Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[AUTOCUT] Gradle Check Flaky Test Report for DeleteByQueryBasicTests #15820

Open
opensearch-ci-bot opened this issue Sep 6, 2024 · 3 comments
Labels
autocut flaky-test Random test failure that succeeds on second run >test-failure Test failure from CI, local build, etc.

Comments

@opensearch-ci-bot
Copy link
Collaborator

opensearch-ci-bot commented Sep 6, 2024

Flaky Test Report for DeleteByQueryBasicTests

Noticed the DeleteByQueryBasicTests has some flaky, failing tests that failed during post-merge actions.

Details

Git Reference Merged Pull Request Build Details Test Name
d5ec1f6 15456 45515 org.opensearch.index.reindex.DeleteByQueryBasicTests.testDeleteByQueryWithMultipleIndices

org.opensearch.index.reindex.DeleteByQueryBasicTests.testMultipleSources
98ed317 16819 51310 org.opensearch.index.reindex.DeleteByQueryBasicTests.testDeleteByQueryWithMultipleIndices

The other pull requests, besides those involved in post-merge actions, that contain failing tests with the DeleteByQueryBasicTests class are:

For more details on the failed tests refer to OpenSearch Gradle Check Metrics dashboard.

@opensearch-ci-bot opensearch-ci-bot added >test-failure Test failure from CI, local build, etc. autocut flaky-test Random test failure that succeeds on second run untriaged labels Sep 6, 2024
@reta reta removed the untriaged label Sep 30, 2024
@reta
Copy link
Collaborator

reta commented Sep 30, 2024

[Catch All Triage - 1, 2, 3, 4]

@prachi-gaonkar
Copy link
Contributor

prachi-gaonkar commented Oct 9, 2024

Hi Team, we are also getting the same error on ppc64le

DeleteByQueryBasicTests > testMultipleSources STANDARD_ERROR
REPRODUCE WITH: ./gradlew ':modules:reindex:test' --tests "org.opensearch.index.reindex.DeleteByQueryBasicTests.testMultipleSources" -Dtests.seed=21BFDE2D5FF80709 -Dtests.security.manager=true -Dtests.jvm.argline="-XX:TieredStopAtLevel=1 -XX:ReservedCodeCacheSize=64m" -Dtests.locale=es-GT -Dtests.timezone=Indian/Kerguelen -Druntime.java=21

DeleteByQueryBasicTests > testMultipleSources FAILED
java.lang.AssertionError:
Expected: an empty iterable
but: [<UnavailableShardsException[[test2][5] primary shard is not active Timeout: [1m], request: [BulkShardRequest [[test2][5]] containing [index {[test2][2], source[{"foo":"a"}]}]]]>,<UnavailableShardsException[[test2][5] primary shard is not active Timeout: [1m], request: [BulkShardRequest [[test2][5]] containing [index {[test2][bogus_doc_aa12], source[{}]}]]]>,<UnavailableShardsException[[test4][7] primary shard is not active Timeout: [1m], request: [BulkShardRequest [[test4][7]] containing [index {[test4][0], source[{"foo":"a"}]}]]]>,<UnavailableShardsException[[test4][4] primary shard is not active Timeout: [1m], request: [BulkShardRequest [[test4][4]] containing [index {[test4][4], source[{"foo":"a"}]}]]]>,<UnavailableShardsException[[test2][6] primary shard is not active Timeout: [1m], request: [BulkShardRequest [[test2][6]] containing [index {[test2][bogus_doc_︞a8], source[{}]}]]]>,<UnavailableShardsException[[test4][7] primary shard is not active Timeout: [1m], request: [BulkShardRequest [[test4][7]] containing [index {[test4][3], source[{"foo":"a"}]}]]]>,<UnavailableShardsException[[test4][4] primary shard is not active Timeout: [1m], request: [BulkShardRequest [[test4][4]] containing [index {[test4][bogus_doc_ꤠa13], source[{}]}]]]>,<UnavailableShardsException[[test2][8] primary shard is not active Timeout: [1m], request: [BulkShardRequest [[test2][8]] containing [index {[test2][8], source[{"foo":"a"}]}]]]>,<UnavailableShardsException[[test2][8] primary shard is not active Timeout: [1m], request: [BulkShardRequest [[test2][8]] containing [index {[test2][bogus_doc_⳸a15], source[{}]}]]]>,<UnavailableShardsException[[test4][4] primary shard is not active Timeout: [1m], request: [BulkShardRequest [[test4][4]] containing [index {[test4][bogus_doc_໇a19], source[{}]}]]]>,<UnavailableShardsException[[test2][6] primary shard is not active Timeout: [1m], request: [BulkShardRequest [[test2][6]] containing [index {[test2][bogus_doc_┯a18], source[{}]}]]]>,<UnavailableShardsException[[test4][8] primary shard is not active Timeout: [1m], request: [BulkShardRequest [[test4][8]] containing [index {[test4][1], source[{"foo":"a"}]}]]]>,<UnavailableShardsException[[test2][6] primary shard is not active Timeout: [1m], request: [BulkShardRequest [[test2][6]] containing [index {[test2][bogus_doc_ꥐa24], source[{}]}]]]>,<UnavailableShardsException[[test4][5] primary shard is not active Timeout: [1m], request: [BulkShardRequest [[test4][5]] containing [index {[test4][bogus_doc_⡟a5], source[{}]}]]]>,<UnavailableShardsException[[test2][8] primary shard is not active Timeout: [1m], request: [BulkShardRequest [[test2][8]] containing [index {[test2][1], source[{"foo":"a"}]}]]]>,<UnavailableShardsException[[test2][8] primary shard is not active Timeout: [1m], request: [BulkShardRequest [[test2][8]] containing [index {[test2][bogus_doc_नa3], source[{}]}]]]>,<UnavailableShardsException[[test2][7] primary shard is not active Timeout: [1m], request: [BulkShardRequest [[test2][7]] containing [index {[test2][3], source[{"foo":"a"}]}]]]>,<UnavailableShardsException[[test4][5] primary shard is not active Timeout: [1m], request: [BulkShardRequest [[test4][5]] containing [index {[test4][2], source[{"foo":"a"}]}]]]>]
at __randomizedtesting.SeedInfo.seed([21BFDE2D5FF80709:A616F239B5B2A95D]:0)
at org.hamcrest.MatcherAssert.assertThat(MatcherAssert.java:18)
at org.junit.Assert.assertThat(Assert.java:964)
at org.junit.Assert.assertThat(Assert.java:930)
at org.opensearch.test.OpenSearchIntegTestCase.indexRandom(OpenSearchIntegTestCase.java:1618)
at org.opensearch.test.OpenSearchIntegTestCase.indexRandom(OpenSearchIntegTestCase.java:1531)
at org.opensearch.test.OpenSearchIntegTestCase.indexRandom(OpenSearchIntegTestCase.java:1515)
at org.opensearch.index.reindex.DeleteByQueryBasicTests.testMultipleSources(DeleteByQueryBasicTests.java:357)

@prachi-gaonkar
Copy link
Contributor

prachi-gaonkar commented Oct 15, 2024

Hi Team
is there any update on this issue?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
autocut flaky-test Random test failure that succeeds on second run >test-failure Test failure from CI, local build, etc.
Projects
None yet
Development

No branches or pull requests

3 participants