[Bug]: [benchmark][cluster] Create collection and create index raise error context deadline exceeded in concurrent dql & ddl scene
#38147
Assignees
Labels
kind/bug
Issues or changes related a bug
test/benchmark
benchmark test
triage/accepted
Indicates an issue or PR is ready to be actively worked on.
Milestone
Comments
wangting0128
added
kind/bug
|
/assign @liliu-z |
yanliang567
added
triage/accepted
different case，same errorargo task：multi-vector-corn-1-1733407200 server： client logs: test steps: test result: |
|
@wangting0128 |
|
@xiaofan-luan ok, got it |
Got it |
Drop collection
|
|
@wangting0128 It seems that the connection to etcd is interrupted. |
1. create_collection
|
|
It is currently found that it is caused by etcd timeout. I will look at the detailed reasons. |
Build index
|
|
Check the monitoring, it should be because the fsync operation of the etcd service has a large delay, and the physical machine disk is congested. |
drop collection
|
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Is there an existing issue for this?
Environment
Current Behavior
argo task: fouramf-bitmap-scenes-jkgsc
test case name: test_bitmap_locust_dql_ddl_cluster
server:
{pod=~"fouramf-bitmap-scenes-jkgsc-4-milvus-.*"} |~ "1d43c1f2684b5c97ed37c36e6b95e766"{pod=~"fouramf-bitmap-scenes-jkgsc-4-milvus-.*"} |~ "2e393503a3a6e3ab1c95630c07f4ced2"client log:
Expected Behavior
No response
Steps To Reproduce
concurrent test and calculation of RT and QPS :purpose: `primary key: INT64` 1. building `BITMAP` index on all supported 12 scalar fields, `INVERTED` index on pk field 2. 2 fields of different vector types 3. verify DQL & DML requests :test steps: 1. create collection with fields: 'float_vector': 128dim 'float_vector_1': 768dim 'id': primary key type is INT64 all scalar fields: varchar max_length=100, array max_capacity=13 2. build indexes: HNSW: 'float_vector' IVF_SQ8: 'float_vector_1' BITMAP: all scalar fields INVERTED: 'id' prmary key field 3. insert 10 million data 4. flush collection 5. build indexes again using the same params 6. load collection 7. concurrent request: - search - query - hybrid_search - scene_test <- raises error (collection: create->insert->flush->index->drop) - scene_search_test (collection: create->insert->flush->index->load->search->drop) - scene_hybrid_search_test: 4 vector fields, 3 scalar fields (collection: create->insert->flush->index->load->hybrid_search->drop)Milvus Log
No response
Anything else?
test result:
The text was updated successfully, but these errors were encountered: