[Bug]: too many open files

[arademaker]

Is there an existing issue for this?

• I have searched the existing issues

Environment

- Milvus version: 2.5.0
- Deployment mode(standalone or cluster): standalone
- MQ type(rocksmq, pulsar or kafka):    
- SDK version(e.g. pymilvus v2.0.0rc2):
- OS(Ubuntu or CentOS): MacOS
- CPU/Memory: Apple M1 Max 32GB
- GPU: 
- Others:

Current Behavior

to many messages like:

E0000 00:00:1732805875.531820   37843 wakeup_fd_pipe.cc:41] pipe creation failed (24): Too many open files
E0000 00:00:1732805875.533009   37843 ev_poll_posix.cc:945] pollset_work: UNKNOWN:pipe: Too many open files (24) {created_time:"2024-11-28T11:57:55.531926-03:00"}
E0000 00:00:1732805875.533610   37843 completion_queue.cc:1047] Completion queue next failed: UNKNOWN:pipe: Too many open files (24) {created_time:"2024-11-28T11:57:55.531926-03:00"}
E0000 00:00:1732805875.600874   37843 wakeup_fd_pipe.cc:41] pipe creation failed (24): Too many open files
E0000 00:00:1732805875.600937   37843 ev_poll_posix.cc:945] pollset_work: UNKNOWN:pipe: Too many open files (24) {created_time:"2024-11-28T11:57:55.600932-03:00"}
E0000 00:00:1732805875.600967   37843 completion_queue.cc:1047] Completion queue next failed: UNKNOWN:pipe: Too many open files (24) {created_time:"2024-11-28T11:57:55.600932-03:00"}

Expected Behavior

No response

Steps To Reproduce

% pip list | grep -i mil
milvus-lite           2.4.10
milvus-model          0.2.9
pymilvus              2.5.0

Error right after the encoding of a query

model_ef = model.dense.SentenceTransformerEmbeddingFunction(
    model_name="Alibaba-NLP/gte-multilingual-base",
    trust_remote_code=True,
    device='cpu'
)
...
model_ef.encode_queries([input_query]).  

### Milvus Log

_No response_

### Anything else?

_No response_

[yanliang567]

@arademaker it seems the error msg happened before milvus api calling. could you please try to run the cmd below:
ulimit -n 10240
also we searched the error msg and found a similar issue for your reference.

/assign @arademaker
/unassign

[stale]

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.
Rotten issues close after 30d of inactivity. Reopen the issue with /reopen.