This repository has been archived by the owner on Sep 12, 2024. It is now read-only.
Replies: 1 comment
-
Seems rwkv.cpp will re-loading .bin from disk every time I call createCompletion |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
In the example
do we need to store the
llama
variable in global, to reuse it? Will it speedup or reduce memory usage?And I found
await llama.createCompletion
never ends, will this cause memory leak?Beta Was this translation helpful? Give feedback.
All reactions