You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Describe the bug
The model_path parameter was renamed to model in #243. This change is not reflected on the current llama-cpp-haystack version on pypi.
The documentation showcases the new API with model, causing a mismatch.
fromhaystack_integrations.components.generators.llama_cppimportLlamaCppGeneratorgenerator=LlamaCppGenerator(
model="openhermes-2.5-mistral-7b.Q4_K_M.gguf",
n_ctx=512,
n_batch=128,
generation_kwargs={"max_tokens": 128, "temperature": 0.1},
)
generator.warm_up()
prompt=f"Who is the best American actor?"result=generator.run(prompt)
Describe your environment (please complete the following information):
OS: Linux
Haystack version: haystack-ai==2.0.0b8
Integration version: llama-cpp-haystack==0.2.1
The text was updated successfully, but these errors were encountered:
Describe the bug
The
model_path
parameter was renamed tomodel
in #243. This change is not reflected on the currentllama-cpp-haystack
version on pypi.The documentation showcases the new API with
model
, causing a mismatch.To Reproduce
To download the model:
curl -L -O "https://huggingface.co/TheBloke/OpenHermes-2.5-Mistral-7B-GGUF/resolve/main/openhermes-2.5-mistral-7b.Q4_K_M.gguf"
Describe your environment (please complete the following information):
Linux
haystack-ai==2.0.0b8
llama-cpp-haystack==0.2.1
The text was updated successfully, but these errors were encountered: