You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
ok, it looks like its due to a version mismatch with lora. In lora_manager.py in my version of tensorrt_llm
the method has three parameters instead of two:
def from_hf(cls, hf_lora_dir, hf_modules_to_trtllm_modules,
trtllm_modules_to_hf_modules):
It looks like when I run the build-llama.sh script, it fails here:
File "/home/vng/dev/trt-llm-rag-linux/build.py", line 895, in
args = parse_arguments()
File "/home/vng/dev/trt-llm-rag-linux/build.py", line 549, in parse_arguments
lora_config = LoraConfig.from_hf(args.hf_lora_dir,
TypeError: LoraConfig.from_hf() missing 1 required positional argument: 'trtllm_modules_to_hf_modules'
Looking at the script, the default for args.hf_lora_dir is None, and its not explicitly provided in the build-llama.sh script.
Is this intentional?
The text was updated successfully, but these errors were encountered: