Skip to content

Commit

Permalink
correct example snippet
Browse files Browse the repository at this point in the history
  • Loading branch information
riteshghorse committed Sep 19, 2023
1 parent e2397fb commit e0fca8a
Showing 1 changed file with 1 addition and 1 deletion.
Original file line number Diff line number Diff line change
Expand Up @@ -603,7 +603,7 @@ def __init__(
Example Usage::
model_handler = HuggingFacePipelineModelHandler(
model_uri="bert-base-uncased", model="meta-llama/Llama-2-7b-hf",
task="text-generation", model="meta-llama/Llama-2-7b-hf",
load_pipeline_args={'model_kwargs':{'quantization_map':config}})
inference_fn: the inference function to use during RunInference.
Expand Down

0 comments on commit e0fca8a

Please sign in to comment.