Skip to content

Commit

Permalink
Update litgpt/deploy/serve.py
Browse files Browse the repository at this point in the history
  • Loading branch information
rasbt authored Apr 22, 2024
1 parent 8170500 commit d7a4ac4
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion litgpt/deploy/serve.py
Original file line number Diff line number Diff line change
Expand Up @@ -114,7 +114,7 @@ def run_server(
generated text but can also lead to more incoherent texts.
max_new_tokens: The number of generation steps to take.
devices: How many devices/GPUs to use.
accelerator: The type of accelerator to use. For example, "auto", "cuda", "cpu", or "mps".capitalize
accelerator: The type of accelerator to use. For example, "auto", "cuda", "cpu", or "mps".
The "auto" setting (default) chooses a GPU if available, and otherwise uses a CPU.
port: The network port number on which the model is configured to be served.
"""
Expand Down

0 comments on commit d7a4ac4

Please sign in to comment.