Skip to content

Commit

Permalink
Update run_inference_vllm.ipynb (#33032)
Browse files Browse the repository at this point in the history
Enable verbose logging for Dataflow launch.
  • Loading branch information
tvalentyn authored Nov 7, 2024
1 parent e598df7 commit 9ed8187
Showing 1 changed file with 1 addition and 0 deletions.
1 change: 1 addition & 0 deletions examples/notebooks/beam-ml/run_inference_vllm.ipynb
Original file line number Diff line number Diff line change
Expand Up @@ -484,6 +484,7 @@
" def process(self, element, *args, **kwargs):\n",
" yield \"Input: {input}, Output: {output}\".format(input=element.example, output=element.inference)\n",
"\n",
"logging.getLogger().setLevel(logging.INFO) # Output additional Dataflow Job metadata and launch logs. \n",
"prompts = [\n",
" \"Hello, my name is\",\n",
" \"The president of the United States is\",\n",
Expand Down

0 comments on commit 9ed8187

Please sign in to comment.