Async API Support. #147
Closed
kentarospin98
started this conversation in
Ideas
Async API Support.
#147
Replies: 1 comment
-
|
Hey hey - a few changes were made to better support async callables. Have you tried these recently? |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Hello. So I was adding guardrails to our engine, and realized we need an Async API for guardrails. We wrap around aiohttp to call various LLMs without blocking execution, and would need a way for guardrails to call the respective async functions, and not block the thread either. Potentially providing async versions of Runner, and PromptCallable?
Beta Was this translation helpful? Give feedback.
All reactions