You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Description
Most of the validators don't support remote inference currently.
For example, ToxicLanguage validator runs the model locally even when the remote inference is enabled through
guardrails configure
and/ or use_local is disabled through the Validator.
We need to decouple the local inference and remote inference code within the validators themselves by implementing the
following methods defined in the base class.
Description
Most of the validators don't support remote inference currently.
For example,
ToxicLanguage
validator runs the model locally even when the remote inference is enabled throughand/ or
use_local
is disabled through the Validator.Ref: https://github.com/guardrails-ai/toxic_language/blob/main/validator/main.py#L152
We need to decouple the local inference and remote inference code within the validators themselves by implementing the
following methods defined in the base class.
Interface to implement a Custom Validator
We can use this issue to keep track of list of Validators to support remote inferencing.
....
The text was updated successfully, but these errors were encountered: