Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update hub validators to support remote inference #975

Open
2 tasks
kaushikb11 opened this issue Jul 30, 2024 · 0 comments
Open
2 tasks

Update hub validators to support remote inference #975

kaushikb11 opened this issue Jul 30, 2024 · 0 comments
Labels
enhancement New feature or request

Comments

@kaushikb11
Copy link
Contributor

kaushikb11 commented Jul 30, 2024

Description
Most of the validators don't support remote inference currently.
For example, ToxicLanguage validator runs the model locally even when the remote inference is enabled through

guardrails configure

and/ or use_local is disabled through the Validator.

Ref: https://github.com/guardrails-ai/toxic_language/blob/main/validator/main.py#L152

We need to decouple the local inference and remote inference code within the validators themselves by implementing the
following methods defined in the base class.

  • _inference_local
  • _inference_remote

Interface to implement a Custom Validator

We can use this issue to keep track of list of Validators to support remote inferencing.

  • ToxicLanguage
  • Restrict to Topic
    ....
@kaushikb11 kaushikb11 added the enhancement New feature or request label Jul 30, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant