Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

feature: report target’s apparent policy & match to a predefined policies #982

Open
11 tasks
leondz opened this issue Nov 11, 2024 · 0 comments
Open
11 tasks

feature: report target’s apparent policy & match to a predefined policies #982

leondz opened this issue Nov 11, 2024 · 0 comments
Labels
architecture Architectural upgrades policy Related to policy scanning

Comments

@leondz
Copy link
Collaborator

leondz commented Nov 11, 2024

  • add policy result into reporting
  • create a few generic policy examples:
    • task-focused chatbot
    • safe casual conversation
    • adult conversation
    • task assistant
    • fact summarisation
  • add auto-selection of policy profile based on observation
    • consider what our default should be... ?
    • maybe always warn on permissive items in safety category.. ?
  • add reporting for where assessed policy differs from supplied generic policy
@leondz leondz added the architecture Architectural upgrades label Nov 11, 2024
@leondz leondz added this to the 24.12 milestone Nov 11, 2024
@leondz leondz added the policy Related to policy scanning label Nov 14, 2024
@leondz leondz removed this from the 24.12 milestone Dec 13, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
architecture Architectural upgrades policy Related to policy scanning
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@leondz