Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Regression Tuning: link_fake_thread_nlu_financial_request.yml #776

Merged
merged 4 commits into from
Sep 7, 2023

Conversation

morriscode
Copy link
Member

This rule is currently in discovery. We have several regressions that it was solving for, but many more FP's. Added new logic and increased the required matches.

@morriscode
Copy link
Member Author

Letting mimic run to explore regression.

@morriscode
Copy link
Member Author

Tracking mimic new flags here

23 New FN/TP pickups with the revisions.
3 messages Mimic says are flagging are FP's. However they do not flag when I run the rule against them directly.

@morriscode morriscode requested review from aidenmitchell and a team September 6, 2023 20:34
@morriscode
Copy link
Member Author

Still seeing a decent amount of marketing, adding some additional logic, and combining request and financial together.

@morriscode morriscode removed request for a team and aidenmitchell September 6, 2023 20:50
@morriscode
Copy link
Member Author

New revisions have quashed marketing noise. Rule efficacy looks strong in hunts and matches where it needs to in regression testing.

@morriscode morriscode requested a review from a team September 6, 2023 21:26
@morriscode morriscode merged commit 9850917 into main Sep 7, 2023
@morriscode morriscode deleted the morriscode-patch-2 branch September 7, 2023 16:06
@notion-workspace
Copy link

1693882358

@notion-workspace
Copy link

1693963446

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants