Add IIRC scenario (?) #397
Replies: 2 comments
-
My guess from a quick look is that you only need a different Accuracy metric, the rest should work as is. It could be a good test to check if avalanche works with different metrics and ensure that the accuracy is not hardcoded anywhere (as it was in the old eval plugin). |
Beta Was this translation helpful? Give feedback.
-
I agree with @AntonioCarta, I also quick-checked the site and seems that we can smoothly integrate the scenario just using an ad hoc accuracy metric. |
Beta Was this translation helpful? Give feedback.
-
We should check how to integrate this scenario in our framework: https://chandar-lab.github.io/IIRC
The difference its mostly in the evaluation part, where a sample have multiple correct labels.
Beta Was this translation helpful? Give feedback.
All reactions