New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

For Grammar Error Correction task, why F0.5 is consider for evaluation and not F1? (Giving twice weight to precision than recall) #574

Open

chayan-dhaddha opened this issue Aug 18, 2021 · 1 comment

chayan-dhaddha commented Aug 18, 2021

No description provided.

Contributor

vdobrovolskii commented Oct 2, 2021

You might want to check the CoNLL-2014 publication at https://aclanthology.org/W14-1701/
Section 4:

F0.5 emphasizes precision twice as much as recall, while F1 weighs precision and recall equally. When a grammar checker is put into actual use, it is important that its proposed corrections are highly accurate in order to gain user acceptance. Neglecting to propose a correction is not as bad as proposing an erroneous correction.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment