Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

docCOMET available ? #230

Open
nicolasdahan opened this issue Sep 9, 2024 · 1 comment
Open

docCOMET available ? #230

nicolasdahan opened this issue Sep 9, 2024 · 1 comment

Comments

@nicolasdahan
Copy link

2) We now support [DocCOMET](https://statmt.org/wmt22/pdf/2022.wmt-1.6.pdf), a document-level extension of COMET which can utilize contextual information. Using context improves accuracy on discourse phenomena tasks as well as referenceless evaluation of [chat translation quality](https://arxiv.org/pdf/2403.08314).

Is docCOMET really available?

the original repo hasn't been updated for a while (https://github.com/amazon-science/doc-mt-metrics/tree/main)

regards

@YutongWang1216
Copy link

I have the same confusion. From https://github.com/Unbabel/COMET/blob/master/comet/cli/score.py we can see a parameter "--enable-context" has been added to the script, but it seems the package installed from pip has not been updated, since running comet-score --enable-context will raise the following error:

comet-score: error: Unrecognized arguments: --enable-context

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants