Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Request for CoT-E Codes for Comparative Evaluation #7

Open
AI4Math-ShanZhang opened this issue Dec 2, 2024 · 0 comments
Open

Request for CoT-E Codes for Comparative Evaluation #7

AI4Math-ShanZhang opened this issue Dec 2, 2024 · 0 comments

Comments

@AI4Math-ShanZhang
Copy link

Thanks for the great benchmark. I am currently conducting research related to the MathVerse benchmark and deeply appreciate your valuable contributions to the field.

While working on my evaluation, I noticed that the accuracy metrics are available for comparison, but I would like to extend my analysis to include the CoT-E (Chain-of-Thought Evaluation) framework mentioned in your work. Having access to the CoT-E codes would enable me to conduct a more comprehensive evaluation and draw meaningful comparisons with your methodology.

If possible, could you kindly share the CoT-E implementation?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant