Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

humaneval jsonl support #75

Merged
merged 2 commits into from
Dec 5, 2024
Merged

humaneval jsonl support #75

merged 2 commits into from
Dec 5, 2024

Conversation

AnirudhG07
Copy link
Collaborator

For #74 @mrigankpawagi, what else have to be changed?
Like in some codes we have mentioned HumanEval.json usages. all should be converted to jsonl??

with open(file_path, "r") as json_file:
base_dir = os.path.dirname(__file__)
path_humaneval = os.path.join(base_dir, "HumanEval.jsonl")
with open(path_humaneval, "r") as json_file:
data = json.load(json_file)
Copy link
Owner

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

You will now have to [json.load(line) for line in json_file.readlines()] (change variable names ^_^)

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Check now.

Copy link
Owner

@mrigankpawagi mrigankpawagi left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@mrigankpawagi mrigankpawagi merged commit 17bcc89 into main Dec 5, 2024
1 check passed
@mrigankpawagi mrigankpawagi deleted the jsonl_sup branch December 5, 2024 18:39
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants