Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add scripts to create benchmark in ci. #896

Merged
merged 5 commits into from
Aug 1, 2024

Conversation

Wrench-Git
Copy link
Collaborator

@Wrench-Git Wrench-Git commented Jul 15, 2024

用于在ci中添加LLM benchmark perf的代码存档

"name": "llama2_7B",
"partition": "pat_rd",
"gpu_requests": "gpu:8",
"script": "run_llama_finetune_perf.py",
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

这个.py脚本在哪里啊

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

deeplink的alpaca-lora,branch sco_benchmark_finetune

zhangzefeng92 pushed a commit to DeepLink-org/deeplink.framework.dev that referenced this pull request Jul 18, 2024
@yangbofun
Copy link
Collaborator

yangbofun commented Jul 22, 2024

在描述里,贴一下运行的结果。

@yangbofun
Copy link
Collaborator

这里是为了搞模型性能测试?

@wugeshui
Copy link
Contributor

NV上run的时候,需同时考虑sco和1424集群

@mrdanielw mrdanielw merged commit 1bffe33 into DeepLink-org:main Aug 1, 2024
27 of 29 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants