Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

JOB workload #46

Merged
merged 23 commits into from
Nov 7, 2024
Merged

JOB workload #46

merged 23 commits into from
Nov 7, 2024

Conversation

wangpatrick57
Copy link
Member

@wangpatrick57 wangpatrick57 commented Nov 3, 2024

Summary: Added the JOB workload to the gym.

Demo:
Screenshot 2024-11-06 at 12 23 18
The JOB queries in the workspace.

Details:

  • The entire pipeline from data/workload creation to dbdata creation and tuning are all working as verified by a new test in E2E tests.
  • Significantly refactored how workload_name works to accommodate both tpch and job.
  • We get the JOB queries from a mirror of the job repo.
  • We use the standard link for the JOB data.
  • We use a schema defined in the dbgym repo (as opposed to the schemas in the job repo or in the JOB data).

@wangpatrick57 wangpatrick57 changed the title job (draft PR for CI) JOB workload Nov 6, 2024
@wangpatrick57 wangpatrick57 marked this pull request as ready for review November 7, 2024 01:29
@wangpatrick57 wangpatrick57 merged commit 4f9e0e6 into cmu-db:main Nov 7, 2024
1 check passed
@wangpatrick57 wangpatrick57 deleted the job branch November 7, 2024 02:01
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant