Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Performance Regression or Improvement: test_cloudml_benchmark_cirteo_no_shuffle_10GB-runtime_sec:runtime_sec #30726

Closed
github-actions bot opened this issue Mar 23, 2024 · 1 comment
Labels
awaiting triage perf-alert Automatically filed performance-related alerts.

Comments

@github-actions
Copy link
Contributor

Performance change found in the
test: test_cloudml_benchmark_cirteo_no_shuffle_10GB-runtime_sec for the metric: runtime_sec.

For more information on how to triage the alerts, please look at
Triage performance alert issues section of the README.

Test description: TFT Criteo test on 10 GB data with no Reshuffle.
Test link - Test link


timestamp: Fri Mar 22 22:14:59 2024, metric_value: 3018.84
timestamp: Thu Mar 21 22:14:22 2024, metric_value: 2756.74
timestamp: Tue Mar 19 22:09:13 2024, metric_value: 2896.13
timestamp: Mon Mar 18 22:13:19 2024, metric_value: 3013.13
timestamp: Sun Mar 17 22:04:48 2024, metric_value: 2413.79
timestamp: Sat Mar 16 21:56:40 2024, metric_value: 2181.14
timestamp: Fri Mar 15 21:58:19 2024, metric_value: 2228.11
timestamp: Thu Mar 14 22:18:48 2024, metric_value: 3161.62
timestamp: Wed Mar 13 22:24:21 2024, metric_value: 3143.32
timestamp: Tue Mar 12 22:02:45 2024, metric_value: 2496.88
timestamp: Mon Mar 11 22:07:51 2024, metric_value: 2751.21 <---- Anomaly
timestamp: Sun Mar 10 21:55:10 2024, metric_value: 2041.20
timestamp: Sat Mar  9 21:56:51 2024, metric_value: 2123.19
timestamp: Fri Mar  8 21:56:27 2024, metric_value: 2205.80
timestamp: Thu Mar  7 21:58:06 2024, metric_value: 2136.08
timestamp: Wed Mar  6 22:03:23 2024, metric_value: 2555.93
timestamp: Tue Mar  5 22:19:15 2024, metric_value: 3149.16
timestamp: Mon Mar  4 22:00:18 2024, metric_value: 2372.29
timestamp: Sun Mar  3 21:56:52 2024, metric_value: 2106.98
timestamp: Sat Mar  2 21:54:38 2024, metric_value: 2074.08
timestamp: Fri Mar  1 21:57:50 2024, metric_value: 2165.85

@github-actions github-actions bot added awaiting triage perf-alert Automatically filed performance-related alerts. labels Mar 23, 2024
Copy link
Contributor Author

Performance change found in the
test: test_cloudml_benchmark_cirteo_no_shuffle_10GB-runtime_sec for the metric: runtime_sec.

For more information on how to triage the alerts, please look at
Triage performance alert issues section of the README.

Test description: TFT Criteo test on 10 GB data with no Reshuffle.
Test link - Test link


timestamp: Fri Mar 29 22:11:09 2024, metric_value: 2965.23
timestamp: Thu Mar 28 22:30:04 2024, metric_value: 3515.37
timestamp: Wed Mar 27 22:29:43 2024, metric_value: 3638.77
timestamp: Tue Mar 26 22:28:53 2024, metric_value: 3627.53 <---- Anomaly
timestamp: Mon Mar 25 22:10:30 2024, metric_value: 2901.97
timestamp: Sun Mar 24 22:05:36 2024, metric_value: 2497.68
timestamp: Sat Mar 23 22:01:08 2024, metric_value: 2415.61
timestamp: Fri Mar 22 22:14:59 2024, metric_value: 3018.84
timestamp: Thu Mar 21 22:14:22 2024, metric_value: 2756.74
timestamp: Tue Mar 19 22:09:13 2024, metric_value: 2896.13
timestamp: Mon Mar 18 22:13:19 2024, metric_value: 3013.13
timestamp: Sun Mar 17 22:04:48 2024, metric_value: 2413.79
timestamp: Sat Mar 16 21:56:40 2024, metric_value: 2181.14
timestamp: Fri Mar 15 21:58:19 2024, metric_value: 2228.11

@damccorm damccorm closed this as completed Apr 2, 2024
@github-actions github-actions bot added this to the 2.56.0 Release milestone Apr 2, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
awaiting triage perf-alert Automatically filed performance-related alerts.
Projects
None yet
Development

No branches or pull requests

1 participant