Performance Regression or Improvement: pytorch_image_classification_benchmarks-resnet101-mean_load_model_latency_milli_secs:mean_load_model_latency_milli_secs

[github-actions]

Performance change found in the
test: pytorch_image_classification_benchmarks-resnet101-mean_load_model_latency_milli_secs for the metric: mean_load_model_latency_milli_secs.

For more information on how to triage the alerts, please look at
Triage performance alert issues section of the README.

Test description: Pytorch image classification on 50k images of size 224 x 224 with resnet 101.
Test link -

beam/.test-infra/jenkins/job_InferenceBenchmarkTests_Python.groovy

Line 34 in 42d0a6e

test : 'apache_beam.testing.benchmarks.inference.pytorch_image_classification_benchmarks',

Test dashboard - http://metrics.beam.apache.org/d/ZpS8Uf44z/python-ml-runinference-benchmarks?orgId=1&viewPanel=7

timestamp: Mon Oct 23 05:03:54 2023, metric_value: 67558.10
timestamp: Mon Oct 23 04:30:07 2023, metric_value: 68828.22
timestamp: Mon Oct 23 04:19:35 2023, metric_value: 68248.07
timestamp: Sun Oct 22 18:24:05 2023, metric_value: 70679.95
timestamp: Sun Oct 22 06:00:37 2023, metric_value: 68930.44
timestamp: Sun Oct 22 04:30:11 2023, metric_value: 71490.65
timestamp: Sun Oct 22 04:20:04 2023, metric_value: 68338.61
timestamp: Sat Oct 21 18:23:07 2023, metric_value: 71755.39
timestamp: Sat Oct 21 04:29:30 2023, metric_value: 68748.29
timestamp: Sat Oct 21 04:22:45 2023, metric_value: 70340.81
timestamp: Sat Oct 21 04:18:20 2023, metric_value: 71591.09 <---- Anomaly
timestamp: Fri Oct 20 18:24:10 2023, metric_value: 78505.62
timestamp: Fri Oct 20 04:29:20 2023, metric_value: 75849.63
timestamp: Fri Oct 20 04:28:12 2023, metric_value: 72637.09
timestamp: Thu Oct 19 18:26:07 2023, metric_value: 96818.89
timestamp: Thu Oct 19 10:44:33 2023, metric_value: 76664.97
timestamp: Thu Oct 19 04:31:55 2023, metric_value: 84824.80
timestamp: Thu Oct 19 04:21:19 2023, metric_value: 76400.78
timestamp: Wed Oct 18 18:25:37 2023, metric_value: 84549.59
timestamp: Wed Oct 18 13:57:30 2023, metric_value: 86576.71
timestamp: Wed Oct 18 11:01:41 2023, metric_value: 80095.78

[AnandInguva]

I don't see any obvious changes to Beam during Oct 20th and Oct 21st -

[AnandInguva]

there is no actual regression. Closing as noise.