ci: integrated-benchmark

[KSXGitHub]

Limitations

• Statistical outliers: Caused by other jobs still running in parallel. The current workaround is to re-run the job. To completely fix this however, this benchmark must be set to be after all other jobs have been completed, which requires touching other workflows.
• No windows: Executing this on Windows CI is just too hard: cannot use powershell because of execution policy, and cannot use bash because it points to WSL which causes error.
• No macOS: The benchmark values are too chaotic and unreliable.
• No clean install yet: It's too slow.

[github-actions]

Micro-Benchmark Results

Linux

group                          main                                   pr
-----                          ----                                   --
tarball/download_dependency    1.02     10.5±5.32ms   412.5 KB/sec    1.00     10.3±3.84ms   419.3 KB/sec

[github-actions]

Integrated-Benchmark Report (Linux)

Scenario: Frozen Lockfile

Command	Mean [ms]	Min [ms]	Max [ms]	Relative
pacquet@HEAD	152.4 ± 16.1	129.5	188.0	1.09 ± 0.15
pacquet@main	139.9 ± 12.3	124.9	158.1	1.00

[github-actions]

Integrated-Benchmark Report (macOS)

Scenario: Frozen Lockfile

Command	Mean [ms]	Min [ms]	Max [ms]	Relative
pacquet@HEAD	831.8 ± 148.7	627.0	1082.4	1.07 ± 0.30
pacquet@main	773.9 ± 167.6	565.1	1145.6	1.00