Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Backport PR #1730 on branch 0.10.x (Fix GH actions benchmark run) #1732

Merged
merged 1 commit into from
Oct 22, 2024

Backport PR #1730: Fix GH actions benchmark run

2b35d81
Select commit
Loading
Failed to load commit list.
Merged

Backport PR #1730 on branch 0.10.x (Fix GH actions benchmark run) #1732

Backport PR #1730: Fix GH actions benchmark run
2b35d81
Select commit
Loading
Failed to load commit list.
scverse-benchmark / benchmark succeeded Oct 22, 2024 in 14m 12s

Benchmark

Benchmark run successful

Details

All benchmarks:

Change Before [49f6cdd] After [2b35d81] Ratio Benchmark (Parameter)
1707488.0 1707769.0 1.00 anndata.GarbargeCollectionSuite.track_peakmem_garbage_collection
132M 134M 1.02 readwrite.H5ADBackedWriteSuite.peakmem_write_compressed('pbmc3k')
135M 135M 1.00 readwrite.H5ADBackedWriteSuite.peakmem_write_full('pbmc3k')
686±5ms 677±6ms 0.99 readwrite.H5ADBackedWriteSuite.time_write_compressed('pbmc3k')
201±2ms 194±6ms 0.97 readwrite.H5ADBackedWriteSuite.time_write_full('pbmc3k')
14.56640625 14.703125 1.01 readwrite.H5ADBackedWriteSuite.track_peakmem_write_compressed('pbmc3k')
14.578125 14.52734375 1.00 readwrite.H5ADBackedWriteSuite.track_peakmem_write_full('pbmc3k')
91214739 91214743 1.00 readwrite.H5ADInMemorySizeSuite.track_actual_in_memory_size('pbmc3k')
23564294 23564294 1.00 readwrite.H5ADInMemorySizeSuite.track_in_memory_size('pbmc3k')
23.6M 23.6M 1.00 readwrite.H5ADReadSuite.mem_readfull_object('pbmc3k')
124M 121M 0.97 readwrite.H5ADReadSuite.peakmem_read_backed('pbmc3k')
148M 153M 1.03 readwrite.H5ADReadSuite.peakmem_read_full('pbmc3k')
142±1ms 142±1ms 1.00 readwrite.H5ADReadSuite.time_read_full('pbmc3k')
1.2188231621663805 1.208352668213457 0.99 readwrite.H5ADReadSuite.track_read_full_memratio('pbmc3k')
150M 148M 0.99 readwrite.H5ADWriteSuite.peakmem_write_compressed('pbmc3k')
148M 153M 1.03 readwrite.H5ADWriteSuite.peakmem_write_full('pbmc3k')
567±4ms 575±1ms 1.01 readwrite.H5ADWriteSuite.time_write_compressed('pbmc3k')
90.3±1ms 89.3±0.5ms 0.99 readwrite.H5ADWriteSuite.time_write_full('pbmc3k')
7.1640625 7.16015625 1.00 readwrite.H5ADWriteSuite.track_peakmem_write_compressed('pbmc3k')
6.5859375 6.6171875 1.00 readwrite.H5ADWriteSuite.track_peakmem_write_full('pbmc3k')
160M 156M 0.97 sparse_dataset.SparseCSRContiguousSlice.peakmem_getitem((10000, 10000), '0:1000')
163M 154M 0.95 sparse_dataset.SparseCSRContiguousSlice.peakmem_getitem((10000, 10000), '0:9000')
157M 158M 1.01 sparse_dataset.SparseCSRContiguousSlice.peakmem_getitem((10000, 10000), ':9000:-1')
156M 154M 0.99 sparse_dataset.SparseCSRContiguousSlice.peakmem_getitem((10000, 10000), '::-2')
158M 157M 0.99 sparse_dataset.SparseCSRContiguousSlice.peakmem_getitem((10000, 10000), 'alternating')
158M 154M 0.98 sparse_dataset.SparseCSRContiguousSlice.peakmem_getitem((10000, 10000), 'arange')
156M 156M 1.00 sparse_dataset.SparseCSRContiguousSlice.peakmem_getitem((10000, 10000), 'array')
154M 154M 1.00 sparse_dataset.SparseCSRContiguousSlice.peakmem_getitem((10000, 10000), 'first')
156M 160M 1.03 sparse_dataset.SparseCSRContiguousSlice.peakmem_getitem_adata((10000, 10000), '0:1000')
158M 162M 1.03 sparse_dataset.SparseCSRContiguousSlice.peakmem_getitem_adata((10000, 10000), '0:9000')
163M 152M 0.94 sparse_dataset.SparseCSRContiguousSlice.peakmem_getitem_adata((10000, 10000), ':9000:-1')
156M 158M 1.01 sparse_dataset.SparseCSRContiguousSlice.peakmem_getitem_adata((10000, 10000), '::-2')
158M 158M 1.00 sparse_dataset.SparseCSRContiguousSlice.peakmem_getitem_adata((10000, 10000), 'alternating')
165M 161M 0.98 sparse_dataset.SparseCSRContiguousSlice.peakmem_getitem_adata((10000, 10000), 'arange')
150M 160M 1.07 sparse_dataset.SparseCSRContiguousSlice.peakmem_getitem_adata((10000, 10000), 'array')
156M 160M 1.02 sparse_dataset.SparseCSRContiguousSlice.peakmem_getitem_adata((10000, 10000), 'first')
1.39±0.2ms 1.37±0.1ms 0.98 sparse_dataset.SparseCSRContiguousSlice.time_getitem((10000, 10000), '0:1000')
5.50±0.4ms 6.43±0.7ms ~1.17 sparse_dataset.SparseCSRContiguousSlice.time_getitem((10000, 10000), '0:9000')
511±5ms 518±6ms 1.01 sparse_dataset.SparseCSRContiguousSlice.time_getitem((10000, 10000), ':9000:-1')
2.54±0.03s 2.53±0.02s 1.00 sparse_dataset.SparseCSRContiguousSlice.time_getitem((10000, 10000), '::-2')
523±2ms 519±3ms 0.99 sparse_dataset.SparseCSRContiguousSlice.time_getitem((10000, 10000), 'alternating')
506±5ms 511±10ms 1.01 sparse_dataset.SparseCSRContiguousSlice.time_getitem((10000, 10000), 'arange')
2.40±0.2ms 2.29±0.2ms 0.95 sparse_dataset.SparseCSRContiguousSlice.time_getitem((10000, 10000), 'array')
998±100μs 1.16±0.06ms ~1.16 sparse_dataset.SparseCSRContiguousSlice.time_getitem((10000, 10000), 'first')
75.4±0.2μs 74.3±0.3μs 0.99 sparse_dataset.SparseCSRContiguousSlice.time_getitem_adata((10000, 10000), '0:1000')
74.9±0.07μs 75.1±1μs 1.00 sparse_dataset.SparseCSRContiguousSlice.time_getitem_adata((10000, 10000), '0:9000')
75.1±0.3μs 76.2±0.4μs 1.01 sparse_dataset.SparseCSRContiguousSlice.time_getitem_adata((10000, 10000), ':9000:-1')
75.1±0.4μs 75.8±0.8μs 1.01 sparse_dataset.SparseCSRContiguousSlice.time_getitem_adata((10000, 10000), '::-2')
258±10μs 277±30μs 1.07 sparse_dataset.SparseCSRContiguousSlice.time_getitem_adata((10000, 10000), 'alternating')
123±0.6μs 125±1μs 1.01 sparse_dataset.SparseCSRContiguousSlice.time_getitem_adata((10000, 10000), 'arange')
112±1μs 113±0.6μs 1.01 sparse_dataset.SparseCSRContiguousSlice.time_getitem_adata((10000, 10000), 'array')
78.2±0.3μs 77.2±0.6μs 0.99 sparse_dataset.SparseCSRContiguousSlice.time_getitem_adata((10000, 10000), 'first')
View more details on scverse-benchmark