Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

{ai}[foss/2023a] PyTorch-bundle v2.3.0 w/ CUDA 12.1.1 #22048

Open
wants to merge 1 commit into
base: develop
Choose a base branch
from
Open

{ai}[foss/2023a] PyTorch-bundle v2.3.0 w/ CUDA 12.1.1 #22048

wants to merge 1 commit into from

Conversation

smoors
Copy link
Contributor

@smoors smoors commented Dec 18, 2024 •
edited
Loading

(created using eb --new-pr)

depends on:

@smoors smoors added the update label Dec 18, 2024
@github-actions GitHub Actions
Copy link

Updated software PyTorch-bundle-2.3.0-foss-2023a-CUDA-12.1.1.eb

Diff against PyTorch-bundle-2.1.2-foss-2023a.eb

easybuild/easyconfigs/p/PyTorch-bundle/PyTorch-bundle-2.1.2-foss-2023a.eb

diff --git a/easybuild/easyconfigs/p/PyTorch-bundle/PyTorch-bundle-2.1.2-foss-2023a.eb b/easybuild/easyconfigs/p/PyTorch-bundle/PyTorch-bundle-2.3.0-foss-2023a-CUDA-12.1.1.eb
index 4c8d8ef847..a744737deb 100644
--- a/easybuild/easyconfigs/p/PyTorch-bundle/PyTorch-bundle-2.1.2-foss-2023a.eb
+++ b/easybuild/easyconfigs/p/PyTorch-bundle/PyTorch-bundle-2.3.0-foss-2023a-CUDA-12.1.1.eb
@@ -1,7 +1,8 @@
 easyblock = 'PythonBundle'
 
 name = 'PyTorch-bundle'
-version = '2.1.2'
+version = '2.3.0'
+versionsuffix = '-CUDA-%(cudaver)s'
 
 homepage = 'https://pytorch.org/'
 description = """PyTorch with compatible versions of official Torch extensions."""
@@ -22,8 +23,9 @@ builddependencies = [
 ]
 
 dependencies = [
+    ('CUDA', '12.1.1', '', SYSTEM),
     ('Python', '3.11.3'),
-    ('PyTorch', version),
+    ('PyTorch', version, versionsuffix),
     ('Pillow-SIMD', '9.5.0'),  # for torchvision
     ('libjpeg-turbo', '2.1.5.1'),  # for torchvision
     ('SentencePiece', '0.2.0'),  # for torchtext
@@ -39,84 +41,83 @@ use_pip = True
 
 # Check with https://pytorch.org/audio/stable/installation.html#compatibility-matrix
 exts_list = [
-    ('portalocker', '2.8.2', {
-        'checksums': ['2b035aa7828e46c58e9b31390ee1f169b98e1066ab10b9a6a861fe7e25ee4f33'],
+    ('tensordict', '0.4.0', {
+        'source_urls': ['https://github.com/pytorch/%(name)s/archive'],
+        'sources': [{'download_filename': 'v%(version)s.tar.gz', 'filename': '%(name)s-%(version)s.tar.gz'}],
+        'checksums': ['c6a565cc88d4f8bc1e1f5e6aba23c2c099f08799730c2716fe6b8706d015b7a5'],
+    }),
+    ('torchrl', '0.4.0', {
+        'source_urls': ['https://github.com/pytorch/rl/archive'],
+        'sources': [{'download_filename': 'v%(version)s.tar.gz', 'filename': '%(name)s-%(version)s.tar.gz'}],
+        'checksums': ['8851a84316f2a1d61d23ec753c90b545bc6479890ec65c5278987ae7c8a2ceec'],
     }),
-    ('torchdata', '0.7.1', {
+    ('portalocker', '3.0.0', {
+        'checksums': ['21f535de2e7a82c94c130c054adb5c7421d480d5619d61073996e2f89bcb879b'],
+    }),
+    ('torchdata', '0.8.0', {
         'preinstallopts': "USE_SYSTEM_LIBS=1 ",
+        'runtest': False,  # circular test requirements
         'source_urls': ['https://github.com/pytorch/data/archive'],
         'sources': [{'download_filename': 'v%(version)s.tar.gz', 'filename': '%(name)s-%(version)s.tar.gz'}],
-        'checksums': ['ef9bbdcee759b53c3c9d99e76eb0a66da33d36bfb7f859a25a9b5e737a51fa23'],
-        'runtest': False,  # circular test requirements
+        'checksums': ['d5d27b264e79d7d00ad4998f14d097b770332d979672dceb6d038caf204f1208'],
     }),
-    ('torchtext', '0.16.2', {
+    ('torchtext', '0.18.0', {
         'patches': [
             'torchtext-0.14.1_use-system-libs.patch',
             'torchtext-0.16.2_download-to-project-root.patch',
         ],
-        'source_urls': ['https://github.com/pytorch/text/archive'],
-        'sources': [{'download_filename': 'v%(version)s.tar.gz', 'filename': '%(name)s-%(version)s.tar.gz'}],
-        'checksums': [
-            {'torchtext-0.16.2.tar.gz': '6574b012804f65220329a2ad34a95c18e4df0d4cff2f862fb7862d57b374b013'},
-            {'torchtext-0.14.1_use-system-libs.patch':
-             '1366d10c4755b6003194f7313ca11d165a80a13d325bee9d669ea2b333d82536'},
-            {'torchtext-0.16.2_download-to-project-root.patch':
-             '9d5599a9983729cf1fc7ab2a2f65d1887f223f528e15662ba1b4a5e359c9686d'},
-        ],
         'runtest': (
             'pytest test/torchtext_unittest'
             ' -k "not test_vocab_from_raw_text_file"'  # segfaults
             '" and not test_get_tokenizer_moses"'  # requires sacremoses
             '" and not test_get_tokenizer_spacy"'  # requires spaCy
             '" and not test_download_charngram_vectors"'  # requires internet access and required host may fail
+            '" and not test_download_glove_vectors"'  # requires internet access and required host may fail
+            '" and not test_vectors_get_vecs"'  # requires internet access and required host may fail
         ),
+        'source_urls': ['https://github.com/pytorch/text/archive'],
+        'sources': [{'download_filename': 'v%(version)s.tar.gz', 'filename': '%(name)s-%(version)s.tar.gz'}],
         'testinstall': True,
+        'checksums': [
+            {'torchtext-0.18.0.tar.gz': 'fe4eb4b361388ef7840dcad117ae95b32252db5520c4eb2b3bead627468fbdf2'},
+            {'torchtext-0.14.1_use-system-libs.patch':
+             '1366d10c4755b6003194f7313ca11d165a80a13d325bee9d669ea2b333d82536'},
+            {'torchtext-0.16.2_download-to-project-root.patch':
+             '9d5599a9983729cf1fc7ab2a2f65d1887f223f528e15662ba1b4a5e359c9686d'},
+        ],
     }),
-    ('pytest-mock', '3.11.1', {  # for torchvision tests
-        'checksums': ['7f6b125602ac6d743e523ae0bfa71e1a697a2f5534064528c6ff84c2f7c2fc7f'],
+    ('pytest-mock', '3.14.0', {  # for torchvision tests
+        'checksums': ['2719255a1efeceadbc056d6bf3df3d1c5015530fb40cf347c0f9afac88410bd0'],
     }),
-    ('torchvision', '0.16.2', {
+    ('torchvision', '0.18.1', {
         'installopts': '-v',
         'patches': [
-            'torchvision-0.16.2_ffmpeg-6.0-fix.patch',
             'torchvision-0.16.2_quantized_tol.patch',
         ],
-        'source_urls': ['https://github.com/pytorch/vision/archive'],
-        'sources': [{'download_filename': 'v%(version)s.tar.gz', 'filename': '%(name)s-%(version)s.tar.gz'}],
-        'checksums': [
-            {'torchvision-0.16.2.tar.gz': '8c1f2951e98d8ada6e5a468f179af4be9f56d2ebc3ab057af873da61669806d7'},
-            {'torchvision-0.16.2_ffmpeg-6.0-fix.patch':
-             'a49336e7bfa1c950e886852bff37a3ea2146ac7bda87241e3ffb31c5cb869cce'},
-            {'torchvision-0.16.2_quantized_tol.patch':
-             '457cdf8ad6653838c552890bce95dbe30b7573b1643334284f5f4a58f74f6e40'},
-        ],
         'runtest': (
             'pytest'
             ' -m "not xfail"'  # don't run tests that are expected that they might fail
             ' -k "not test_frame_reading_mem_vs_file"'  # this one hangs
-            '" and not test_antialias_default_warning"'  # flaky test which is removed in later versions
         ),
+        'source_urls': ['https://github.com/pytorch/vision/archive'],
+        'sources': [{'download_filename': 'v%(version)s.tar.gz', 'filename': '%(name)s-%(version)s.tar.gz'}],
         'testinstall': True,
+        'checksums': [
+            {'torchvision-0.18.1.tar.gz': '347d472a9ceecc44e0bee1eda140d63cfaffc74a54ec07d4b98da7698ce75516'},
+            {'torchvision-0.16.2_quantized_tol.patch':
+             '457cdf8ad6653838c552890bce95dbe30b7573b1643334284f5f4a58f74f6e40'},
+        ],
     }),
     ('torchaudio', version, {
         'installopts': "--no-use-pep517 -v",
         'patches': [
-            'torchaudio-2.1.2_use-external-sox.patch',
+            'torchaudio-2.3.0_use-external-sox.patch',
             'torchaudio-2.1.2_transform_test_tol.patch',
         ],
         'preinstallopts': ('rm -r third_party/{sox,ffmpeg/multi};'  # runs twice when testinstall
-                           ' USE_CUDA=0 USE_OPENMP=1 USE_FFMPEG=1 FFMPEG_ROOT="$EBROOTFFMPEG"'),
-        'source_urls': ['https://github.com/pytorch/audio/archive'],
-        'sources': [{'download_filename': 'v%(version)s.tar.gz', 'filename': '%(name)s-%(version)s.tar.gz'}],
-        'checksums': [
-            {'torchaudio-2.1.2.tar.gz': '82c2745a73172b495327ec36c6970ad5ad9d5d2ac44feeaea2617152f9393bf7'},
-            {'torchaudio-2.1.2_use-external-sox.patch':
-             'a93ebe0b4e7b10b0a264a09d5c49375674e24666258820738ede07e5b457010c'},
-            {'torchaudio-2.1.2_transform_test_tol.patch':
-             '57f315c60db70ed2bd9711bcf6f7c7c24dac8c2f04e00488996eb2dc507bdfd2'},
-        ],
+                           ' USE_CUDA=1 USE_OPENMP=1 USE_FFMPEG=1 FFMPEG_ROOT="$EBROOTFFMPEG"'),
         'runtest': (
-            'pytest test/torchaudio_unittest/'
+            'pytest -vvv test/torchaudio_unittest/'
             ' -k "not TestProcessPoolExecutor"'  # hang maybe related https://github.com/pytorch/audio/issues/1021
             '" and not FilterGraphWithCudaAccel"'  # requires FFmpeg with CUDA support
             '" and not kaldi_io_test"'  # requires kaldi_io
@@ -124,32 +125,36 @@ exts_list = [
             '" and not test_h264_cuvid"'  # requires special render device permissions
             '" and not test_hevc_cuvid"'  # requires special render device permissions
         ),
+        'source_urls': ['https://github.com/pytorch/audio/archive'],
+        'sources': [{'download_filename': 'v%(version)s.tar.gz', 'filename': '%(name)s-%(version)s.tar.gz'}],
         'testinstall': True,
+        'checksums': [
+            {'torchaudio-2.3.0.tar.gz': '83f6351754ed57cb625b1322bab8e12c9140213a9b79626cc5bf7dfd122f869d'},
+            {'torchaudio-2.3.0_use-external-sox.patch':
+             '894884b0b8e4d21130a19bf9eb6da2a95e1b854d02547d075ad1dd8ab97a8956'},
+            {'torchaudio-2.1.2_transform_test_tol.patch':
+             '57f315c60db70ed2bd9711bcf6f7c7c24dac8c2f04e00488996eb2dc507bdfd2'},
+        ],
     }),
-    ('pytorch-ignite', '0.4.13', {
+    ('pytorch-ignite', '0.5.1', {
         'modulename': 'ignite',
-        'source_urls': ['https://github.com/pytorch/ignite/archive'],
-        'sources': [{'download_filename': 'v%(version)s.tar.gz', 'filename': '%(name)s-%(version)s.tar.gz'}],
         'patches': ['torch-ignite-0.4.13_dont_destroy_python_path_in_test_launcher.patch'],
-        'checksums': [
-            {'pytorch-ignite-0.4.13.tar.gz': 'bfe4b6f1cd96e78c021a65a0c51350cdb89d6ef5a8b9609638666ca95bae51d7'},
-            {'torch-ignite-0.4.13_dont_destroy_python_path_in_test_launcher.patch':
-             'fd5dfe99f4c8804d6c57e4d9140d9e556e0724b379f9eaae8aeaf1b7bd058686'},
-        ],
+        'preinstallopts': "sed -i 's/^from visdom/# from visdom/g' tests/ignite/handlers/conftest.py && ",
         'runtest': (
-            'pytest'
+            'pytest -vvv tests/ignite'
             ' -m "not distributed"'
-            ' --ignore=tests/ignite/contrib/handlers/test_clearml_logger.py'  # requires clearml
-            ' --ignore=tests/ignite/contrib/handlers/test_mlflow_logger.py'  # requires mlflow
-            ' --ignore=tests/ignite/contrib/handlers/test_neptune_logger.py'  # requires neptune
-            ' --ignore=tests/ignite/contrib/handlers/test_polyaxon_logger.py'  # requires polyaxon
-            ' --ignore=tests/ignite/contrib/handlers/test_tensorboard_logger.py'  # requires tensorboardX
-            ' --ignore=tests/ignite/contrib/handlers/test_visdom_logger.py'  # requires visdom
-            ' --ignore=tests/ignite/contrib/handlers/test_wandb_logger.py'  # requires wandb
+            ' --ignore=tests/ignite/handlers/test_checkpoint.py'  # fails by comparing tensors on different devices
+            ' --ignore=tests/ignite/handlers/test_clearml_logger.py'  # requires clearml
+            ' --ignore=tests/ignite/handlers/test_mlflow_logger.py'  # requires mlflow
+            ' --ignore=tests/ignite/handlers/test_neptune_logger.py'  # requires neptune
+            ' --ignore=tests/ignite/handlers/test_polyaxon_logger.py'  # requires polyaxon
+            ' --ignore=tests/ignite/handlers/test_tensorboard_logger.py'  # requires tensorboardX
+            ' --ignore=tests/ignite/handlers/test_tqdm_logger.py'  # fragile tests on some platforms
+            ' --ignore=tests/ignite/handlers/test_visdom_logger.py'  # requires visdom
+            ' --ignore=tests/ignite/handlers/test_wandb_logger.py'  # requires wandb
             ' --ignore=tests/ignite/metrics/gan/test_fid.py'  # requires pytorch_fid
             ' --ignore=tests/ignite/metrics/nlp/test_rouge.py'  # requires rouge
-            ' --ignore=tests/ignite/handlers/test_checkpoint.py'  # fails by comparing tensors on different devices
-            ' --ignore=tests/ignite/contrib/handlers/test_tqdm_logger.py'  # fragile tests on some platforms
+            ' --treat-unrun-as-failed'
             ' -k "not test_setup_visdom_logging"'  # requires visdom
             '" and not test_setup_plx_logging"'  # requires polyaxon
             '" and not test_setup_mlflow_logging"'  # requires mlflow
@@ -158,13 +163,19 @@ exts_list = [
             '" and not test__setup_ddp_vars_from_slurm_env_bad_configs"'  # fails sometimes
             '" and not test__native_dist_model_create_from_backend_bad_config"'  # fails sometimes
             '" and not test_inception_score"'  # fails sometimes due to connection problem with download.pytorch.org
+            '" and not test_logger_type_support"'  # fails with FileNotFoundError: [Errno 2] No such file or directory
         ),
+        'source_urls': ['https://github.com/pytorch/ignite/archive'],
+        'sources': [{'download_filename': 'v%(version)s.tar.gz', 'filename': '%(name)s-%(version)s.tar.gz'}],
         'testinstall': True,
+        'checksums': [
+            {'pytorch-ignite-0.5.1.tar.gz': 'b41e7c7bd33530b22fd1787a6d79b89c5efebd13f37c2a53cf3ac3a25d1fbe13'},
+            {'torch-ignite-0.4.13_dont_destroy_python_path_in_test_launcher.patch':
+             'fd5dfe99f4c8804d6c57e4d9140d9e556e0724b379f9eaae8aeaf1b7bd058686'},
+        ],
     }),
     ('torch-tb-profiler', '0.4.3', {
         'modulename': 'torch.profiler',
-        'sources': ['torch_tb_profiler-%(version)s.tar.gz'],
-        'checksums': ['8b8d29b2de960b3c4423087b23cec29beaf9ac3a8c7b046c18fd25b218f726b1'],
         'runtest': (
             'pytest'
             ' --ignore=test/test_tensorboard_end2end.py'  # timeouts
@@ -174,7 +185,9 @@ exts_list = [
             '" and not test_profiler_api_without_step"'  # fails
             '" and not test_autograd_api"'  # fails
         ),
+        'sources': ['torch_tb_profiler-%(version)s.tar.gz'],
         'testinstall': True,
+        'checksums': ['8b8d29b2de960b3c4423087b23cec29beaf9ac3a8c7b046c18fd25b218f726b1'],
     }),
 ]
Diff against PyTorch-bundle-2.1.2-foss-2023a-CUDA-12.1.1.eb

easybuild/easyconfigs/p/PyTorch-bundle/PyTorch-bundle-2.1.2-foss-2023a-CUDA-12.1.1.eb

diff --git a/easybuild/easyconfigs/p/PyTorch-bundle/PyTorch-bundle-2.1.2-foss-2023a-CUDA-12.1.1.eb b/easybuild/easyconfigs/p/PyTorch-bundle/PyTorch-bundle-2.3.0-foss-2023a-CUDA-12.1.1.eb
index d7e1c6cc2e..a744737deb 100644
--- a/easybuild/easyconfigs/p/PyTorch-bundle/PyTorch-bundle-2.1.2-foss-2023a-CUDA-12.1.1.eb
+++ b/easybuild/easyconfigs/p/PyTorch-bundle/PyTorch-bundle-2.3.0-foss-2023a-CUDA-12.1.1.eb
@@ -1,7 +1,7 @@
 easyblock = 'PythonBundle'
 
 name = 'PyTorch-bundle'
-version = '2.1.2'
+version = '2.3.0'
 versionsuffix = '-CUDA-%(cudaver)s'
 
 homepage = 'https://pytorch.org/'
@@ -41,30 +41,31 @@ use_pip = True
 
 # Check with https://pytorch.org/audio/stable/installation.html#compatibility-matrix
 exts_list = [
-    ('portalocker', '2.8.2', {
-        'checksums': ['2b035aa7828e46c58e9b31390ee1f169b98e1066ab10b9a6a861fe7e25ee4f33'],
+    ('tensordict', '0.4.0', {
+        'source_urls': ['https://github.com/pytorch/%(name)s/archive'],
+        'sources': [{'download_filename': 'v%(version)s.tar.gz', 'filename': '%(name)s-%(version)s.tar.gz'}],
+        'checksums': ['c6a565cc88d4f8bc1e1f5e6aba23c2c099f08799730c2716fe6b8706d015b7a5'],
+    }),
+    ('torchrl', '0.4.0', {
+        'source_urls': ['https://github.com/pytorch/rl/archive'],
+        'sources': [{'download_filename': 'v%(version)s.tar.gz', 'filename': '%(name)s-%(version)s.tar.gz'}],
+        'checksums': ['8851a84316f2a1d61d23ec753c90b545bc6479890ec65c5278987ae7c8a2ceec'],
     }),
-    ('torchdata', '0.7.1', {
+    ('portalocker', '3.0.0', {
+        'checksums': ['21f535de2e7a82c94c130c054adb5c7421d480d5619d61073996e2f89bcb879b'],
+    }),
+    ('torchdata', '0.8.0', {
         'preinstallopts': "USE_SYSTEM_LIBS=1 ",
+        'runtest': False,  # circular test requirements
         'source_urls': ['https://github.com/pytorch/data/archive'],
         'sources': [{'download_filename': 'v%(version)s.tar.gz', 'filename': '%(name)s-%(version)s.tar.gz'}],
-        'checksums': ['ef9bbdcee759b53c3c9d99e76eb0a66da33d36bfb7f859a25a9b5e737a51fa23'],
-        'runtest': False,  # circular test requirements
+        'checksums': ['d5d27b264e79d7d00ad4998f14d097b770332d979672dceb6d038caf204f1208'],
     }),
-    ('torchtext', '0.16.2', {
+    ('torchtext', '0.18.0', {
         'patches': [
             'torchtext-0.14.1_use-system-libs.patch',
             'torchtext-0.16.2_download-to-project-root.patch',
         ],
-        'source_urls': ['https://github.com/pytorch/text/archive'],
-        'sources': [{'download_filename': 'v%(version)s.tar.gz', 'filename': '%(name)s-%(version)s.tar.gz'}],
-        'checksums': [
-            {'torchtext-0.16.2.tar.gz': '6574b012804f65220329a2ad34a95c18e4df0d4cff2f862fb7862d57b374b013'},
-            {'torchtext-0.14.1_use-system-libs.patch':
-             '1366d10c4755b6003194f7313ca11d165a80a13d325bee9d669ea2b333d82536'},
-            {'torchtext-0.16.2_download-to-project-root.patch':
-             '9d5599a9983729cf1fc7ab2a2f65d1887f223f528e15662ba1b4a5e359c9686d'},
-        ],
         'runtest': (
             'pytest test/torchtext_unittest'
             ' -k "not test_vocab_from_raw_text_file"'  # segfaults
@@ -74,52 +75,49 @@ exts_list = [
             '" and not test_download_glove_vectors"'  # requires internet access and required host may fail
             '" and not test_vectors_get_vecs"'  # requires internet access and required host may fail
         ),
+        'source_urls': ['https://github.com/pytorch/text/archive'],
+        'sources': [{'download_filename': 'v%(version)s.tar.gz', 'filename': '%(name)s-%(version)s.tar.gz'}],
         'testinstall': True,
+        'checksums': [
+            {'torchtext-0.18.0.tar.gz': 'fe4eb4b361388ef7840dcad117ae95b32252db5520c4eb2b3bead627468fbdf2'},
+            {'torchtext-0.14.1_use-system-libs.patch':
+             '1366d10c4755b6003194f7313ca11d165a80a13d325bee9d669ea2b333d82536'},
+            {'torchtext-0.16.2_download-to-project-root.patch':
+             '9d5599a9983729cf1fc7ab2a2f65d1887f223f528e15662ba1b4a5e359c9686d'},
+        ],
     }),
-    ('pytest-mock', '3.11.1', {  # for torchvision tests
-        'checksums': ['7f6b125602ac6d743e523ae0bfa71e1a697a2f5534064528c6ff84c2f7c2fc7f'],
+    ('pytest-mock', '3.14.0', {  # for torchvision tests
+        'checksums': ['2719255a1efeceadbc056d6bf3df3d1c5015530fb40cf347c0f9afac88410bd0'],
     }),
-    ('torchvision', '0.16.2', {
+    ('torchvision', '0.18.1', {
         'installopts': '-v',
         'patches': [
-            'torchvision-0.16.2_ffmpeg-6.0-fix.patch',
             'torchvision-0.16.2_quantized_tol.patch',
         ],
-        'source_urls': ['https://github.com/pytorch/vision/archive'],
-        'sources': [{'download_filename': 'v%(version)s.tar.gz', 'filename': '%(name)s-%(version)s.tar.gz'}],
-        'checksums': [
-            {'torchvision-0.16.2.tar.gz': '8c1f2951e98d8ada6e5a468f179af4be9f56d2ebc3ab057af873da61669806d7'},
-            {'torchvision-0.16.2_ffmpeg-6.0-fix.patch':
-             'a49336e7bfa1c950e886852bff37a3ea2146ac7bda87241e3ffb31c5cb869cce'},
-            {'torchvision-0.16.2_quantized_tol.patch':
-             '457cdf8ad6653838c552890bce95dbe30b7573b1643334284f5f4a58f74f6e40'},
-        ],
         'runtest': (
             'pytest'
             ' -m "not xfail"'  # don't run tests that are expected that they might fail
             ' -k "not test_frame_reading_mem_vs_file"'  # this one hangs
         ),
+        'source_urls': ['https://github.com/pytorch/vision/archive'],
+        'sources': [{'download_filename': 'v%(version)s.tar.gz', 'filename': '%(name)s-%(version)s.tar.gz'}],
         'testinstall': True,
+        'checksums': [
+            {'torchvision-0.18.1.tar.gz': '347d472a9ceecc44e0bee1eda140d63cfaffc74a54ec07d4b98da7698ce75516'},
+            {'torchvision-0.16.2_quantized_tol.patch':
+             '457cdf8ad6653838c552890bce95dbe30b7573b1643334284f5f4a58f74f6e40'},
+        ],
     }),
     ('torchaudio', version, {
         'installopts': "--no-use-pep517 -v",
         'patches': [
-            'torchaudio-2.1.2_use-external-sox.patch',
+            'torchaudio-2.3.0_use-external-sox.patch',
             'torchaudio-2.1.2_transform_test_tol.patch',
         ],
         'preinstallopts': ('rm -r third_party/{sox,ffmpeg/multi};'  # runs twice when testinstall
                            ' USE_CUDA=1 USE_OPENMP=1 USE_FFMPEG=1 FFMPEG_ROOT="$EBROOTFFMPEG"'),
-        'source_urls': ['https://github.com/pytorch/audio/archive'],
-        'sources': [{'download_filename': 'v%(version)s.tar.gz', 'filename': '%(name)s-%(version)s.tar.gz'}],
-        'checksums': [
-            {'torchaudio-2.1.2.tar.gz': '82c2745a73172b495327ec36c6970ad5ad9d5d2ac44feeaea2617152f9393bf7'},
-            {'torchaudio-2.1.2_use-external-sox.patch':
-             'a93ebe0b4e7b10b0a264a09d5c49375674e24666258820738ede07e5b457010c'},
-            {'torchaudio-2.1.2_transform_test_tol.patch':
-             '57f315c60db70ed2bd9711bcf6f7c7c24dac8c2f04e00488996eb2dc507bdfd2'},
-        ],
         'runtest': (
-            'pytest test/torchaudio_unittest/'
+            'pytest -vvv test/torchaudio_unittest/'
             ' -k "not TestProcessPoolExecutor"'  # hang maybe related https://github.com/pytorch/audio/issues/1021
             '" and not FilterGraphWithCudaAccel"'  # requires FFmpeg with CUDA support
             '" and not kaldi_io_test"'  # requires kaldi_io
@@ -127,32 +125,36 @@ exts_list = [
             '" and not test_h264_cuvid"'  # requires special render device permissions
             '" and not test_hevc_cuvid"'  # requires special render device permissions
         ),
+        'source_urls': ['https://github.com/pytorch/audio/archive'],
+        'sources': [{'download_filename': 'v%(version)s.tar.gz', 'filename': '%(name)s-%(version)s.tar.gz'}],
         'testinstall': True,
+        'checksums': [
+            {'torchaudio-2.3.0.tar.gz': '83f6351754ed57cb625b1322bab8e12c9140213a9b79626cc5bf7dfd122f869d'},
+            {'torchaudio-2.3.0_use-external-sox.patch':
+             '894884b0b8e4d21130a19bf9eb6da2a95e1b854d02547d075ad1dd8ab97a8956'},
+            {'torchaudio-2.1.2_transform_test_tol.patch':
+             '57f315c60db70ed2bd9711bcf6f7c7c24dac8c2f04e00488996eb2dc507bdfd2'},
+        ],
     }),
-    ('pytorch-ignite', '0.4.13', {
+    ('pytorch-ignite', '0.5.1', {
         'modulename': 'ignite',
-        'source_urls': ['https://github.com/pytorch/ignite/archive'],
-        'sources': [{'download_filename': 'v%(version)s.tar.gz', 'filename': '%(name)s-%(version)s.tar.gz'}],
         'patches': ['torch-ignite-0.4.13_dont_destroy_python_path_in_test_launcher.patch'],
-        'checksums': [
-            {'pytorch-ignite-0.4.13.tar.gz': 'bfe4b6f1cd96e78c021a65a0c51350cdb89d6ef5a8b9609638666ca95bae51d7'},
-            {'torch-ignite-0.4.13_dont_destroy_python_path_in_test_launcher.patch':
-             'fd5dfe99f4c8804d6c57e4d9140d9e556e0724b379f9eaae8aeaf1b7bd058686'},
-        ],
+        'preinstallopts': "sed -i 's/^from visdom/# from visdom/g' tests/ignite/handlers/conftest.py && ",
         'runtest': (
-            'pytest'
+            'pytest -vvv tests/ignite'
             ' -m "not distributed"'
-            ' --ignore=tests/ignite/contrib/handlers/test_clearml_logger.py'  # requires clearml
-            ' --ignore=tests/ignite/contrib/handlers/test_mlflow_logger.py'  # requires mlflow
-            ' --ignore=tests/ignite/contrib/handlers/test_neptune_logger.py'  # requires neptune
-            ' --ignore=tests/ignite/contrib/handlers/test_polyaxon_logger.py'  # requires polyaxon
-            ' --ignore=tests/ignite/contrib/handlers/test_tensorboard_logger.py'  # requires tensorboardX
-            ' --ignore=tests/ignite/contrib/handlers/test_visdom_logger.py'  # requires visdom
-            ' --ignore=tests/ignite/contrib/handlers/test_wandb_logger.py'  # requires wandb
+            ' --ignore=tests/ignite/handlers/test_checkpoint.py'  # fails by comparing tensors on different devices
+            ' --ignore=tests/ignite/handlers/test_clearml_logger.py'  # requires clearml
+            ' --ignore=tests/ignite/handlers/test_mlflow_logger.py'  # requires mlflow
+            ' --ignore=tests/ignite/handlers/test_neptune_logger.py'  # requires neptune
+            ' --ignore=tests/ignite/handlers/test_polyaxon_logger.py'  # requires polyaxon
+            ' --ignore=tests/ignite/handlers/test_tensorboard_logger.py'  # requires tensorboardX
+            ' --ignore=tests/ignite/handlers/test_tqdm_logger.py'  # fragile tests on some platforms
+            ' --ignore=tests/ignite/handlers/test_visdom_logger.py'  # requires visdom
+            ' --ignore=tests/ignite/handlers/test_wandb_logger.py'  # requires wandb
             ' --ignore=tests/ignite/metrics/gan/test_fid.py'  # requires pytorch_fid
             ' --ignore=tests/ignite/metrics/nlp/test_rouge.py'  # requires rouge
-            ' --ignore=tests/ignite/handlers/test_checkpoint.py'  # fails by comparing tensors on different devices
-            ' --ignore=tests/ignite/contrib/handlers/test_tqdm_logger.py'  # fragile tests on some platforms
+            ' --treat-unrun-as-failed'
             ' -k "not test_setup_visdom_logging"'  # requires visdom
             '" and not test_setup_plx_logging"'  # requires polyaxon
             '" and not test_setup_mlflow_logging"'  # requires mlflow
@@ -161,13 +163,19 @@ exts_list = [
             '" and not test__setup_ddp_vars_from_slurm_env_bad_configs"'  # fails sometimes
             '" and not test__native_dist_model_create_from_backend_bad_config"'  # fails sometimes
             '" and not test_inception_score"'  # fails sometimes due to connection problem with download.pytorch.org
+            '" and not test_logger_type_support"'  # fails with FileNotFoundError: [Errno 2] No such file or directory
         ),
+        'source_urls': ['https://github.com/pytorch/ignite/archive'],
+        'sources': [{'download_filename': 'v%(version)s.tar.gz', 'filename': '%(name)s-%(version)s.tar.gz'}],
         'testinstall': True,
+        'checksums': [
+            {'pytorch-ignite-0.5.1.tar.gz': 'b41e7c7bd33530b22fd1787a6d79b89c5efebd13f37c2a53cf3ac3a25d1fbe13'},
+            {'torch-ignite-0.4.13_dont_destroy_python_path_in_test_launcher.patch':
+             'fd5dfe99f4c8804d6c57e4d9140d9e556e0724b379f9eaae8aeaf1b7bd058686'},
+        ],
     }),
     ('torch-tb-profiler', '0.4.3', {
         'modulename': 'torch.profiler',
-        'sources': ['torch_tb_profiler-%(version)s.tar.gz'],
-        'checksums': ['8b8d29b2de960b3c4423087b23cec29beaf9ac3a8c7b046c18fd25b218f726b1'],
         'runtest': (
             'pytest'
             ' --ignore=test/test_tensorboard_end2end.py'  # timeouts
@@ -177,7 +185,9 @@ exts_list = [
             '" and not test_profiler_api_without_step"'  # fails
             '" and not test_autograd_api"'  # fails
         ),
+        'sources': ['torch_tb_profiler-%(version)s.tar.gz'],
         'testinstall': True,
+        'checksums': ['8b8d29b2de960b3c4423087b23cec29beaf9ac3a8c7b046c18fd25b218f726b1'],
     }),
 ]
Diff against PyTorch-bundle-1.13.1-foss-2022a-CUDA-11.7.0.eb

easybuild/easyconfigs/p/PyTorch-bundle/PyTorch-bundle-1.13.1-foss-2022a-CUDA-11.7.0.eb

diff --git a/easybuild/easyconfigs/p/PyTorch-bundle/PyTorch-bundle-1.13.1-foss-2022a-CUDA-11.7.0.eb b/easybuild/easyconfigs/p/PyTorch-bundle/PyTorch-bundle-2.3.0-foss-2023a-CUDA-12.1.1.eb
index 9daa4dfb67..a744737deb 100644
--- a/easybuild/easyconfigs/p/PyTorch-bundle/PyTorch-bundle-1.13.1-foss-2022a-CUDA-11.7.0.eb
+++ b/easybuild/easyconfigs/p/PyTorch-bundle/PyTorch-bundle-2.3.0-foss-2023a-CUDA-12.1.1.eb
@@ -1,71 +1,192 @@
 easyblock = 'PythonBundle'
 
 name = 'PyTorch-bundle'
-version = '1.13.1'
+version = '2.3.0'
 versionsuffix = '-CUDA-%(cudaver)s'
 
 homepage = 'https://pytorch.org/'
 description = """PyTorch with compatible versions of official Torch extensions."""
 
-toolchain = {'name': 'foss', 'version': '2022a'}
+toolchain = {'name': 'foss', 'version': '2023a'}
 
 builddependencies = [
-    ('CMake', '3.23.1'),
-    ('RE2', '2022-06-01'),  # for torchtext
+    ('CMake', '3.26.3'),
+    ('RE2', '2023-08-01'),  # for torchtext
+    ('parameterized', '0.9.0'),  # for torchtext and torchaudio tests
+    ('scikit-learn', '1.3.1'),  # for torchaudio and pytorch-ignite tests
+    ('scikit-image', '0.22.0'),  # for pytorch-ignite tests
+    ('dill', '0.3.7'),  # for pytorch-ignite tests
+    ('matplotlib', '3.7.2'),  # for pytorch-ignite tests
+    ('librosa', '0.10.1'),  # for torchaudio tests
+    ('NLTK', '3.8.1'),  # for torchtext tests
+    ('Scalene', '1.5.26'),  # for pynvml in ignite tests
 ]
 
 dependencies = [
-    ('CUDA', '11.7.0', '', SYSTEM),
-    ('Python', '3.10.4'),
+    ('CUDA', '12.1.1', '', SYSTEM),
+    ('Python', '3.11.3'),
     ('PyTorch', version, versionsuffix),
-    ('Pillow-SIMD', '9.2.0'),  # for torchvision
-    ('SentencePiece', '0.1.97'),  # for torchtext
-    ('tqdm', '4.64.0'),  # for torchtext
-    ('double-conversion', '3.2.0'),  # for torchtext
-    ('utf8proc', '2.7.0'),  # for torchtext
-    ('tensorboard', '2.10.0'),  # for torch-tb-profiler
+    ('Pillow-SIMD', '9.5.0'),  # for torchvision
+    ('libjpeg-turbo', '2.1.5.1'),  # for torchvision
+    ('SentencePiece', '0.2.0'),  # for torchtext
+    ('tqdm', '4.66.1'),  # for torchtext
+    ('double-conversion', '3.3.0'),  # for torchtext
+    ('utf8proc', '2.8.0'),  # for torchtext
+    ('tensorboard', '2.15.1'),  # for torch-tb-profiler
+    ('FFmpeg', '6.0'),  # for torchvision and torchaudio
+    ('SoX', '14.4.2'),  # for torchaudio
 ]
 
 use_pip = True
 
+# Check with https://pytorch.org/audio/stable/installation.html#compatibility-matrix
 exts_list = [
-    ('portalocker', '2.7.0', {
-        'checksums': ['032e81d534a88ec1736d03f780ba073f047a06c478b06e2937486f334e955c51'],
+    ('tensordict', '0.4.0', {
+        'source_urls': ['https://github.com/pytorch/%(name)s/archive'],
+        'sources': [{'download_filename': 'v%(version)s.tar.gz', 'filename': '%(name)s-%(version)s.tar.gz'}],
+        'checksums': ['c6a565cc88d4f8bc1e1f5e6aba23c2c099f08799730c2716fe6b8706d015b7a5'],
+    }),
+    ('torchrl', '0.4.0', {
+        'source_urls': ['https://github.com/pytorch/rl/archive'],
+        'sources': [{'download_filename': 'v%(version)s.tar.gz', 'filename': '%(name)s-%(version)s.tar.gz'}],
+        'checksums': ['8851a84316f2a1d61d23ec753c90b545bc6479890ec65c5278987ae7c8a2ceec'],
     }),
-    ('torchdata', '0.5.1', {
+    ('portalocker', '3.0.0', {
+        'checksums': ['21f535de2e7a82c94c130c054adb5c7421d480d5619d61073996e2f89bcb879b'],
+    }),
+    ('torchdata', '0.8.0', {
         'preinstallopts': "USE_SYSTEM_LIBS=1 ",
+        'runtest': False,  # circular test requirements
         'source_urls': ['https://github.com/pytorch/data/archive'],
         'sources': [{'download_filename': 'v%(version)s.tar.gz', 'filename': '%(name)s-%(version)s.tar.gz'}],
-        'checksums': ['69d80bd33ce8f08e7cfeeb71cefddfc29cede25a85881e33dbae47576b96ed29'],
+        'checksums': ['d5d27b264e79d7d00ad4998f14d097b770332d979672dceb6d038caf204f1208'],
     }),
-    ('torchtext', '0.14.1', {
+    ('torchtext', '0.18.0', {
         'patches': [
             'torchtext-0.14.1_use-system-libs.patch',
-            'torchtext-0.13.1_cxx_17.patch',
+            'torchtext-0.16.2_download-to-project-root.patch',
         ],
+        'runtest': (
+            'pytest test/torchtext_unittest'
+            ' -k "not test_vocab_from_raw_text_file"'  # segfaults
+            '" and not test_get_tokenizer_moses"'  # requires sacremoses
+            '" and not test_get_tokenizer_spacy"'  # requires spaCy
+            '" and not test_download_charngram_vectors"'  # requires internet access and required host may fail
+            '" and not test_download_glove_vectors"'  # requires internet access and required host may fail
+            '" and not test_vectors_get_vecs"'  # requires internet access and required host may fail
+        ),
         'source_urls': ['https://github.com/pytorch/text/archive'],
         'sources': [{'download_filename': 'v%(version)s.tar.gz', 'filename': '%(name)s-%(version)s.tar.gz'}],
+        'testinstall': True,
         'checksums': [
-            {'torchtext-0.14.1.tar.gz': 'fd1ef3da7d9c20408c740f7dc7d02ad52a6048b46368355a1a7326d3bc4f2e63'},
+            {'torchtext-0.18.0.tar.gz': 'fe4eb4b361388ef7840dcad117ae95b32252db5520c4eb2b3bead627468fbdf2'},
             {'torchtext-0.14.1_use-system-libs.patch':
              '1366d10c4755b6003194f7313ca11d165a80a13d325bee9d669ea2b333d82536'},
-            {'torchtext-0.13.1_cxx_17.patch': 'fd242c139baa27352d1065cece4658a3ede76f46ffec08ac04a554301e547f22'},
+            {'torchtext-0.16.2_download-to-project-root.patch':
+             '9d5599a9983729cf1fc7ab2a2f65d1887f223f528e15662ba1b4a5e359c9686d'},
         ],
     }),
-    ('torchvision', '0.14.1', {
+    ('pytest-mock', '3.14.0', {  # for torchvision tests
+        'checksums': ['2719255a1efeceadbc056d6bf3df3d1c5015530fb40cf347c0f9afac88410bd0'],
+    }),
+    ('torchvision', '0.18.1', {
+        'installopts': '-v',
+        'patches': [
+            'torchvision-0.16.2_quantized_tol.patch',
+        ],
+        'runtest': (
+            'pytest'
+            ' -m "not xfail"'  # don't run tests that are expected that they might fail
+            ' -k "not test_frame_reading_mem_vs_file"'  # this one hangs
+        ),
         'source_urls': ['https://github.com/pytorch/vision/archive'],
         'sources': [{'download_filename': 'v%(version)s.tar.gz', 'filename': '%(name)s-%(version)s.tar.gz'}],
-        'checksums': ['ced67e1cf1f97e168cdf271851a4d0b6d382ab7936e7bcbb39aaa87239c324b6'],
+        'testinstall': True,
+        'checksums': [
+            {'torchvision-0.18.1.tar.gz': '347d472a9ceecc44e0bee1eda140d63cfaffc74a54ec07d4b98da7698ce75516'},
+            {'torchvision-0.16.2_quantized_tol.patch':
+             '457cdf8ad6653838c552890bce95dbe30b7573b1643334284f5f4a58f74f6e40'},
+        ],
     }),
-    ('pytorch-ignite', '0.4.12', {
+    ('torchaudio', version, {
+        'installopts': "--no-use-pep517 -v",
+        'patches': [
+            'torchaudio-2.3.0_use-external-sox.patch',
+            'torchaudio-2.1.2_transform_test_tol.patch',
+        ],
+        'preinstallopts': ('rm -r third_party/{sox,ffmpeg/multi};'  # runs twice when testinstall
+                           ' USE_CUDA=1 USE_OPENMP=1 USE_FFMPEG=1 FFMPEG_ROOT="$EBROOTFFMPEG"'),
+        'runtest': (
+            'pytest -vvv test/torchaudio_unittest/'
+            ' -k "not TestProcessPoolExecutor"'  # hang maybe related https://github.com/pytorch/audio/issues/1021
+            '" and not FilterGraphWithCudaAccel"'  # requires FFmpeg with CUDA support
+            '" and not kaldi_io_test"'  # requires kaldi_io
+            '" and not test_dup_hw_acel"'  # requires special render device permissions
+            '" and not test_h264_cuvid"'  # requires special render device permissions
+            '" and not test_hevc_cuvid"'  # requires special render device permissions
+        ),
+        'source_urls': ['https://github.com/pytorch/audio/archive'],
+        'sources': [{'download_filename': 'v%(version)s.tar.gz', 'filename': '%(name)s-%(version)s.tar.gz'}],
+        'testinstall': True,
+        'checksums': [
+            {'torchaudio-2.3.0.tar.gz': '83f6351754ed57cb625b1322bab8e12c9140213a9b79626cc5bf7dfd122f869d'},
+            {'torchaudio-2.3.0_use-external-sox.patch':
+             '894884b0b8e4d21130a19bf9eb6da2a95e1b854d02547d075ad1dd8ab97a8956'},
+            {'torchaudio-2.1.2_transform_test_tol.patch':
+             '57f315c60db70ed2bd9711bcf6f7c7c24dac8c2f04e00488996eb2dc507bdfd2'},
+        ],
+    }),
+    ('pytorch-ignite', '0.5.1', {
         'modulename': 'ignite',
+        'patches': ['torch-ignite-0.4.13_dont_destroy_python_path_in_test_launcher.patch'],
+        'preinstallopts': "sed -i 's/^from visdom/# from visdom/g' tests/ignite/handlers/conftest.py && ",
+        'runtest': (
+            'pytest -vvv tests/ignite'
+            ' -m "not distributed"'
+            ' --ignore=tests/ignite/handlers/test_checkpoint.py'  # fails by comparing tensors on different devices
+            ' --ignore=tests/ignite/handlers/test_clearml_logger.py'  # requires clearml
+            ' --ignore=tests/ignite/handlers/test_mlflow_logger.py'  # requires mlflow
+            ' --ignore=tests/ignite/handlers/test_neptune_logger.py'  # requires neptune
+            ' --ignore=tests/ignite/handlers/test_polyaxon_logger.py'  # requires polyaxon
+            ' --ignore=tests/ignite/handlers/test_tensorboard_logger.py'  # requires tensorboardX
+            ' --ignore=tests/ignite/handlers/test_tqdm_logger.py'  # fragile tests on some platforms
+            ' --ignore=tests/ignite/handlers/test_visdom_logger.py'  # requires visdom
+            ' --ignore=tests/ignite/handlers/test_wandb_logger.py'  # requires wandb
+            ' --ignore=tests/ignite/metrics/gan/test_fid.py'  # requires pytorch_fid
+            ' --ignore=tests/ignite/metrics/nlp/test_rouge.py'  # requires rouge
+            ' --treat-unrun-as-failed'
+            ' -k "not test_setup_visdom_logging"'  # requires visdom
+            '" and not test_setup_plx_logging"'  # requires polyaxon
+            '" and not test_setup_mlflow_logging"'  # requires mlflow
+            '" and not test_setup_clearml_logging"'  # requires clearml
+            '" and not test_setup_neptune_logging"'  # requires neptune
+            '" and not test__setup_ddp_vars_from_slurm_env_bad_configs"'  # fails sometimes
+            '" and not test__native_dist_model_create_from_backend_bad_config"'  # fails sometimes
+            '" and not test_inception_score"'  # fails sometimes due to connection problem with download.pytorch.org
+            '" and not test_logger_type_support"'  # fails with FileNotFoundError: [Errno 2] No such file or directory
+        ),
         'source_urls': ['https://github.com/pytorch/ignite/archive'],
         'sources': [{'download_filename': 'v%(version)s.tar.gz', 'filename': '%(name)s-%(version)s.tar.gz'}],
-        'checksums': ['7d10fd40edc568bbda687151bb5b53b0d59a980cd6c25ec2b061e7f234aeab76'],
+        'testinstall': True,
+        'checksums': [
+            {'pytorch-ignite-0.5.1.tar.gz': 'b41e7c7bd33530b22fd1787a6d79b89c5efebd13f37c2a53cf3ac3a25d1fbe13'},
+            {'torch-ignite-0.4.13_dont_destroy_python_path_in_test_launcher.patch':
+             'fd5dfe99f4c8804d6c57e4d9140d9e556e0724b379f9eaae8aeaf1b7bd058686'},
+        ],
     }),
     ('torch-tb-profiler', '0.4.3', {
         'modulename': 'torch.profiler',
+        'runtest': (
+            'pytest'
+            ' --ignore=test/test_tensorboard_end2end.py'  # timeouts
+            ' -k "not test_dump_gpu_metrics"'  # missing file
+            '" and not test_profiler_api_with_record_shapes_memory_stack"'  # fails
+            '" and not test_profiler_api_without_record_shapes_memory_stack"'  # fails
+            '" and not test_profiler_api_without_step"'  # fails
+            '" and not test_autograd_api"'  # fails
+        ),
         'sources': ['torch_tb_profiler-%(version)s.tar.gz'],
+        'testinstall': True,
         'checksums': ['8b8d29b2de960b3c4423087b23cec29beaf9ac3a8c7b046c18fd25b218f726b1'],
     }),
 ]

VRehnberg
VRehnberg reviewed Dec 19, 2024
View reviewed changes
Copy link
Contributor

@VRehnberg VRehnberg left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

  • torch-tb-profiler and dependencies can be removed.
  • We've stopped recommending torchdata to our users, but I suspect that it's still a build dependency for some of the other packages.

easybuild/easyconfigs/p/PyTorch-bundle/PyTorch-bundle-2.3.0-foss-2023a-CUDA-12.1.1.eb
('tqdm', '4.66.1'), # for torchtext
('double-conversion', '3.3.0'), # for torchtext
('utf8proc', '2.8.0'), # for torchtext
('tensorboard', '2.15.1'), # for torch-tb-profiler
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
('tensorboard', '2.15.1'), # for torch-tb-profiler

torch-tb-profiler has been deprecated https://github.com/pytorch/kineto?tab=readme-ov-file#pytorch-tensorboard-profiler-deprecated

easybuild/easyconfigs/p/PyTorch-bundle/PyTorch-bundle-2.3.0-foss-2023a-CUDA-12.1.1.eb
Comment on lines +177 to +191
('torch-tb-profiler', '0.4.3', {
'modulename': 'torch.profiler',
'runtest': (
'pytest'
' --ignore=test/test_tensorboard_end2end.py' # timeouts
' -k "not test_dump_gpu_metrics"' # missing file
'" and not test_profiler_api_with_record_shapes_memory_stack"' # fails
'" and not test_profiler_api_without_record_shapes_memory_stack"' # fails
'" and not test_profiler_api_without_step"' # fails
'" and not test_autograd_api"' # fails
),
'sources': ['torch_tb_profiler-%(version)s.tar.gz'],
'testinstall': True,
'checksums': ['8b8d29b2de960b3c4423087b23cec29beaf9ac3a8c7b046c18fd25b218f726b1'],
}),
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
('torch-tb-profiler', '0.4.3', {
'modulename': 'torch.profiler',
'runtest': (
'pytest'
' --ignore=test/test_tensorboard_end2end.py' # timeouts
' -k "not test_dump_gpu_metrics"' # missing file
'" and not test_profiler_api_with_record_shapes_memory_stack"' # fails
'" and not test_profiler_api_without_record_shapes_memory_stack"' # fails
'" and not test_profiler_api_without_step"' # fails
'" and not test_autograd_api"' # fails
),
'sources': ['torch_tb_profiler-%(version)s.tar.gz'],
'testinstall': True,
'checksums': ['8b8d29b2de960b3c4423087b23cec29beaf9ac3a8c7b046c18fd25b218f726b1'],
}),

torch-tb-profiler has been deprecated https://github.com/pytorch/kineto?tab=readme-ov-file#pytorch-tensorboard-profiler-deprecated

@smoors smoors mentioned this pull request Dec 20, 2024
Open
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@VRehnberg VRehnberg VRehnberg left review comments

At least 1 approving review is required to merge this pull request.

Assignees
No one assigned
Labels
update
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@smoors @VRehnberg