Code

Release 2.0.0rc1#9786

Code

Closed

ko3n1g wants to merge 173 commits intor2.0.0rc1NVIDIA/NeMo:r2.0.0rc1from mainNVIDIA/NeMo:mainCopy head branch name to clipboard

+41,697-5,201

Commits

Commits on Jul 8, 2024

• Nemotron export - fixing megatron_export.py (#9625)

  Show description for 9b91df5
  

  borisfom

  and

  ericharper

  authored
  9b91df5

• support lora when kv_channel != hidden_size / num_heads (#9636)

  suiyoubi

  authored
  62459cc

Commits on Jul 9, 2024

• [Nemo CICD] Docker temp files auto-cleanup (#9642)

  Show description for 55ee9f4
  pablo-garay

  authored
  55ee9f4

• Update Dockerfile.ci (#9651)

  Show description for b97da9c
  huvunvidia

  authored
  b97da9c

• SDXL improvements (and support for Draft+) [DRAFT PR] (#9543)

  Show description for 1c73e1b
  

  3 peopleauthored
  1c73e1b

• Triton deployment improvements for in-framework models (#9600)

  Show description for 8898b76
  

  jukim-nv

  and

  oyilmaz-nvidia

  authored
  8898b76

• Use FP8 in GPT TP2 test (#9451)

  Show description for 2ee8646
  

  jbaczek

  and

  pablo-garay

  authored
  2ee8646

Commits on Jul 10, 2024

• enables default data step in megatron parallel to operate on a wider variety of tensors (#9641)

  Show description for f5d5221
  

  jomitchellnv

  and

  marcromeyn

  authored
  f5d5221

• Revert "enables default data step in megatron parallel to operate on a wider …" (#9666)

  marcromeyn

  authored
  355d3c5

• Contrastive Reranker/Reward model (#9171)

  Show description for 74e32c8
  arendu

  authored
  74e32c8

• unpin transformers version (#9606)

  Show description for b4821e1
  

  3 peopleauthored
  b4821e1

• Added CPU offloading docs (#9479)

  Show description for 14d42dc
  

  3 peopleauthored
  14d42dc

• Update llama-3 PEFT notebook to download model from NGC (#9667)

  Show description for 3ab0a2a
  shashank3959

  authored
  3ab0a2a

• fix pipeline parallel dtype bug (#9637) (#9661)

  Show description for 4e5174b
  

  3 peopleauthored
  4e5174b

Commits on Jul 11, 2024

• LITA integration (#9578)

  Show description for 900ca0b
  

  3 peopleauthored
  900ca0b

• Parametrize FPS group (#9648) (#9669)

  Show description for 08cc515
  

  3 peopleauthored
  08cc515

• Huvu/mcore t5 (#9677)

  Show description for d4f1d3c
  

  huvunvidia

  and

  Huy Vu2

  authored
  d4f1d3c

• chore: Version bump NeMo (#9631)

  Show description for 3cf5a1d
  ko3n1g

  authored
  3cf5a1d

• add a bit more for timeout (#9702)

  Show description for 693c55f
  pablo-garay

  authored
  693c55f

• Alit/mamba (#9696)

  Show description for 3482dc1
  

  3 peopleauthored
  3482dc1

• NeMo performance feature documentation (#9482)

  erhoo82

  authored
  6f91dcc

• [TTS] Add fullband mel codec checkpoints (#9704)

  Show description for 472ff9f
  rlangman

  authored
  472ff9f

Commits on Jul 12, 2024

• Adding support for mcore T5 Eval - SFT - PEFT (#9679)

  Show description for 3e2bb21
  

  huvunvidia

  and

  Huy Vu2

  authored
  3e2bb21

• Allows non-strict load with distributed checkpoints (#9613) (#9715)

  Show description for 081a163
  

  github-actions[bot]

  and

  mikolajblaz

  authored
  081a163

• refactor: Uniform BRANCH for notebooks (#9710)

  Show description for 599b60f
  ko3n1g

  authored
  599b60f

Commits on Jul 15, 2024

• fix legacy ds padding bug (#9716)

  Show description for 56f024d
  dimapihtar

  authored
  56f024d

• enables default data step in megatron parallel to operate on a wider variety of tensors - second try (#9671)

  Show description for f477ed1
  

  jomitchellnv

  and

  jstjohn

  authored
  f477ed1

• [NeMo-UX] Fix when optimizers are setup for PEFT (#9619) (#9647)

  Show description for 8e9ef94
  

  4 peopleauthored
  8e9ef94

• refactor: README (#9712)

  Show description for 02ff85b
  ko3n1g

  authored
  02ff85b

• Remove mask if use fusion mask (#9723)

  Show description for 27b5c47
  hsiehjackson

  authored
  27b5c47

• [NeMo-UX] Fix imports so local configuration of runs works again (#9690) (#9694)

  Show description for b166a8f
  

  github-actions[bot]

  and

  marcromeyn

  authored
  b166a8f

• add contianer (#9731)

  Show description for a9dbe37
  

  JRD971000

  and

  Ali Taghibakhshi

  authored
  a9dbe37

• update pretrained model text (#9724) (#9745)

  Show description for c21e011
  

  github-actions[bot]

  and

  erastorgueva-nv

  authored
  c21e011

• [Nemo-UX] Including all trainable-params in a PEFT-checkpoint (#9650) (#9691)

  Show description for 8128122
  

  6 peopleauthored
  8128122

• [NeMo-UX] Make TE and Apex dependencies optional (#9732)

  Show description for f2e3232
  

  3 peopleauthored
  f2e3232

Commits on Jul 16, 2024

• [NeMo-UX] Minor bug fix when TE/Apex not installed (#9749)

  Show description for 34bfe1b
  ashors1

  authored
  34bfe1b

• make 'load_directly_on_device' configurable (#9657) (#9674)

  Show description for 2d87359
  

  3 peopleauthored
  2d87359

• TorchAudio installation workaround for incorrect PYTORCH_VERSION env variable (#9736) (#9750)

  Show description for b39a487
  

  github-actions[bot]

  and

  artbataev

  authored
  b39a487

• Create __init__.py (#9755)

  Show description for c279c13
  stevehuang52

  authored
  c279c13

• Canary Adapters tutorial (#9670)

  Show description for ca94e03
  titu1994

  authored
  ca94e03

Commits on Jul 17, 2024

• match nemo 1's default behavior for drop_last and pad_samples_to_global_batch_size (#9707) (#9753)

  Show description for 4696e64
  

  3 peopleauthored
  4696e64

• ci: Bump MCore tag (#9744)

  Show description for af4f0ed
  ko3n1g

  authored
  af4f0ed

• Fix the serialization of partial functions in nemo 2.0 (#9668)

  Show description for f65fea2
  sararb

  authored
  f65fea2

• ci: Add PAT to create-pullrequest action (#9769)

  Show description for ae62a4d
  ko3n1g

  authored
  ae62a4d

• Speeds up copying of necessary artifact files with SaveRestoreConnector (#9682)

  Show description for 649ad1f
  

  terrykong

  and

  ericharper

  authored
  649ad1f

• ci: Remove ko3n1g from reviewers (#9773)

  Show description for 8c04749
  ko3n1g

  authored
  8c04749

• bump mcore commit in Dockerfile (#9766)

  Show description for f4fa399
  ashors1

  authored
  f4fa399

• Yuya/add checkpoints section (#9329)

  Show description for 9c138a4
  

  4 peopleauthored
  9c138a4

Commits on Jul 18, 2024

• Release automation (#9687)

  Show description for f01cbe2
  ko3n1g

  authored
  f01cbe2

• Rename speech dockerfile appropriately (#9778)

  Show description for 8949dc8
  pablo-garay

  authored
  8949dc8

• Add option to convert PyTriton response to OpenAI format (#9726)

  Show description for 234ac8b
  athitten

  authored
  234ac8b

• ci: Fix changelog-config (#9788)

  Show description for 8035dd0
  ko3n1g

  authored
  8035dd0

Commits on Jul 19, 2024

• Support configurable extra fields for LazyNeMoTarredIterator (#9548)

  Show description for e244cfd
  pzelasko

  authored
  e244cfd

• upper bound huggingface-hub version to 0.24.0 (exc.) (#9799)

  Show description for 5546190
  akoumpa

  authored
  5546190

• Add Lita, Vila and Vita TRTLLM export (#9734)

  Show description for ab8988e
  

  xuanzic

  and

  Vivian Chen

  authored
  ab8988e

• Fix null/None truncation field with extra generating tokens (#9379)

  Show description for 2f9bcae
  hsiehjackson

  authored
  2f9bcae

• vLLM 0.5.1 update (#9779) (#9798)

  Show description for d6e0c15
  

  3 peopleauthored
  d6e0c15

• minor fix tutorial (#9813)

  Show description for 6f9f731
  

  JRD971000

  and

  Ali Taghibakhshi

  authored
  6f9f731

Commits on Jul 22, 2024

• Adds Tiktoken tokenizer for Nemotron-Mistral 12B (#9797)

  Show description for 425d5dd
  

  61 peopleauthored
  425d5dd

Commits on Jul 23, 2024

• typos and branch name update to r2.0.0rc1 (#9847)

  Show description for 903e2aa
  

  github-actions[bot]

  and

  nithinraok

  authored
  903e2aa

• [Audio] Remove torchaudio from spectrogram transforms (#9802)

  Show description for 7e16edb
  

  anteju

  and

  racoiaws

  authored
  7e16edb

• Add "offline" data cache generation support (#9576)

  Show description for 00fe96f
  dimapihtar

  authored
  00fe96f

• Fix few issues and docs for neva and clip in r2.0.0rc1 (#9681) (#9808)

  Show description for f83f974
  

  github-actions[bot]

  and

  yaoyu-33

  authored
  f83f974

• fix lita bugs (#9810) (#9828)

  Show description for d28c1b2
  

  3 peopleauthored
  d28c1b2

• Add SpeechLLM docs (#9780)

  Show description for 9c06389
  

  stevehuang52

  and

  zhehuaichen

  authored
  9c06389

• Add Llama 3.1 LoRA PEFT and NIM Deployment tutorial (#9844)

  Show description for b7ca4a3
  shashank3959

  authored
  b7ca4a3

• [Audio] Metric with Squim objective and MOS (#9751)

  Show description for 1711334
  anteju

  authored
  1711334

Commits on Jul 24, 2024

• add dummy vision and text transformer config (assumed mcore to be false) (#9699) (#9827)

  Show description for 3885287
  

  github-actions[bot]

  and

  rohitrango

  authored
  3885287

• Jpg2p jun18 (#9538)

  Show description for 53d7a91
  

  3 peopleauthored
  53d7a91

• Query TransformerConfig attributes when copying btw configs (#9832)

  Show description for 10b5442
  akoumpa

  authored
  10b5442

• NeMo MoE docs (#9579)

  Show description for 153efc6
  

  akoumpa

  and

  yaoyu-33

  authored
  153efc6

• Fix hf hub for 0.24+ (#9806) (#9857)

  Show description for 5726d49
  

  github-actions[bot]

  and

  titu1994

  authored
  5726d49

• Fix RNNT alignments test (#9770) (#9862)

  Show description for a022765
  artbataev

  authored
  a022765

• Update arch check for SD (#9783)

  Show description for cd0d2c2
  

  minitu

  and

  Jaemin Choi

  authored
  cd0d2c2

• Revert "Jpg2p jun18 (#9538)" (#9874)

  Show description for 11bbe0b
  pablo-garay

  authored
  11bbe0b

• Revert and further changes for CICD bugfix (#9875)

  Show description for e400b6d
  pablo-garay

  authored
  e400b6d

Commits on Jul 25, 2024

• Change decord to guard import (#9865)

  Show description for 0ec398e
  meatybobby

  authored
  0ec398e

• By default trust remote code from HF Datasets (#9886) (#9887)

  Show description for 8a08319
  

  github-actions[bot]

  and

  nithinraok

  authored
  8a08319

• Docs: add "Nemo Fundamentals" page (#9835) (#9889)

  Show description for 28a2e52
  

  github-actions[bot]

  and

  erastorgueva-nv

  authored
  28a2e52

• Set default Torch version if YY.MM format is not met (#9776)

  Show description for 7eac53c
  thomasdhc

  authored
  7eac53c

• fix arg name (#9848)

  Show description for 5491642
  

  erhoo82

  and

  akoumpa

  authored
  5491642

• Added defer wgrad support with mcore optim (#9896)

  Show description for bd185cb
  

  sanandaraj5597

  and

  Selvaraj Anandaraj

  authored
  bd185cb

Commits on Jul 26, 2024

• tutorial fixes (#9907)

  JRD971000

  authored
  fe16259

• [TTS][Vietnamese] Add VietnameseCharsTokenizer (#9665)

  Show description for 74c2caf
  

  huutuongtu

  and

  XuesongYang

  authored
  74c2caf

• Integrate TRT-LLM v0.11 (#9705)

  Show description for c81f7cf
  oyilmaz-nvidia

  authored
  c81f7cf

• add code owner (#9917)

  pablo-garay

  authored
  fc0e4ab

• Fix Docker build. Make Dockerfile consistent with CI (#9784) (#9915)

  Show description for 67aee7f
  

  github-actions[bot]

  and

  artbataev

  authored
  67aee7f

• Fix missing parallelisms (#9725) (#9758)

  Show description for eaa8fa9
  

  github-actions[bot]

  and

  maanug-nv

  authored
  eaa8fa9

• Remove assert guard preventing PEFT + VP being used together (#9833)

  Show description for b484116
  vysarge

  authored
  b484116

• minor fix tutorial (#9927)

  JRD971000

  authored
  940bdb3

• New mcore transformer block spec (#9035)

  Show description for 7506f98
  

  5 peopleauthored
  7506f98

• [NeMo-UX] log val loss (#9814) (#9831)

  Show description for 4152edf
  

  github-actions[bot]

  and

  ashors1

  authored
  4152edf

• [NeMo-UX] Fix some dataloading bugs (#9807) (#9850)

  Show description for b505940
  

  github-actions[bot]

  and

  ashors1

  authored
  b505940

• [NeMo UX] Support generating datasets using different train/valid/test distributions (#9771) (#9841)

  Show description for 7a9b2ef
  

  github-actions[bot]

  and

  ashors1

  authored
  7a9b2ef

• [TTS][ja-JP] g2p and tokenizer. (#9879)

  Show description for 491b577
  

  3 peopleauthored
  491b577

• comment out flaky QAT test (#9935)

  pablo-garay

  authored
  515fcd9

• update branch name for script (#9936) (#9937)

  Show description for 6fe71f7
  

  github-actions[bot]

  and

  nithinraok

  authored
  6fe71f7

Commits on Jul 27, 2024

• updte branch (#9942) (#9943)

  Show description for ac706e9
  

  github-actions[bot]

  and

  nithinraok

  authored
  ac706e9

• Fix for scoring when Canary outputs a lot of endoftext tokens. (#9901)

  Show description for bc6d534
  pzelasko

  authored
  bc6d534

• Fixing canary prompts for back compatibility (#9836)

  Show description for 9dbdf57
  tbartley94

  authored
  9dbdf57

Commits on Jul 28, 2024

• Editing mcore T5 initialization interface to compatible with latest M-LM (#9791)

  Show description for 72f630d
  

  huvunvidia

  and

  Huy Vu2

  authored
  72f630d

Commits on Jul 29, 2024

• Adding distributed training functionality in bert embedding model and… (#9822)

  Show description for 558cf2e
  

  adityavavre

  and

  JRD971000

  authored
  558cf2e

• Draft: Add LoRA test with sequence parallelism (#9433)

  Show description for 0a9eb95
  michal2409

  authored
  0a9eb95

Commits on Jul 30, 2024

• [NeMo-UX] Set async_save from strategy rather than ModelCheckpoint (#9800) (#9853)

  Show description for e201b00
  

  github-actions[bot]

  and

  ashors1

  authored
  e201b00

• [NeMo-UX] Adding recipes (#9720) (#9851)

  Show description for bd17e77
  

  5 peopleauthored
  bd17e77

• fix a minor bug with async checkpointing where a checkpoint would get saved on_train_batch_end and on_validation_end within the same step (#9856) (#9867)

  Show description for 86bfac2
  

  github-actions[bot]

  and

  ashors1

  authored
  86bfac2

• Akoumparouli/mixtral fixes for r2.0.0rc1 (#9911) (#9933)

  Show description for 7dd9378
  

  github-actions[bot]

  and

  akoumpa

  authored
  7dd9378

• fix mem (#9957)

  Show description for 68d4dba
  gshennvm

  authored
  68d4dba

• Run a sample query for a quantized model conditionally (#9717)

  Show description for ad4dbdd
  janekl

  authored
  ad4dbdd

• Adds a Knob for OnlineSampling by introducing 'global_sample_mapping' in the SFT config.yaml (#9913)

  Show description for c29d91a
  

  3 peopleauthored
  c29d91a

• ci: Refactor tests to template (#9950)

  Show description for 0716675
  ko3n1g

  authored
  0716675

• mistral-2407 checkpoint converter (#9953)

  Show description for 1a8c9b6
  akoumpa

  authored
  1a8c9b6

Commits on Jul 31, 2024

• Updated Latest News and added Blog section (#9898)

  Show description for 9f9a01a
  jgerh

  authored
  9f9a01a

• [NeMo-UX] Fix some serialization bugs (#9868) (#9928)

  Show description for 6e5c87c
  

  github-actions[bot]

  and

  ashors1

  authored
  6e5c87c

• make progress bar easier to parse (#9877) (#9888)

  Show description for c63fd16
  

  github-actions[bot]

  and

  ashors1

  authored
  c63fd16

• Resiliency features update (#9714) (#9979)

  Show description for f3fd44c
  

  github-actions[bot]

  and

  jbieniusiewi

  authored
  f3fd44c

• hypen -> hyphen (#9976)

  Show description for 4d1d5bf
  akoumpa

  authored
  4d1d5bf

• Fix for train.controlnet.controlnet_v1_5_1node_100steps (#9678)

  Show description for e5b0fef
  

  3 peopleauthored
  e5b0fef

Commits on Aug 1, 2024

• Fix Canary not stripping prompt from reference + more test coverage (#9987)

  Show description for 876c851
  pzelasko

  authored
  876c851

• add bert conversion and cicd (#9966)

  Show description for adcc72b
  JRD971000

  authored
  adcc72b

• Rename sdk references to NeMo Run (#9872) (#9925)

  Show description for 5f30ede
  

  github-actions[bot]

  and

  hemildesai

  authored
  5f30ede

• [NeMo-UX] Fixes to make PreemptionCallback work (#9830) (#9908)

  Show description for 92f5f53
  

  github-actions[bot]

  and

  hemildesai

  authored
  92f5f53

• Support hf tokenizer in packed seq preparation script (#9974)

  Show description for a7fbf6b
  cuichenx

  authored
  a7fbf6b

• [NeMo-UX] Use single instance of loss reductions in GPTModel (#9801) (#9861)

  Show description for 38517a9
  

  github-actions[bot]

  and

  hemildesai

  authored
  38517a9

• Fix sdxl inference and add compatible changes for launcher support (#9995)

  Show description for d5507f0
  Victor49152

  authored
  d5507f0

• Add Mcore microbatches calculator supports (#9968)

  Show description for c277b9a
  BoxiangW

  authored
  c277b9a

Commits on Aug 2, 2024

• Allow users to pass HF via local-path: model_cls.import_ckpt("hf:///path/to/ckpt/"); (#9978)

  Show description for fdf07a9
  akoumpa

  authored
  fdf07a9

• clean up (#10024)

  Show description for 0b0e5bc
  stevehuang52

  authored
  0b0e5bc

• Update precision arg (#9859)

  Show description for df07e7f
  eagle705

  authored
  df07e7f

• Fix bug with distopt buckets when virtual pipelines are enabled (#9408)

  Show description for 0176224
  timmoon10

  authored
  0176224

• TRT-LLM checkpoint in safetensors (#10011)

  Show description for 7cf703c
  

  oyilmaz-nvidia

  and

  meatybobby

  authored
  7cf703c

• [NeMo-UX] Add more NeMo Logger tests (#9795) (#9931)

  Show description for 406bdb0
  

  3 peopleauthored
  406bdb0

• [NeMo-UX] Wait for async checkpoint calls to complete in preemption callback (#10014)

  Show description for 58ec3e6
  hemildesai

  authored
  58ec3e6

• [🤠]: Howdy folks, let's bump Dockerfile.ci to 0b4c4cf ! (#10017)

  Show description for b3aa26a
  ko3n1g

  authored
  b3aa26a

Commits on Aug 3, 2024

• Re-tarring script (#10004)

  Show description for dcb9832
  pzelasko

  authored
  dcb9832

• Revert back updated test (#9756)

  Show description for 75a734a
  pablo-garay

  authored
  75a734a

Commits on Aug 4, 2024

• log TFLOPs (#9932)

  Show description for d899549
  

  malay-nagda

  and

  Malay Nagda

  authored
  d899549

Commits on Aug 5, 2024

• [NeMo-UX] Add missing docstrings and update some defaults (#9895) (#9944)

  Show description for 7876e03
  

  github-actions[bot]

  and

  ashors1

  authored
  7876e03

• [NeMo-UX] Add distributed checkpointing unit tests (#9922)

  Show description for df1ea12
  

  github-actions[bot]

  and

  ashors1

  authored
  df1ea12

• Make Mistral HF to NeMo checkpoint converter iterable to allow for lo… (#9972)

  Show description for 7cfca95
  akoumpa

  authored
  7cfca95

• Schroedinger bridge model for audio processing (#9880)

  Show description for 53f361a
  anteju

  authored
  53f361a

• Update continual pre-training argument override strategy (#10027)

  Show description for 6acab7a
  yaoyu-33

  authored
  6acab7a

• remove prepare_youmakeup.py (#10028)

  Show description for 88b43e7
  

  3 peopleauthored
  88b43e7

Commits on Aug 6, 2024

• pin dask version (#9910) (#9918)

  Show description for 5d2e0d4
  

  github-actions[bot]

  and

  cuichenx

  authored
  5d2e0d4

• r2.0.0rc1 fix for dist checkpoint loading (#9854) (#9924)

  Show description for 8bd2a71
  

  github-actions[bot]

  and

  yaoyu-33

  authored
  8bd2a71

• fix vision clip (#9842)

  Show description for 7f16668
  

  Slyne

  and

  slyne deng

  authored
  7f16668

• [🤠]: Howdy folks, let's bump Dockerfile.ci to 2fd6e2b ! (#10045)

  Show description for 8880c37
  ko3n1g

  authored
  8880c37

• Update to vLLM 0.5.3.post1, LLAMA3.1 support (#9873)

  Show description for 8c70d7b
  

  apanteleev

  and

  oyilmaz-nvidia

  authored
  8c70d7b

• Add moe_router_pre_softmax=True to checkpoint converters & nemo-ux (#10050)

  Show description for 874a1ea
  akoumpa

  authored
  874a1ea

• Add support for overlapped gradient and parameter synchronization for GPT SFT model (#10041)

  Show description for 1bc5a87
  michal2409

  authored
  1bc5a87

• Nemotron Conversion script (#10031)

  Show description for d4d41ed
  suiyoubi

  authored
  d4d41ed

• Change default interval to step and add lr in prog_bar in nemo.lightning (#10033)

  Show description for c98be2f
  hemildesai

  authored
  c98be2f

• nemo ux mixtral 8x22b config (#9977)

  Show description for 71ab9d7
  akoumpa

  authored
  71ab9d7

• [NeMo-UX] Fix logging of consumed samples in MegatronDataSampler (#10018)

  Show description for 23697b9
  hemildesai

  authored
  23697b9

• [NeMo-UX] Update default PTL logging save_dir (#9954) (#9985)

  Show description for cb72f02
  

  github-actions[bot]

  and

  ashors1

  authored
  cb72f02

• [NeMo-UX] Wrap task config save in a try/except (#9956) (#9984)

  Show description for 7b7d02f
  

  github-actions[bot]

  and

  ashors1

  authored
  7b7d02f

Commits on Aug 7, 2024

• Use directly trtllm-build command for quantized checkpoints (#9982)

  Show description for c6412af
  janekl

  authored
  c6412af

• Fix Canary's transcribe(): move to device and prompt feeding (#10054)

  Show description for d0efff0
  pzelasko

  authored
  d0efff0

• nemo-ux: Use kv_channels to enable cases where head_dim != hidden_size // head… (#9994)

  Show description for 8dbe1da
  akoumpa

  authored
  8dbe1da

• [lhotse] Support for NeMo tarred manifests with offset field (#10035)

  Show description for e5e648d
  pzelasko

  authored
  e5e648d

• remove assertation for models with unknown chat template (#10042)

  Show description for 695fadc
  akoumpa

  authored
  695fadc

• add mixtral neva tutorial + update tutorials + update configs (#9926) (#9929)

  Show description for 7cae5c4
  

  3 peopleauthored
  7cae5c4

• add the mcore interface for optim arg; average_in_collective (#10010)

  Show description for 6cf59fa
  erhoo82

  authored
  6cf59fa

• mixtral recipe (#9975)

  Show description for 633c373
  akoumpa

  authored
  633c373

• Make MegatronStrategy.parallelism return ParallelismConfig (#10012)

  Show description for b9ecf00
  akoumpa

  authored
  b9ecf00

• log learning rate before optimizer step (#10063)

  Show description for 4ee9148
  ashors1

  authored
  4ee9148

• Update dev doc for features (#10049)

  Show description for e879330
  yaoyu-33

  authored
  e879330

Commits on Aug 8, 2024

• Update base image for tts asr import check test (#10072)

  Show description for 3ba23bd
  thomasdhc

  authored
  3ba23bd

Commits on Aug 9, 2024

• Drop PyTorch 2.1 version check from fabric strategies (#10079)

  Show description for 58606fe
  

  farhadrgh

  and

  marcromeyn

  authored
  58606fe

• Moe doc fixes (#10077)

  Show description for 86715c1
  akoumpa

  authored
  86715c1

Commits on Aug 12, 2024

• Comment docs (#10109)

  Show description for de29d19
  ericharper

  authored
  de29d19

• ci: Token permission to cancel Workflow run (#10095)

  Show description for 4b4f763
  ko3n1g

  authored
  4b4f763

• ci: Proper cleanup (#10114)

  Show description for d6cfdc0
  ko3n1g

  authored
  d6cfdc0