Cherry pick `PEFT Inference (11030)` into `r2.0.0` #5886

Run time

Learn about OS pricing on GitHub Actions

Job	Run time
cicd-cluster-clean	1s
cicd-cluster-clean	3s
gpu-test	1s
gpu-test	17s
cicd-test-container-setup	1s
cicd-test-container-setup	2m 57s
L0_Unit_Tests_GPU_Common	1s
OPTIONAL_L0_Unit_Tests_GPU_ASR	1s
OPTIONAL_L0_Unit_Tests_GPU_Audio	1s
L0_Unit_Tests_GPU_LLM	1s
L0_Unit_Tests_GPU_Multimodal	1s
OPTIONAL_L0_Unit_Tests_GPU_NLP	1s
OPTIONAL_L0_Unit_Tests_GPU_TTS	1s
L0_Unit_Tests_GPU_Hydra	1s
L0_Unit_Tests_GPU_Others	1s
OPTIONAL_L0_Unit_Tests_CPU_ASR	1s
OPTIONAL_L0_Unit_Tests_CPU_Audio	1s
OPTIONAL_L0_Unit_Tests_CPU_Common	1s
OPTIONAL_L0_Unit_Tests_GPU_Core	1s
OPTIONAL_L0_Unit_Tests_GPU_Lightning	1s
L0_Unit_Tests_CPU_Hydra	1s
L0_Setup_Test_Data_And_Models	1s
L0_Unit_Tests_CPU_Lightning	1s
L0_Unit_Tests_CPU_LLM	1s
L0_Unit_Tests_CPU_Multimodal	1s
L0_Unit_Tests_CPU_Others	1s
OPTIONAL_L0_Unit_Tests_CPU_Core	1s
OPTIONAL_L0_Unit_Tests_CPU_NLP	1s
OPTIONAL_L0_Unit_Tests_CPU_TTS	1s
L2_Community_LLM_Checkpoints_tests_Bert	1s
L2_Community_LLM_Checkpoints_tests_Falcon	1s
L2_Community_LLM_Checkpoints_tests_Llama	1s
L2_Community_LLM_Checkpoints_tests_Mamba2	1s
L2_Community_LLM_Checkpoints_tests_Llama3	1s
L2_Community_LLM_Checkpoints_tests_StarCoder	1s
ASR_dev_run_Speech_to_Text	1s
ASR_dev_run_Speech_to_Text_WPE_-_CitriNet	1s
L2_Community_vita_Checkpoints_tests_Llama3	1s
L2_Distill_Llama2	1s
L2_PTQ_Llama2_Export_Only	1s
L2_PTQ_Llama2_FP8	1s
OPTIONAL_L2_PTQ_Llama2_INT8_SQ	1s
ASR_dev_run_Speech_Pre-training_-_CitriNet	1s
ASR_dev_run_Speech_To_Text_Finetuning	1s
ASR_dev_run_Speech_to_Text_WPE_-_Conformer	1s
ASR_dev_run-part_two_Speech_to_Text_WPE_-_Squeezeformer	1s
L2_Speech_to_Text_EMA	1s
L2_Speech_to_Text_AED	1s
OPTIONAL_ASR_dev_run_Speech_To_Text_HF_Finetuning	1s
L2_Speaker_dev_run_Clustering_Diarizer_Inference	1s
L2_Speaker_dev_run_Speaker_Diarization	1s
L2_Speaker_dev_run_Neural_Diarizer_Inference	1s
L2_Speaker_dev_run_Speaker_Diarization_with_ASR_Inference	1s
L2_Speaker_dev_run_Speaker_Recognition	1s
L2_Speaker_dev_run_Speech_to_Label	1s
L2_ASR_Adapters_Linear_Adapters	1s
L2_ASR_Adapters_RelPos_MHA_Adapters	1s
L2_ASR_Multi-dataloader_dev_run_Speech_to_Label_multi-dataloader	1s
L2_ASR_Multi-dataloader_dev_run_Speech_to_Text_multi-dataloader	1s
L2_Speaker_dev_run_Multispeaker_ASR_Data_Simulation	1s
L2_Speech_Estimate_Duration_Bins	1s
L2_Speech_Batch_Size_OOMptimizer	1s
L2_Segmentation_Tool_Parallel_ctc_segmentation_test_L2_Eng_CitriNet_with_wav	1s
L2_Segmentation_Tool_Parallel_ctc_segmentation_test_L2_Ru_QN_with_mp3	1s
L2_Speech_Batch_Size_OOMptimizer_Canary	1s
L2_Speech_Transcription_Canary_Transcribe_Audio_Dir	1s
L2_Speech_Transcription_Canary_Transcribe_With_Prompt	1s
L2_Speech_Transcription_Canary_Transcribe_Full_Manifest	1s
L2_Speech_Transcription_Speech_to_Text_Transcribe	1s
OPTIONAL_L2_Transducer_alignment_Running_pytest	1s
L2_Duplex_Text_Normalization_with_Tarred_dataset	1s
L2_G2P_Models_G2P_Conformer_training_evaluation_and_inference	1s
L2_G2P_Models_HeteronymClassificationModel_training_evaluation_and_inference	1s
L2_Intent_and_Slot_Classification_Tasks_Intent_and_Slot_Classification	1s
L2_Intent_and_Slot_Classification_Tasks_Multi-Label_Intent_and_Slot_Classification	1s
L2_Parallel_NLP_Examples2_NER_finetuning_from_pretrained_Test	1s
L2_NMT_Attention_is_All_You_Need_Training_NMT_Training_Pre-LN	1s
L2_Parallel_NLP_Examples2_Evaluation_script_for_Punctuation	1s
L2_Parallel_NLP_Examples2_Evaluation_script_for_Token_Classification	1s
L2_Parallel_NLP_Examples2_NER_with_TurkuNLP__bert-base-finnish-cased-v1	1s
L2_Parallel_NLP_Examples2_Punctuation_and_capitalization_finetuning_from_pretrained_test	1s
L2_Pretraining_BERT_from_Preprocessed	1s
L2_Pretraining_BERT_pretraining_from_Text	1s
L2_Megatron_BART_Perceiver_MIM_Training_TP2	1s
L2_Megatron_NMT_Training_TP2	1s
L2_NMT_Attention_is_All_You_Need_Finetuning	1s
L2_NMT_Attention_is_All_You_Need_Inference	1s
L2_NMT_Attention_is_All_You_Need_Training_NMT_Multi-Validation	1s
L2_NMT_Attention_is_All_You_Need_Training_NMT_Training_Post-LN	1s
L2_NMT_Tarred_Dataset_Creation_Auto_Tarred_Dataset_Creation	1s
L2_NMT_Tarred_Dataset_Creation_Script_Tarred_Dataset_Creation	1s
L2_BioMegatron_Bert_NER_Task	1s
L2_Legacy_Megatron_RETRO_Pretraining_and_Resume_Training	1s
L2_Megatron_Bert_Pretraining_and_Resume_Training	1s
L2_Megatron_Bert_Pretraining_and_Resume_Training_with_Pipeline_Parallelism	1s
L2_Megatron_Core_Bert_Pretraining_and_Resume_Training	1s
L2_Megatron_GPT_Pretraining_and_Resume_Training_TP2	1s
L2_Megatron_RETRO_Pretraining_and_Resume_Training	1s
L2_RAG_Pipeline_Generating	1s
L2_RAG_Pipeline_Indexing	1s
L2_Megatron_GPT_Finetuning_PP2	1s
L2_Megatron_GPT_Finetuning_StarCoder_PP1	1s
L2_Megatron_GPT_Reranker	1s
L2_Megatron_GPT_with_ALiBi_Pretraining_and_Resume_Training_TP2	1s
L2_Megatron_GPT_with_KERPLE_Pretraining_and_Resume_Training_TP2	1s
L2_Megatron_GPT_with_ResetLR_Pretraining_and_Resume_Training_TP2	1s
L2_Megatron_GPT_with_Rope_Pretraining_and_Resume_Training_TP2	1s
OPTIONAL_L2_Megatron_GPT_Embedding	1s
Optional_L2_Megatron_GPT_Pretraining_and_Resume_Training_PP2	1s
L2_Megatron_Change_Partitions_Reduce_TP_Num_Partitions_-2_to_1-_and_PP_Num_Partitions_-1_to_2	1s
L2_Megatron_GPT_Eval	1s
L2_Megatron_GPT_Eval_PP2	1s
L2_Megatron_GPT_PEFT_Lora_PP2_O2	1s
L2_Megatron_GPT_PEFT_Lora_TP2_O1	1s
L2_Megatron_GPT_PEFT_Lora_TP2SP1	1s
L2_Megatron_GPT_SFT_Eval_inference_seq_len_greaterThan_training_seq_len	1s
L2_Megatron_Change_Partitions_Increase_TP_Num_Partitions_-2_to_4-_and_PP_Num_Partitions_-1_to_2	1s
L2_Megatron_Core_T5_Pretraining_and_Resume_Training_TP2	1s
L2_Megatron_T5_Pretraining_and_Resume_Training_PP2	1s
L2_Megatron_T5_Pretraining_and_Resume_Training_TP2	1s
L2_Megatron_T5_with_ALiBi_Pretraining_and_Resume_Training_TP2	1s
L2_Megatron_T5_with_KERPLE_Pretraining_and_Resume_Training_TP2	1s
L2_Megatron_BART_Pretraining_and_Resume_Training_PP2	1s
L2_Megatron_BART_Pretraining_and_Resume_Training_TP2	1s
L2_Megatron_Core_T5_Eval	1s
L2_Megatron_T5_Eval	1s
L2_Megatron_T5_PEFT_Lora_TP2	1s
L2_Megatron_T5_w_Mixture_of_Expert_Pretraining	1s
L2_Megatron_UL2_Pretraining_and_Resume_Training_TP2	1s
L2_Megatron_Mock_Data_Generation_MockGPTDataset	1s
L2_Megatron_Core_T5_PEFT_Lora_TP2	1s
L2_Megatron_Mock_Data_Generation_MockT5Dataset	1s
L2_TTS_Fast_dev_runs_1_FastPitch	1s
L2_TTS_Fast_dev_runs_1_Hifigan	1s
L2_TTS_Fast_dev_runs_1_Tacotron_2	1s
L2_TTS_Fast_dev_runs_1_WaveGlow	1s
L2_TTS_Fast_dev_runs_1_Mixer-TTS	1s
L2_NeMo_2_GPT_Pretraining_no_transformer_engine	1s
OPTIONAL_L2_NeMo_2_GPT_DDP_Param_Parity_check	1s
OPTIONAL_L2_Stable_Diffusion_Training	1s
Speech_Checkpoints_tests	1s
L2_NeMo_2_GPT_SFT_TP1PP1_MBS1	1s
L2_NeMo_2_GPT_SFT_TP1PP1_MBS2	1s
L2_NeMo_2_GPT_SFT_TP1PP2_MBS2	1s
L2_NeMo_2_GPT_SFT_TP2PP1_MBS2	1s
OPTIONAL_L2_NeMo_2_SSM_Finetuning	1s
OPTIONAL_L2_NeMo_2_SSM_Pretraining	1s
L2_NeMo_2_GPT_LoRA_TP1PP1_MBS1	1s
L2_NeMo_2_GPT_LoRA_TP1PP1_MBS2	1s
L2_NeMo_2_GPT_LoRA_TP1PP2_MBS2	1s
L2_NeMo_2_GPT_LoRA_TP2PP1_MBS2	1s
Nemo_CICD_Test	2s
Nemo_CICD_Test	5s
pre-flight	1s
L0_Unit_Tests_GPU_Common / main	2m 51s
L0_Unit_Tests_GPU_Multimodal / main	1m 42s
L0_Unit_Tests_GPU_LLM / main	2m 43s
L0_Unit_Tests_GPU_Others / main	1m 35s
OPTIONAL_L0_Unit_Tests_GPU_ASR / main	7m 40s
L0_Unit_Tests_CPU_LLM / main	1m 52s
L0_Unit_Tests_GPU_Hydra / main	2m 3s
OPTIONAL_L0_Unit_Tests_GPU_Audio / main	2m 35s
OPTIONAL_L0_Unit_Tests_GPU_NLP / main	3m 38s
OPTIONAL_L0_Unit_Tests_GPU_Lightning / main	2m 39s
L0_Unit_Tests_CPU_Multimodal / main	1m 49s
OPTIONAL_L0_Unit_Tests_CPU_ASR / main	10m 31s
OPTIONAL_L0_Unit_Tests_GPU_Core / main	21m 16s
OPTIONAL_L0_Unit_Tests_GPU_TTS / main	1m 38s
OPTIONAL_L0_Unit_Tests_CPU_Audio / main	2m 43s
OPTIONAL_L0_Unit_Tests_CPU_NLP / main	2m 36s
OPTIONAL_L0_Unit_Tests_CPU_TTS / main	2m 48s
L0_Setup_Test_Data_And_Models / main	1m 19s
OPTIONAL_L0_Unit_Tests_CPU_Common / main	2m 51s
L0_Unit_Tests_CPU_Hydra / main	2m 3s
L0_Unit_Tests_CPU_Lightning / main	1m 45s
L0_Unit_Tests_CPU_Others / main	1m 32s
L2_Community_LLM_Checkpoints_tests_Bert / main	1m 59s
L2_Community_LLM_Checkpoints_tests_Llama3 / main	1m 49s
L2_Community_LLM_Checkpoints_tests_Falcon / main	1m 42s
L2_Community_LLM_Checkpoints_tests_StarCoder / main	1m 45s
OPTIONAL_L0_Unit_Tests_CPU_Core / main	6m 46s
ASR_dev_run_Speech_Pre-training_-_CitriNet / main	58s
ASR_dev_run_Speech_To_Text_Finetuning / main	56s
L2_Community_LLM_Checkpoints_tests_Llama / main	1m 48s
ASR_dev_run_Speech_to_Text / main	1m 1s
L2_Community_LLM_Checkpoints_tests_Mamba2 / main	1m 50s
L2_Community_vita_Checkpoints_tests_Llama3 / main	5m 4s
L2_PTQ_Llama2_Export_Only / main	1m 35s
L2_Distill_Llama2 / main	2m 54s
L2_PTQ_Llama2_FP8 / main	1m 51s
OPTIONAL_ASR_dev_run_Speech_To_Text_HF_Finetuning / main	1m 39s
OPTIONAL_L2_PTQ_Llama2_INT8_SQ / main	1m 39s
ASR_dev_run_Speech_to_Text_WPE_-_CitriNet / main	59s
ASR_dev_run-part_two_Speech_to_Text_WPE_-_Squeezeformer / main	48s
ASR_dev_run_Speech_to_Text_WPE_-_Conformer / main	45s
L2_Speech_to_Text_AED / main	55s
L2_Speaker_dev_run_Speaker_Diarization / main	47s
L2_Speaker_dev_run_Clustering_Diarizer_Inference / main	1m 43s
L2_Speaker_dev_run_Speaker_Recognition / main	47s
L2_Speaker_dev_run_Speaker_Diarization_with_ASR_Inference / main	1m 38s
L2_Speech_to_Text_EMA / main	1m 58s
L2_ASR_Adapters_Linear_Adapters / main	52s
L2_Speaker_dev_run_Speech_to_Label / main	50s
L2_ASR_Multi-dataloader_dev_run_Speech_to_Label_multi-dataloader / main	46s
L2_ASR_Adapters_RelPos_MHA_Adapters / main	52s
L2_ASR_Multi-dataloader_dev_run_Speech_to_Text_multi-dataloader / main	1m 3s
L2_Speaker_dev_run_Multispeaker_ASR_Data_Simulation / main	1m 35s
L2_Speaker_dev_run_Neural_Diarizer_Inference / main	1m 47s
L2_Segmentation_Tool_Parallel_ctc_segmentation_test_L2_Ru_QN_with_mp3 / main	2m 59s
L2_Speech_Batch_Size_OOMptimizer / main	2m 41s
L2_Speech_Batch_Size_OOMptimizer_Canary / main	2m 6s
L2_Speech_Estimate_Duration_Bins / main	1m 50s
L2_Speech_Transcription_Canary_Transcribe_Audio_Dir / main	3m 28s
L2_Speech_Transcription_Canary_Transcribe_With_Prompt / main	3m 31s
L2_Speech_Transcription_Canary_Transcribe_Full_Manifest / main	3m 26s
L2_Speech_Transcription_Speech_to_Text_Transcribe / main	1m 37s
L2_Duplex_Text_Normalization_with_Tarred_dataset / main	1m 48s
L2_G2P_Models_G2P_Conformer_training_evaluation_and_inference / main	2m 1s
L2_Segmentation_Tool_Parallel_ctc_segmentation_test_L2_Eng_CitriNet_with_wav / main	3m 41s
OPTIONAL_L2_Transducer_alignment_Running_pytest / main	1m 37s
L2_G2P_Models_HeteronymClassificationModel_training_evaluation_and_inference / main	2m 36s
L2_Intent_and_Slot_Classification_Tasks_Intent_and_Slot_Classification / main	53s
L2_Intent_and_Slot_Classification_Tasks_Multi-Label_Intent_and_Slot_Classification / main	55s
L2_Parallel_NLP_Examples2_Evaluation_script_for_Token_Classification / main	1m 49s
L2_Parallel_NLP_Examples2_Punctuation_and_capitalization_finetuning_from_pretrained_test / main	1m 2s
L2_NMT_Attention_is_All_You_Need_Training_NMT_Training_Post-LN / main	1m 14s
L2_Parallel_NLP_Examples2_Evaluation_script_for_Punctuation / main	1m 44s
L2_Parallel_NLP_Examples2_NER_with_TurkuNLP__bert-base-finnish-cased-v1 / main	47s
L2_NMT_Attention_is_All_You_Need_Finetuning / main	1m 40s
L2_Parallel_NLP_Examples2_NER_finetuning_from_pretrained_Test / main	59s
L2_NMT_Attention_is_All_You_Need_Inference / main	1m 55s
L2_Pretraining_BERT_pretraining_from_Text / main	55s
L2_Megatron_BART_Perceiver_MIM_Training_TP2 / main	2m 51s
L2_NMT_Attention_is_All_You_Need_Training_NMT_Training_Pre-LN / main	55s
L2_NMT_Attention_is_All_You_Need_Training_NMT_Multi-Validation / main	1m 9s
L2_Pretraining_BERT_from_Preprocessed / main	59s
L2_Megatron_Bert_Pretraining_and_Resume_Training / main	3m 40s
L2_Megatron_Bert_Pretraining_and_Resume_Training_with_Pipeline_Parallelism / main	3m 40s
L2_Megatron_NMT_Training_TP2 / main	3m 54s
L2_BioMegatron_Bert_NER_Task / main	3m 27s
L2_Legacy_Megatron_RETRO_Pretraining_and_Resume_Training / main	2m 53s
L2_NMT_Tarred_Dataset_Creation_Auto_Tarred_Dataset_Creation / main	54s
L2_NMT_Tarred_Dataset_Creation_Script_Tarred_Dataset_Creation / main	1m 45s
L2_Megatron_Core_Bert_Pretraining_and_Resume_Training / main	3m 38s
L2_Megatron_RETRO_Pretraining_and_Resume_Training / main	8m 18s
L2_RAG_Pipeline_Generating / main	2m 25s
L2_Megatron_GPT_Finetuning_StarCoder_PP1 / main	1m 17s
L2_Megatron_GPT_Finetuning_PP2 / main	4m 50s
L2_Megatron_GPT_PEFT_Lora_PP2_O2 / main	2m 50s
L2_Megatron_GPT_PEFT_Lora_TP2_O1 / main	2m 47s
L2_Megatron_GPT_Pretraining_and_Resume_Training_TP2 / main	3m 36s
L2_Megatron_GPT_with_ALiBi_Pretraining_and_Resume_Training_TP2 / main	3m 0s
L2_Megatron_GPT_with_KERPLE_Pretraining_and_Resume_Training_TP2 / main	2m 57s
L2_Megatron_GPT_with_ResetLR_Pretraining_and_Resume_Training_TP2 / main	4m 9s
L2_Megatron_GPT_with_Rope_Pretraining_and_Resume_Training_TP2 / main	3m 1s
L2_RAG_Pipeline_Indexing / main	1m 54s
L2_Megatron_Change_Partitions_Increase_TP_Num_Partitions_-2_to_4-_and_PP_Num_Partitions_-1_to_2 / main	1m 59s
L2_Megatron_Change_Partitions_Reduce_TP_Num_Partitions_-2_to_1-_and_PP_Num_Partitions_-1_to_2 / main	1m 58s
L2_Megatron_GPT_Reranker / main	1m 47s
OPTIONAL_L2_Megatron_GPT_Embedding / main	2m 20s
Optional_L2_Megatron_GPT_Pretraining_and_Resume_Training_PP2 / main	3m 48s
L2_Megatron_Core_T5_Pretraining_and_Resume_Training_TP2 / main	3m 11s
L2_Megatron_GPT_Eval / main	1m 59s
L2_Megatron_GPT_Eval_PP2 / main	2m 51s
L2_Megatron_GPT_PEFT_Lora_TP2SP1 / main	1m 8s
L2_Megatron_GPT_SFT_Eval_inference_seq_len_greaterThan_training_seq_len / main	1m 58s
L2_Megatron_T5_Pretraining_and_Resume_Training_PP2 / main	2m 50s
L2_Megatron_T5_Pretraining_and_Resume_Training_TP2 / main	2m 55s
L2_Megatron_T5_w_Mixture_of_Expert_Pretraining / main	2m 3s
L2_Megatron_T5_with_ALiBi_Pretraining_and_Resume_Training_TP2 / main	2m 54s
L2_Megatron_T5_with_KERPLE_Pretraining_and_Resume_Training_TP2 / main	2m 55s
L2_Megatron_BART_Pretraining_and_Resume_Training_PP2 / main	2m 48s
L2_Megatron_BART_Pretraining_and_Resume_Training_TP2 / main	2m 51s
L2_Megatron_Core_T5_Eval / main	1m 55s
L2_Megatron_T5_Eval / main	1m 38s
L2_Megatron_Core_T5_PEFT_Lora_TP2 / main	3m 43s
L2_Megatron_T5_PEFT_Lora_TP2 / main	2m 50s
L2_Megatron_Mock_Data_Generation_MockGPTDataset / main	3m 4s
L2_Megatron_UL2_Pretraining_and_Resume_Training_TP2 / main	2m 55s
L2_Megatron_Mock_Data_Generation_MockT5Dataset / main	1m 58s
L2_TTS_Fast_dev_runs_1_FastPitch / main	1m 56s
L2_TTS_Fast_dev_runs_1_Hifigan / main	1m 44s
L2_TTS_Fast_dev_runs_1_Mixer-TTS / main	1m 59s
L2_TTS_Fast_dev_runs_1_Tacotron_2 / main	1m 1s
L2_TTS_Fast_dev_runs_1_WaveGlow / main	1m 43s
L2_NeMo_2_GPT_LoRA_TP1PP1_MBS1 / main	3m 37s
L2_NeMo_2_GPT_Pretraining_no_transformer_engine / main	3m 32s
Speech_Checkpoints_tests / main	3m 38s
L2_NeMo_2_GPT_SFT_TP1PP1_MBS2 / main	4m 8s
L2_NeMo_2_GPT_SFT_TP1PP1_MBS1 / main	4m 12s
L2_NeMo_2_GPT_SFT_TP1PP2_MBS2 / main	4m 5s
L2_NeMo_2_GPT_SFT_TP2PP1_MBS2 / main	4m 6s
OPTIONAL_L2_NeMo_2_GPT_DDP_Param_Parity_check / main	2m 11s
OPTIONAL_L2_NeMo_2_SSM_Finetuning / main	4m 22s
OPTIONAL_L2_Stable_Diffusion_Training / main	4m 12s
OPTIONAL_L2_NeMo_2_SSM_Pretraining / main	3m 49s
L2_NeMo_2_GPT_LoRA_TP1PP2_MBS2 / main	3m 37s
L2_NeMo_2_GPT_LoRA_TP1PP1_MBS2 / main	3m 38s
L2_NeMo_2_GPT_LoRA_TP2PP1_MBS2 / main	3m 38s
	6h 20m 52s

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Cherry pick `PEFT Inference (11030)` into `r2.0.0` #5886

Usage

Cherry pick `PEFT Inference (11030)` into `r2.0.0` #5886

Jobs

Run details

Run time

Cherry pick PEFT Inference (11030) into r2.0.0 #5886

Usage

Run time

Cherry pick `PEFT Inference (11030)` into `r2.0.0` #5886