Skip to content
Back to pull request #9715

Allows non-strict load with distributed checkpoints #2971

Sign in to view logs

Allows non-strict load with distributed checkpoints

Allows non-strict load with distributed checkpoints #2971

Run time

Learn about OS pricing on GitHub Actions
Job Run time
cicd-cluster-clean
3s
gpu-test
16s
cicd-test-container-setup
22m 55s
L2_QAT_Llama2_INT4
4m 7s
L2_Megatron_Bert_Pretraining_and_Resume_Training
3m 52s
L2_Megatron_Core_Bert_Pretraining_and_Resume_Training
2m 58s
L2_Megatron_Bert_Pretraining_and_Resume_Training_with_Pipeline_Parallelism
1m 43s
L2_RAG_Pipeline_Indexing
1m 17s
L2_Megatron_GPT_Finetuning_StarCoder_PP1
2m 6s
L2_Megatron_GPT_Pretraining_and_Resume_Training_TP2
3m 22s
L2_Megatron_GPT_with_ALiBi_Pretraining_and_Resume_Training_TP2
1m 33s
L2_Megatron_GPT_with_KERPLE_Pretraining_and_Resume_Training_TP2
2m 10s
L2_Megatron_GPT_with_Rope_Pretraining_and_Resume_Training_TP2
2m 10s
L2_Megatron_GPT_with_ResetLR_Pretraining_and_Resume_Training_TP2
2m 32s
L2_RAG_Pipeline_Generating
1m 45s
L2_Community_LLM_Checkpoints_tests_Llama / main
34s
L2_Community_LLM_Checkpoints_tests_Llama / runner-auto-clean
3s
L0_Setup_Test_Data_And_Models / runner-auto-clean
9s
L0_Setup_Test_Data_And_Models / main
25s
L0_Unit_Tests_CPU / main
29m 38s
L0_Unit_Tests_CPU / runner-auto-clean
9s
L0_Unit_Tests_GPU / main
41m 37s
L0_Unit_Tests_GPU / runner-auto-clean
4s
L2_Community_LLM_Checkpoints_tests_Llama3 / runner-auto-clean
4s
L2_Community_LLM_Checkpoints_tests_Falcon / runner-auto-clean
3s
L2_Community_LLM_Checkpoints_tests_Falcon / main
1m 0s
L2_Community_LLM_Checkpoints_tests_Llama3 / main
34s
L2_Community_LLM_Checkpoints_tests_StarCoder / runner-auto-clean
3s
L2_Community_LLM_Checkpoints_tests_StarCoder / main
39s
L2_Community_vita_Checkpoints_tests_Llama3 / main
4m 48s
L2_Community_vita_Checkpoints_tests_Llama3 / runner-auto-clean
3s
L2_PTQ_Llama2_FP8 / runner-auto-clean
3s
L2_PTQ_Llama2_Export_Only / main
29s
L2_PTQ_Llama2_Export_Only / runner-auto-clean
2s
L2_PTQ_Llama2_FP8 / main
3m 49s
L2_PTQ_Llama2_INT8_SQ / main
1m 3s
ASR_dev_run_Speech_Pre-training_-_CitriNet / runner-auto-clean
8s
L2_PTQ_Llama2_INT8_SQ / runner-auto-clean
8s
ASR_dev_run_Speech_Pre-training_-_CitriNet / main
1m 45s
ASR_dev_run_Speech_to_Text / main
44s
ASR_dev_run_Speech_to_Text / runner-auto-clean
3s
ASR_dev_run_Speech_To_Text_Finetuning / main
42s
ASR_dev_run_Speech_To_Text_Finetuning / runner-auto-clean
3s
ASR_dev_run_Speech_to_Text_WPE_-_CitriNet / runner-auto-clean
3s
ASR_dev_run_Speech_to_Text_WPE_-_CitriNet / main
40s
ASR_dev_run_Speech_to_Text_WPE_-_Conformer / runner-auto-clean
3s
ASR_dev_run-part_two_Speech_to_Text_WPE_-_Squeezeformer / main
31s
ASR_dev_run-part_two_Speech_to_Text_WPE_-_Squeezeformer / runner-auto-clean
2s
ASR_dev_run_Speech_to_Text_WPE_-_Conformer / main
31s
L2_Speaker_dev_run_Speaker_Recognition / main
31s
L2_Speaker_dev_run_Speaker_Recognition / runner-auto-clean
3s
L2_Speech_to_Text_EMA / main
45s
L2_Speech_to_Text_EMA / runner-auto-clean
7s
L2_ASR_Adapters_Linear_Adapters / main
33s
L2_ASR_Adapters_Linear_Adapters / runner-auto-clean
3s
OPTIONAL_ASR_dev_run_Speech_To_Text_HF_Finetuning / main
1m 28s
OPTIONAL_ASR_dev_run_Speech_To_Text_HF_Finetuning / runner-auto-clean
3s
L2_ASR_Adapters_RelPos_MHA_Adapters / main
34s
L2_ASR_Adapters_RelPos_MHA_Adapters / runner-auto-clean
2s
L2_ASR_Multi-dataloader_dev_run_Speech_to_Label_multi-dataloader / runner-auto-clean
3s
L2_ASR_Multi-dataloader_dev_run_Speech_to_Label_multi-dataloader / main
31s
L2_ASR_Multi-dataloader_dev_run_Speech_to_Text_multi-dataloader / runner-auto-clean
3s
L2_ASR_Multi-dataloader_dev_run_Speech_to_Text_multi-dataloader / main
41s
L2_Segmentation_Tool_Parallel_ctc_segmentation_test_L2_Eng_CitriNet_with_wav / runner-auto-clean
8s
L2_Segmentation_Tool_Parallel_ctc_segmentation_test_L2_Eng_CitriNet_with_wav / main
2m 8s
L2_Speaker_dev_run_Clustering_Diarizer_Inference / main
31s
L2_Speaker_dev_run_Clustering_Diarizer_Inference / runner-auto-clean
3s
L2_Speaker_dev_run_Multispeaker_ASR_Data_Simulation / main
25s
L2_Speaker_dev_run_Multispeaker_ASR_Data_Simulation / runner-auto-clean
3s
L2_Speaker_dev_run_Neural_Diarizer_Inference / main
38s
L2_Speaker_dev_run_Neural_Diarizer_Inference / runner-auto-clean
3s
L2_Speaker_dev_run_Speaker_Diarization / main
31s
L2_Speaker_dev_run_Speaker_Diarization / runner-auto-clean
3s
L2_Speaker_dev_run_Speaker_Diarization_with_ASR_Inference / main
51s
L2_Speaker_dev_run_Speaker_Diarization_with_ASR_Inference / runner-auto-clean
3s
L2_Speaker_dev_run_Speech_to_Label / runner-auto-clean
2s
L2_Speaker_dev_run_Speech_to_Label / main
31s
L2_Speech_Transcription_Speech_to_Text_Transcribe / main
25s
L2_Speech_Transcription_Speech_to_Text_Transcribe / runner-auto-clean
8s
L2_Transducer_alignment_Running_pytest / runner-auto-clean
8s
L2_Transducer_alignment_Running_pytest / main
1m 22s
L2_Duplex_Text_Normalization_with_Tarred_dataset / main
1m 6s
L2_Duplex_Text_Normalization_with_Tarred_dataset / runner-auto-clean
3s
L2_G2P_Models_G2P_Conformer_training_evaluation_and_inference / runner-auto-clean
3s
L2_G2P_Models_G2P_Conformer_training_evaluation_and_inference / main
1m 23s
L2_G2P_Models_HeteronymClassificationModel_training_evaluation_and_inference / main
1m 5s
L2_G2P_Models_HeteronymClassificationModel_training_evaluation_and_inference / runner-auto-clean
3s
L2_Intent_and_Slot_Classification_Tasks_Intent_and_Slot_Classification / main
33s
L2_Intent_and_Slot_Classification_Tasks_Intent_and_Slot_Classification / runner-auto-clean
3s
L2_Intent_and_Slot_Classification_Tasks_Multi-Label_Intent_and_Slot_Classification / main
36s
L2_Intent_and_Slot_Classification_Tasks_Multi-Label_Intent_and_Slot_Classification / runner-auto-clean
2s
L2_Parallel_NLP_Examples2_Evaluation_script_for_Punctuation / main
37s
L2_Parallel_NLP_Examples2_Evaluation_script_for_Punctuation / runner-auto-clean
3s
L2_Parallel_NLP_Examples2_Evaluation_script_for_Token_Classification / main
1m 4s
L2_Parallel_NLP_Examples2_Evaluation_script_for_Token_Classification / runner-auto-clean
3s
L2_Parallel_NLP_Examples2_NER_finetuning_from_pretrained_Test / main
38s
L2_Parallel_NLP_Examples2_NER_finetuning_from_pretrained_Test / runner-auto-clean
2s
L2_Parallel_NLP_Examples2_NER_with_TurkuNLP__bert-base-finnish-cased-v1 / main
33s
L2_Parallel_NLP_Examples2_NER_with_TurkuNLP__bert-base-finnish-cased-v1 / runner-auto-clean
2s
L2_Parallel_NLP_Examples2_Punctuation_and_capitalization_finetuning_from_pretrained_test / main
38s
L2_Parallel_NLP_Examples2_Punctuation_and_capitalization_finetuning_from_pretrained_test / runner-auto-clean
3s
L2_Pretraining_BERT_from_Preprocessed / main
37s
L2_Pretraining_BERT_from_Preprocessed / runner-auto-clean
3s
L2_Pretraining_BERT_pretraining_from_Text / main
34s
L2_Pretraining_BERT_pretraining_from_Text / runner-auto-clean
2s
L2_Legacy_Megatron_RETRO_Pretraining_and_Resume_Training / main
1m 41s
L2_Segmentation_Tool_Parallel_ctc_segmentation_test_L2_Ru_QN_with_mp3 / main
2m 2s
L2_Legacy_Megatron_RETRO_Pretraining_and_Resume_Training / runner-auto-clean
3s
L2_Segmentation_Tool_Parallel_ctc_segmentation_test_L2_Ru_QN_with_mp3 / runner-auto-clean
3s
L2_Megatron_BART_Perceiver_MIM_Training_TP2 / main
1m 38s
L2_Megatron_BART_Perceiver_MIM_Training_TP2 / runner-auto-clean
3s
L2_Megatron_NMT_Training_TP2 / runner-auto-clean
2s
L2_Megatron_NMT_Training_TP2 / main
3m 25s
L2_Megatron_RETRO_Pretraining_and_Resume_Training / runner-auto-clean
3s
L2_Megatron_RETRO_Pretraining_and_Resume_Training / main
7m 16s
L2_NMT_Attention_is_All_You_Need_Finetuning / runner-auto-clean
3s
L2_NMT_Attention_is_All_You_Need_Finetuning / main
1m 36s
L2_NMT_Attention_is_All_You_Need_Inference / main
1m 13s
L2_NMT_Attention_is_All_You_Need_Inference / runner-auto-clean
3s
L2_NMT_Attention_is_All_You_Need_Training_NMT_Multi-Validation / main
58s
L2_NMT_Attention_is_All_You_Need_Training_NMT_Multi-Validation / runner-auto-clean
3s
L2_NMT_Attention_is_All_You_Need_Training_NMT_Training_Post-LN / main
59s
L2_NMT_Attention_is_All_You_Need_Training_NMT_Training_Post-LN / runner-auto-clean
3s
L2_NMT_Attention_is_All_You_Need_Training_NMT_Training_Pre-LN / main
46s
L2_NMT_Attention_is_All_You_Need_Training_NMT_Training_Pre-LN / runner-auto-clean
3s
L2_NMT_Tarred_Dataset_Creation_Auto_Tarred_Dataset_Creation / main
42s
L2_NMT_Tarred_Dataset_Creation_Auto_Tarred_Dataset_Creation / runner-auto-clean
3s
L2_BioMegatron_Bert_NER_Task / runner-auto-clean
3s
L2_NMT_Tarred_Dataset_Creation_Script_Tarred_Dataset_Creation / main
1m 3s
L2_NMT_Tarred_Dataset_Creation_Script_Tarred_Dataset_Creation / runner-auto-clean
3s
L2_BioMegatron_Bert_NER_Task / main
1m 31s
L2_Megatron_GPT_Embedding / main
1m 24s
L2_Megatron_GPT_Eval / main
1m 43s
L2_Megatron_GPT_Embedding / runner-auto-clean
3s
L2_Megatron_GPT_Eval / runner-auto-clean
3s
L2_Megatron_GPT_Eval_PP2 / main
1m 24s
L2_Megatron_GPT_Eval_PP2 / runner-auto-clean
3s
L2_Megatron_GPT_PEFT_Lora_PP2_O2 / main
2m 12s
L2_Megatron_GPT_PEFT_Lora_PP2_O2 / runner-auto-clean
3s
L2_Megatron_GPT_Finetuning_PP2 / main
2m 59s
L2_Megatron_GPT_Finetuning_PP2 / runner-auto-clean
3s
L2_Megatron_GPT_PEFT_Lora_TP2_O1 / main
2m 10s
L2_Megatron_GPT_PEFT_Lora_TP2_O1 / runner-auto-clean
3s
L2_Megatron_GPT_Pretraining_and_Resume_Training_PP2 / main
3m 8s
L2_Megatron_GPT_Pretraining_and_Resume_Training_PP2 / runner-auto-clean
3s
L2_Megatron_GPT_SFT_Eval_inference_seq_len_greaterThan_training_seq_len / main
1m 10s
L2_Megatron_GPT_SFT_Eval_inference_seq_len_greaterThan_training_seq_len / runner-auto-clean
3s
L2_Megatron_BART_Pretraining_and_Resume_Training_TP2 / runner-auto-clean
3s
L2_Megatron_BART_Pretraining_and_Resume_Training_TP2 / main
2m 6s
L2_Megatron_Change_Partitions_Increase_TP_Num_Partitions_-2_to_4-_and_PP_Num_Partitions_-1_to_2 / runner-auto-clean
3s
L2_Megatron_Change_Partitions_Increase_TP_Num_Partitions_-2_to_4-_and_PP_Num_Partitions_-1_to_2 / main
43s
L2_Megatron_Change_Partitions_Reduce_TP_Num_Partitions_-2_to_1-_and_PP_Num_Partitions_-1_to_2 / main
45s
L2_Megatron_Change_Partitions_Reduce_TP_Num_Partitions_-2_to_1-_and_PP_Num_Partitions_-1_to_2 / runner-auto-clean
3s
L2_Megatron_Core_T5_Eval / runner-auto-clean
3s
L2_Megatron_Core_T5_Eval / main
1m 10s
L2_Megatron_Core_T5_Pretraining_and_Resume_Training_TP2 / runner-auto-clean
3s
L2_Megatron_Core_T5_Pretraining_and_Resume_Training_TP2 / main
1m 38s
L2_Megatron_T5_Eval / main
54s
L2_Megatron_T5_Eval / runner-auto-clean
3s
L2_Megatron_T5_Pretraining_and_Resume_Training_PP2 / main
1m 28s
L2_Megatron_T5_Pretraining_and_Resume_Training_PP2 / runner-auto-clean
3s
L2_Megatron_T5_Pretraining_and_Resume_Training_TP2 / runner-auto-clean
3s
L2_Megatron_T5_Pretraining_and_Resume_Training_TP2 / main
2m 9s
L2_Megatron_T5_with_ALiBi_Pretraining_and_Resume_Training_TP2 / main
1m 27s
L2_Megatron_T5_with_ALiBi_Pretraining_and_Resume_Training_TP2 / runner-auto-clean
3s
L2_Megatron_T5_w_Mixture_of_Expert_Pretraining / runner-auto-clean
3s
L2_Megatron_T5_with_KERPLE_Pretraining_and_Resume_Training_TP2 / main
2m 8s
L2_Megatron_T5_with_KERPLE_Pretraining_and_Resume_Training_TP2 / runner-auto-clean
2s
L2_Megatron_T5_w_Mixture_of_Expert_Pretraining / main
51s
L2_Megatron_UL2_Pretraining_and_Resume_Training_TP2 / runner-auto-clean
3s
L2_Megatron_UL2_Pretraining_and_Resume_Training_TP2 / main
2m 18s
L2_Megatron_BART_Pretraining_and_Resume_Training_PP2 / main
1m 34s
L2_Megatron_BART_Pretraining_and_Resume_Training_PP2 / runner-auto-clean
3s
L2_Megatron_Core_T5_PEFT_Lora_TP2 / main
3m 35s
L2_Megatron_Core_T5_PEFT_Lora_TP2 / runner-auto-clean
3s
L2_Megatron_Mock_Data_Generation_MockGPTDataset / main
2m 17s
L2_Megatron_Mock_Data_Generation_MockGPTDataset / runner-auto-clean
2s
L2_Megatron_Mock_Data_Generation_MockT5Dataset / main
36s
L2_Megatron_Mock_Data_Generation_MockT5Dataset / runner-auto-clean
3s
L2_Megatron_T5_PEFT_Lora_TP2 / main
1m 32s
L2_Megatron_T5_PEFT_Lora_TP2 / runner-auto-clean
4s
L2_Stable_Diffusion_Training / main
3m 52s
L2_Stable_Diffusion_Training / runner-auto-clean
3s
L2_TTS_Fast_dev_runs_1_FastPitch / main
1m 14s
L2_TTS_Fast_dev_runs_1_FastPitch / runner-auto-clean
2s
L2_TTS_Fast_dev_runs_1_Hifigan / runner-auto-clean
3s
L2_TTS_Fast_dev_runs_1_Mixer-TTS / main
47s
L2_TTS_Fast_dev_runs_1_Mixer-TTS / runner-auto-clean
3s
L2_TTS_Fast_dev_runs_1_Hifigan / main
58s
L2_TTS_Fast_dev_runs_1_Tacotron_2 / main
46s
L2_TTS_Fast_dev_runs_1_Tacotron_2 / runner-auto-clean
3s
L2_TTS_Fast_dev_runs_1_WaveGlow / runner-auto-clean
3s
L2_TTS_Fast_dev_runs_1_WaveGlow / main
33s
Speech_Checkpoints_tests / main
5m 5s
Speech_Checkpoints_tests / runner-auto-clean
3s
Nemo_CICD_Test
4s
4h 10m 39s