Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix import #9240

Merged
merged 2 commits into from
May 20, 2024
Merged

fix import #9240

Changes from all commits
Commits
Show all changes
2 commits
Select commit Hold shift + click to select a range
f13af5c
fix import
akoumpa May 17, 2024
a1a1f65
Apply isort and black reformatting
akoumpa May 17, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
8 changes: 4 additions & 4 deletions examples/nlp/language_modeling/megatron_lm_ckpt_to_nemo.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -291,9 +291,9 @@ def load_from_checkpoint(
**kwargs,
):
"""
Loads Megatron_LM checkpoints, convert it, with some maintenance of restoration.
For documentation, please refer to LightningModule.load_from_checkpoin() documentation.
"""
Loads Megatron_LM checkpoints, convert it, with some maintenance of restoration.
For documentation, please refer to LightningModule.load_from_checkpoin() documentation.
"""
checkpoint = None
try:
cls._set_model_restore_state(is_being_restored=True)
Expand Down Expand Up @@ -470,7 +470,7 @@ def convert(local_rank, rank, world_size, args):
)
if mcore_output and not args.mcore_input:
# convert from legacy Megatron-LM to MCore NeMo. Initialize an mcore translation dict
from scripts.nlp_language_modeling.convert_nemo_gpt_to_mcore import build_key_mapping
from scripts.checkpoint_converters.convert_gpt_nemo_to_mcore import build_key_mapping

mcore_translate = {}
for k, v in build_key_mapping(model_cfg).items():
Expand Down
Loading