Skip to content

Commit

Permalink
Merge branch 'ashors/nemo-ux-drop-optim-states-async' of github.com:N…
Browse files Browse the repository at this point in the history
…VIDIA/NeMo into ashors/nemo-ux-drop-optim-states-async
  • Loading branch information
ashors1 committed Dec 2, 2024
2 parents f1c352a + ee523a3 commit 30954ab
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion nemo/lightning/io/pl.py
Original file line number Diff line number Diff line change
Expand Up @@ -307,7 +307,7 @@ def drop_optimizer_states(self, path):
from megatron.core import dist_checkpointing

dist_checkpointing.remove_sharded_tensors(path, key_prefix="optimizer")

def adjust_non_strict_load(self, path: _PATH, sharded_state_dict: Dict[str, Any]):
from megatron.core import dist_checkpointing
from megatron.core.dist_checkpointing.dict_utils import extract_matching_values
Expand Down

0 comments on commit 30954ab

Please sign in to comment.