Skip to content

Commit

Permalink
Apply isort and black reformatting
Browse files Browse the repository at this point in the history
Signed-off-by: hemildesai <[email protected]>
  • Loading branch information
hemildesai committed Jul 18, 2024
1 parent 781c999 commit 6306228
Showing 1 changed file with 1 addition and 0 deletions.
1 change: 1 addition & 0 deletions nemo/collections/llm/gpt/model/base.py
Original file line number Diff line number Diff line change
Expand Up @@ -28,6 +28,7 @@
TRAIN_LOSS_REDUCTION = MaskedTokenLossReduction()
VALIDATION_LOSS_REDUCTION = MaskedTokenLossReduction(validation_step=True)


def gpt_data_step(dataloader_iter) -> Dict[str, torch.Tensor]:
from megatron.core import parallel_state

Expand Down

0 comments on commit 6306228

Please sign in to comment.