Skip to content

Commit

Permalink
Cleanup
Browse files Browse the repository at this point in the history
  • Loading branch information
vasunvidia committed Apr 15, 2024
1 parent c3c397c commit 3fb59ec
Showing 1 changed file with 1 addition and 0 deletions.
1 change: 1 addition & 0 deletions nemo/core/optim/distributed_adam.py
Original file line number Diff line number Diff line change
Expand Up @@ -481,6 +481,7 @@ def _param_copy_fragments(self, fragments: Iterable[DistributedFusedAdam.Paramet
_multi_tensor_copy(
buffers_in, buffers_out, dummy_overflow_buf=self._dummy_overflow_buf,
)

# Update transpose caches
params = set(self.parameter(fragment) for fragment in fragments)
for param in params:
Expand Down

0 comments on commit 3fb59ec

Please sign in to comment.