Skip to content

Commit

Permalink
minor fix
Browse files Browse the repository at this point in the history
Signed-off-by: Huiying Li <[email protected]>
  • Loading branch information
HuiyingLi committed Oct 30, 2024
1 parent 62ee0cb commit 4f22933
Showing 1 changed file with 0 additions and 1 deletion.
1 change: 0 additions & 1 deletion scripts/checkpoint_converters/convert_nemo1_to_nemo2.py
Original file line number Diff line number Diff line change
Expand Up @@ -128,7 +128,6 @@ def get_tokenizer(input_path: Path, tokenizer_tmp_dir: Path) -> AutoTokenizer:


def main() -> None:
args = get_args()
tokenizer_tmp_dir = Path("/tmp/nemo_tokenizer")
tokenizer_tmp_dir.mkdir(parents=True, exist_ok=True)
tokenizer = get_tokenizer(Path(args.input_path), tokenizer_tmp_dir)
Expand Down

0 comments on commit 4f22933

Please sign in to comment.