Skip to content

Commit

Permalink
done after hooks
Browse files Browse the repository at this point in the history
  • Loading branch information
Sagi Polaczek committed Dec 18, 2024
1 parent 804c185 commit 85eaee9
Showing 1 changed file with 2 additions and 1 deletion.
3 changes: 2 additions & 1 deletion fuse/data/tokenizers/modular_tokenizer/op.py
Original file line number Diff line number Diff line change
Expand Up @@ -8,11 +8,12 @@
from huggingface_hub import HfApi, snapshot_download
from huggingface_hub.utils import SoftTemporaryDirectory, validate_hf_hub_args

from fuse.data import OpBase, get_sample_id
from fuse.data import OpBase
from fuse.data.tokenizers.modular_tokenizer.inject_utils import (
InjectorToModularTokenizerLib,
)
from fuse.data.tokenizers.modular_tokenizer.modular_tokenizer import ModularTokenizer
from fuse.data.utils.sample import get_sample_id
from fuse.utils import NDict


Expand Down

0 comments on commit 85eaee9

Please sign in to comment.