Skip to content

Commit

Permalink
Fix listify bug
Browse files Browse the repository at this point in the history
  • Loading branch information
BramVanroy authored Sep 29, 2024
1 parent c7f6f51 commit f122941
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion src/datatrove/pipeline/filters/language_filter.py
Original file line number Diff line number Diff line change
Expand Up @@ -33,7 +33,7 @@ def __init__(
super().__init__(exclusion_writer)
self.language_threshold = language_threshold
if isinstance(languages, str):
languages = list(languages)
languages = [languages]
self.languages = languages
self.backend = backend
self.model = FT176LID(languages) if backend == "ft176" else GlotLID(languages)
Expand Down

0 comments on commit f122941

Please sign in to comment.