Skip to content

Commit

Permalink
Add a bunch more infinitives from the list of words reported as being…
Browse files Browse the repository at this point in the history 
… incorrectly tokenized in stanfordnlp/stanza#1401  This does not lower the quality of the Stanza tokenizer, and hopefully helps with its tokenization of words with these lemmas
  • Loading branch information
@AngledLuffa
AngledLuffa committed Jul 21, 2024
1 parent 6d83af4 commit 1fd456c
Show file tree
Hide file tree
Showing 2 changed files with 353 additions and 23 deletions.
Loading

0 comments on commit 1fd456c

Please sign in to comment.