Update README to include new option --character-offsets

tsproisl · Dec 22, 2023 · 3eb5247 · 3eb5247
1 parent 7531745
commit 3eb5247
Showing 1 changed file with 1 addition and 0 deletions.
diff --git a/README.md b/README.md
@@ -179,6 +179,7 @@ options:
                         SpaceAfter=No if the token was not followed by a space
                         and OriginalSpelling="…" if the token contained
                         whitespace.
+  --character-offsets   Output character offsets in the input for each token.
   --parallel N          Run N worker processes (up to the number of CPUs) to
                         speed up tokenization.
   -v, --version         Output version information and exit.