Skip to content

Issues: microsoft/BlingFire

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

38 Open 31 Closed
38 Open 31 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

In some cases, blingfire models created with the new vocab.txt produce different results.
#181 opened Nov 9, 2024 by springkim
Loading the bert_base_tok.bin model sometimes throws an exception
#178 opened Aug 30, 2023 by jw444
c# example negative offset for Starts
#177 opened Jul 19, 2023 by dbalikhin
Build_Dll_For_Linux_ARM64 job fails
#176 opened Jul 12, 2023 by Miloslav
Support for CLIP tokenizers from Hugging Face
#173 opened Jun 5, 2023 by dkalinowski
Import issue on MacOS M1
#171 opened May 12, 2023 by dariolamaj
6
/O2 in CMakeLists.txt is incompatible with vcpkg using Ninja
#170 opened May 8, 2023 by davidmatson
Unable to Modify Tokenization Logic
#169 opened May 1, 2023 by Andrew03
Issues building on Mac OSX M2
#168 opened Apr 27, 2023 by Kevdome3000
1
"terminate called after throwing an instance of 'std::runtime_error'"
#166 opened Apr 14, 2023 by michieal
1
BlingFire fails with all-lowercase text
#165 opened Apr 12, 2023 by mhillebrand
Add xlm-roberta-large tokenization support
#158 opened Nov 17, 2022 by palenshus
Could java call the tokenizer of bin file
#157 opened Nov 14, 2022 by MichaleDong
Missing vcruntime140.dll and vcruntime140_1.dll dependencies
#156 opened Aug 19, 2022 by Joshua-Palamuttam
4
Missing numpy dependency on setup.py
#155 opened Aug 18, 2022 by combacsa
How to create i2w model
#154 opened Aug 9, 2022 by MikiHunnter2
1
what is the last char of the last word from GetWords?
#150 opened Jun 22, 2022 by tiagu-sh
M2M100 Marianmt tokenizers
#145 opened Apr 12, 2022 by RaulRoPer
Trouble installing for custom model creation
#144 opened Mar 29, 2022 by Darth-Carrotpie
2
Byte offsets for original input bytes to allow non-destructive tokenization
#143 opened Mar 15, 2022 by ELind77
Sentence boundary for other languages
#141 opened Feb 24, 2022 by mmehdig
libblingfiretokdll.dylib arm64e support
#140 opened Jan 26, 2022 by youyinnn
1
Word Tokenization - Unexpected Output
#139 opened Jan 24, 2022 by albertnanda
Invalid parameters error FAMultiMapPack_fixed.cpp
#138 opened Jan 17, 2022 by Kaelorn
Support for ARM64 architecture
#137 opened Dec 7, 2021 by DavidObando
5
ProTip! Follow long discussions with comments:>50.