Tokenizer: add_prefix_space shouldn't affect self.use_bos (#1328)
#217
| Job | Run time |
|---|---|
| 16s | |
| 16s |
add_prefix_space shouldn't affect self.use_bos (#1328)
#217
| Job | Run time |
|---|---|
| 16s | |
| 16s |