Tokenizer: add_prefix_space shouldn't affect self.use_bos
#216
| Job | Run time |
|---|---|
| 17s | |
| 17s |
add_prefix_space shouldn't affect self.use_bos
#216
| Job | Run time |
|---|---|
| 17s | |
| 17s |