v0.2.2

What's Changed

• remove misc files and style by @Saibo-creator in #19
• Hotfix v0.2.0 by @Saibo-creator in #20
• raise error when unicode mode used with model other than GPT2 by @Saibo-creator in #22
• Smiles chemical by @Saibo-creator in #23
• Dev by @Saibo-creator in #25
• Cal flow by @arinaruck in #26
• Adding pddl grammars by @arinaruck in #28
• Update logits_process.py by returning a modified copy of a logit tensor by @Saibo-creator in #27
• add accept.py in example, which are used to check if a sentence is accepted by a grammar by @Saibo-creator in #33
• Fix bug in parsing hex char escapes by @RadixSeven in #36
• add metrics to measure probability gain from constrained generation by @Saibo-creator in #38
• Fix unicode error by @Saibo-creator in #42
• Unicode escaping by @Saibo-creator in #39
• Benchmarking by @arinaruck in #41
• Update vocab_struct.py to fix llama3 tokenizer by @Saibo-creator in #44
• Update logging_config.py by @Saibo-creator in #51
• Custom json grammars by @arinaruck in #45
• Pipeline example by @arinaruck in #43
• fix: update func api in debugging_custom_grammar.md by @Saibo-creator in #56
• Refactor tokenization interface by @Saibo-creator in #65
• Add support phi,bart, t5, mistral by @Saibo-creator in #66
• Check for presence of pretokenizers key when checking model type by @MatthewChang in #61
• Add support phi bart t5 by @Saibo-creator in #68
• Add Meta-Llama-3 tokenizer support, enhance token handling and refactor tests structure by @Saibo-creator in #70
• Update latest news in README by @Saibo-creator in #71
• Add support for DeepSeek by @Saibo-creator in #73
• Add Support to Gemma2 by @fillassuncao in #75
• Update README and requirements: by @Saibo-creator in #77

New Contributors

• @arinaruck made their first contribution in #26
• @RadixSeven made their first contribution in #36
• @MatthewChang made their first contribution in #61
• @fillassuncao made their first contribution in #75

Full Changelog: v0.2.0...v0.2.1

What's Changed

• add GitHub Actions workflow for PyPI releases by @Saibo-creator in #78

Full Changelog: v0.2.1...v0.2.2