Expose Encoder and Decoder in TiktokenTokenizer#7314

Draft

razshare wants to merge 2 commits intodotnet:mainfrom razshare:main

+5-5

Commits on Nov 15, 2024

Expose Encoder and Decoder properties in TiktokenTokenizer
razshare
committed
Fixing TiktokenTests to use the public properties Encoder and Decoder isntead of using reflection
razshare
committed