v0.0.2 Settings Enhancements
This release exposes settings for drama_llama
and fixes some crashes.
- (almost all)
drama_llama
settings are available in the settings tab. This includes the ability to mix and match any combination of sampling methods to your liking, N-gram based repetition penalties (not just unigrams). Left to add are: A UI for custom stop criteria as well as ignored n-grams for the purpose of repetition penalty. That will come next release. If you need custom stop strings, you can use the previous release to add them. The settings are backwards and forwards compatible. It was removed because I simply didn't have time to add them todrama_llama
today. - Fixed some crashes in the
drama_llama
sampling code. - Improved defaults for OpenAI