Skip to content

v0.0.2 Settings Enhancements

Compare
Choose a tag to compare
@mdegans mdegans released this 26 May 05:19
· 2 commits to main since this release
30e5317

This release exposes settings for drama_llama and fixes some crashes.

  • (almost all) drama_llama settings are available in the settings tab. This includes the ability to mix and match any combination of sampling methods to your liking, N-gram based repetition penalties (not just unigrams). Left to add are: A UI for custom stop criteria as well as ignored n-grams for the purpose of repetition penalty. That will come next release. If you need custom stop strings, you can use the previous release to add them. The settings are backwards and forwards compatible. It was removed because I simply didn't have time to add them to drama_llama today.
  • Fixed some crashes in the drama_llama sampling code.
  • Improved defaults for OpenAI