v0.0.34

0.0.34 - September 30, 2024

Caution

This release has breaking changes! Please read the changelog carefully.

Added

• New supported models gemma-2-9b, llama-3.2-1b, and llama-3.2-3b via Groq.

Changed

• In order to be more consistent with l2m2's naming scheme, the following model ids have been updated:
  • llama3-8b → llama-3-8b
  • llama3-70b → llama-3-70b
  • llama3.1-8b → llama-3.1-8b
  • llama3.1-70b → llama-3.1-70b
  • llama3.1-405b → llama-3.1-405b
• This is a breaking change!!! Calls using the old model_ids (llama3-8b, etc.) will fail.

Removed

• Provider octoai has been removed as they have been acquired and are shutting down their cloud platform. This is a breaking change!!! Calls using the octoai provider will fail.
  • All previous OctoAI supported models (mixtral-8x22b, mixtral-8x7b, mistral-7b, llama-3-70b, llama-3.1-8b, llama-3.1-70b, and llama-3.1-405b) are still available via Mistral, Groq, and/or Replicate.