Fireworks AI is a platform for hosting and running machine learning (ML) models with a cloud API, without having to manage your own infrastructure. Sign up for an account at Fireworks and get an API key, which you'll need for this project.
This repository showcases a simple Streamlit app for running the following open-source text and image generation models on Fireworks AI:
- Text: Meta Llama 3 70B Instruct
- Text: Google Gemma 2 9B Instruct
- Text: Mixtral MoE 8x7B Instruct
- Text: 01 Yi Large
- Image: Stable Diffusion XL
For a detailed guide, see this post. To deploy on Railway using a one-click template, click the button below.
