Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update README with proper naming #1029

Merged
merged 2 commits into from
May 3, 2024
Merged

Update README with proper naming #1029

Changes from 1 commit
Commits
Show all changes
2 commits
Select commit Hold shift + click to select a range
0b1b941
Update README.md
slemeur May 2, 2024
da7e477
Update README.md
benoitf May 2, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
19 changes: 9 additions & 10 deletions README.md
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,7 +1,6 @@
# AI Lab

The Podman Desktop AI Lab extension simplifies getting started and developing with AI in a local environment. It provides key open-source technologies to start building on AI. A curated catalog of so-called recipes helps navigate the jungle of AI use cases and AI models. AI Lab further ships playgrounds: environments to experiment with and test AI models, for instance, a chat bot.
# Podman AI Lab

odman AI Lab is an open source extension for Podman Desktop to work with LLMs (Large Language Models) on a local environment. Featuring a recipe catalog with common AI use cases, a curated set of open source models, and a playground for learning, prototyping and experimentation, Podman AI Lab helps you to quickly and easily get started bringing AI into your applications, without depending on infrastructure beyond your laptop ensuring data privacy and security.

benoitf marked this conversation as resolved.
Show resolved Hide resolved

## Topics
Expand All @@ -17,14 +16,14 @@ The Podman Desktop AI Lab extension simplifies getting started and developing wi

## Technology

The AI Lab extensions uses [Podman](https://podman.io) machines to run inference servers for LLM models and AI applications.
Podman AI Lab uses [Podman](https://podman.io) machines to run inference servers for LLM models and AI applications.
The AI models can be downloaded, and common formats like [GGUF](https://github.com/ggerganov/ggml/blob/master/docs/gguf.md), [Pytorch](https://pytorch.org) or [Tensorflow](https://www.tensorflow.org) are supported.

## Extension features

### AI Models

AI Lab provides a curated list of open source AI models and LLMs. Once downloaded, the models are available to be used for AI applications, model services and playgrounds.
Podman AI Lab provides a curated list of open source AI models and LLMs. Once downloaded, the models are available to be used for AI applications, model services and playgrounds.

#### Model services

Expand All @@ -36,9 +35,9 @@ The integrated Playground environments allow for experimenting with available mo

### AI applications

Once an AI model is available through a well known endpoint, it's easy to imagine a new world of applications that will connect and use the AI model. AI Lab support AI applications as a set of containers that are connected together.
Once an AI model is available through a well known endpoint, it's easy to imagine a new world of applications that will connect and use the AI model. Podman AI Lab supports AI applications as a set of containers that are connected together.

AI Lab ships with a so-called Recipes Catalog that helps you navigate a number of core AI use cases and problem domains such as Chat Bots, Code Generators and Text Summarizers. Each recipe comes with detailed explanations and sample applications that can be run with various large language models (LLMs). Experimenting with multiple models allows finding the optimal one for your use case.
Podman AI Lab ships with a so-called Recipes Catalog that helps you navigate a number of core AI use cases and problem domains such as Chat Bots, Code Generators and Text Summarizers. Each recipe comes with detailed explanations and sample applications that can be run with various large language models (LLMs). Experimenting with multiple models allows finding the optimal one for your use case.

## Requirements

Expand Down Expand Up @@ -69,7 +68,7 @@ Please note that this is not relevant for WSL on Windows as the WSL technology t

You can install the Podman AI Lab extension directly inside of Podman Desktop.

Go to Extensions > Catalog > Install Podman Desktop AI Lab.
Go to Extensions > Catalog > Install Podman AI Lab.

![](https://github.com/containers/podman-desktop-media/raw/ai-lab/gifs/install_ai_lab.gif)

Expand Down Expand Up @@ -103,7 +102,7 @@ Once a model is available locally, let's start an inference server

## Contributing

Want to help develop and contribute to the AI Lab extension?
Want to help develop and contribute to Podman AI Lab?

You can use `yarn watch --extension-folder` from the Podman Desktop directory to automatically rebuild and test the AI Lab extension:

Expand All @@ -125,7 +124,7 @@ $ yarn watch

### Cleaning up resources

We'll be adding a way in AI Lab to let a user cleanup the environment: see issue https://github.com/containers/podman-desktop-extension-ai-lab/issues/469.
We'll be adding a way to let a user cleanup their environment: see issue https://github.com/containers/podman-desktop-extension-ai-lab/issues/469.
For the time being, please consider the following actions:
1. Remove the extension from Podman Desktop, from the Settings > Extensions
2. Remove the running playground environments from the list of Pods
Expand Down
Loading