Skip to content

Commit

Permalink
Merge pull request #79 from dkuroczk/main
Browse files Browse the repository at this point in the history
feat: add Amazon SageMaker backend dokumentation
  • Loading branch information
AlexsJones authored Dec 27, 2023
2 parents 087ae9c + 709c23d commit 6819542
Showing 1 changed file with 20 additions and 2 deletions.
22 changes: 20 additions & 2 deletions docs/reference/providers/backend.md
Original file line number Diff line number Diff line change
Expand Up @@ -2,10 +2,11 @@

A Backend or a Provider is a service that provides access to the AI language model. There are many different backends available for K8sGPT. Each backend has its own strengths and weaknesses, so it is important to choose the one that is right for your needs.

Currently we have a total of 4 backends available:
Currently we have a total of 5 backends available:
- [OpenAI](https://openai.com/)
- [Azure OpenAI](https://azure.microsoft.com/en-us/products/cognitive-services/openai-service)
- [LocalAI](https://github.com/go-skynet/LocalAI)
- [Amazon SageMaker](https://aws.amazon.com/sagemaker/)
- FakeAI

## OpenAI
Expand Down Expand Up @@ -55,9 +56,26 @@ LocalAI is a local model, which is an OpenAI compatible API. It uses llama.cpp a
- Analyze with a LocalAI backend:
```
k8sgpt analyze --explain --backend localai
```
## Amazon SageMaker
The Amazon SageMaker backend allows you to leverage a self-deployed and managed Language Models (LLM) on Amazon SageMaker.
Example how to deploy Amazon SageMaker with cdk is available in [llm-sagemaker-jumpstart-cdk](https://github.com/zaremb/llm-sagemaker-jumpstart-cdk) repo.
- Run the following command to add SageMaker:
```bash
k8sgpt auth add --backend amazonsagemaker --providerRegion eu-west-1 --endpointname endpoint-xxxxxxxxxx
```

- Now you are ready to analyze with the Amazon SageMaker backend:

```bash
k8sgpt analyze --explain --backend amazonsagemaker
```

## FakeAI

FakeAI or the NoOpAiProvider might be useful in situations where you need to test a new feature or simulate the behaviour of an AI based-system without actually invoking it. It can help you with local development, testing and troubleshooting.
Expand Down

0 comments on commit 6819542

Please sign in to comment.