Skip to content

Commit

Permalink
feat: Update set up for Milvus database and add link to RAG notebook. (
Browse files Browse the repository at this point in the history
…#1231)

I was asked to update the database set up based on [Mivus
article](https://milvus.io/docs/apify_milvus_rag.md#Set-up-MilvusZilliz-URI-token-and-collection-name)
I also added a notebook for complete RAG
  • Loading branch information
jirispilka authored Oct 7, 2024
1 parent 54cd84c commit eb7a498
Showing 1 changed file with 9 additions and 4 deletions.
13 changes: 9 additions & 4 deletions sources/platform/integrations/ai/milvus.md
Original file line number Diff line number Diff line change
Expand Up @@ -22,17 +22,20 @@ It can also be connected to a managed Milvus instance on [Zilliz Cloud](https://

Before you begin, ensure that you have the following:

- A Milvus database universal resource identifier (URI) and API token. Optionally, you can use a username and password in the URI. You can run Milvus on Docker or Kubernetes, but in this example, we'll use the hosted Milvus service at [Zilliz Cloud](https://cloud.zilliz.com).
- A Milvus/Zilliz database universal resource identifier (URI) and Token to setup the client. Optionally, you can use a username and password in the URI. You can run Milvus on Docker or Kubernetes, but in this example, we'll use the hosted Milvus service at [Zilliz Cloud](https://cloud.zilliz.com).
- An [OpenAI API key](https://openai.com/index/openai-api/) to compute text embeddings.
- An [Apify API token](https://docs.apify.com/platform/integrations/api#api-token) to access [Apify Actors](https://apify.com/store).

### How to set up Milvus database
### How to set up Milvus/Zilliz database

1. Sign up or log in to your Zilliz account and create a new cluster.

1. Download the created credentials: user name and password.
1. Find the `uri` and `token`, which correspond to the [Public Endpoint and API key](https://docs.zilliz.com/docs/on-zilliz-cloud-console#cluster-details) in Zilliz Cloud.

Once the cluster is ready and you have the URL, API key, and credentials, you can set up the integration with Apify.
Note that the collection does not need to exist beforehand.
It will be automatically created when data is uploaded to the database.

Once the cluster is ready, and you have the `URI` and `Token`, you can set up the integration with Apify.


### Integration Methods
Expand Down Expand Up @@ -107,8 +110,10 @@ Another way to interact with Milvus is through the [Apify Python SDK](https://do
```

Congratulations! You've successfully integrated Apify with Milvus, and the scraped data is now stored in your Milvus database.
For a complete example of Retrieval-Augmented Generation (RAG), check out the Additional Resources below.

## Additional Resources

- [Apify Milvus Integration](https://apify.com/apify/milvus-integration)
- [Milvus documentation](https://milvus.io/docs)
- [Retrieval-Augmented Generation: Crawling Websites with Apify and Saving Data to Milvus for Question Answering](https://milvus.io/docs/apify_milvus_rag.md)

0 comments on commit eb7a498

Please sign in to comment.