Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Adding additional Service Providers via Amazon Bedrock #739

Open
1 task done
jeffpaul opened this issue Mar 5, 2024 · 3 comments
Open
1 task done

Adding additional Service Providers via Amazon Bedrock #739

jeffpaul opened this issue Mar 5, 2024 · 3 comments
Labels
type:enhancement New feature or request.

Comments

@jeffpaul
Copy link
Member

jeffpaul commented Mar 5, 2024

Is your enhancement related to a problem? Please describe.

Amazon Bedrock is a fully managed service that offers a choice of high-performing foundation models from leading AI companies, along with a broad set of capabilities to build generative AI applications, simplifying development while maintaining privacy and security.
source

Our 3.0.0 release made it easier to integrate additional Service Providers to ClassifAI's features. Leveraging something like Amazon Bedrock might make it additionally easier to add in other service providers to make ClassifAI's features less dependent on a specific provider and allow ClassifAI users the ability to swap in/out providers on a whim to test which best fits their needs.

Additional models available that can help with text generation, text summarization, image generation, image text abstraction, and content moderation:

Designs

No response

Describe alternatives you've considered

No response

Code of Conduct

  • I agree to follow this project's Code of Conduct
@jeffpaul jeffpaul added the type:enhancement New feature or request. label Mar 5, 2024
@jeffpaul jeffpaul added this to the Future Release milestone Mar 5, 2024
@jeffpaul jeffpaul moved this from Incoming to Backlog in Open Source Practice Mar 5, 2024
@iamdharmesh
Copy link
Member

I gave a quick look to Anthropic's Claude and it looks promising.

API Docs: https://docs.anthropic.com/claude/reference/getting-started-with-the-api

@faisal-alvi
Copy link
Member

Amazon Bedrock is a service that offers models, should we leverage the service or add providers separately? Like we have an API available for Anthropic as suggested^ by @iamdharmesh cc: @dkotter

@dkotter
Copy link
Collaborator

dkotter commented Mar 27, 2024

I think there's value in both approaches, similar to how we have a direct integration with OpenAI and an integration with Azure OpenAI.

Seems this issue though is specific to adding support for Amazon Bedrock and allowing users to choose which model they want to use on that service (assuming that's possible and we don't need specific integrations for each model)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
type:enhancement New feature or request.
Projects
Status: Backlog
Development

No branches or pull requests

4 participants