Assets/Accelerators for Watson NLP (this repo) contains self-serve notebooks and documentation on how to create NLP models using Watson NLP library, how to serve Watson NLP models, and how to make inference requests from custom applications. With an IBM Cloud account a full production sample can be deployed in roughly one hour.
Key Technologies:
- IBM Watson NLP (Natural Language Processing) comes with a wide variety of text processing capabilities, such as emotion analysis and topic modeling. Watson NLP is built on top of the best AI open source software. It provides stable and supported interfaces, it handles a wide range of languages and its quality is enterprise proven. The Watson NLP containers can be deployed with Docker, on various Kubernetes-based platforms, or using cloud-based container services.
Machine Learning notebooks, tutorials, and datasets focused on supporting a Data Science Engineer are under the ML folder. Assets focused on deployment are under the MLOps folder. Go to the respective folders to learn more about these assets.
- ML Assets
- Emotion Classification
- Entities & Keywords Extraction
- Sentiment Analysis
- Text Classification
- Topic Modeling
- Topic Modeling Tutorial
- Topic Modeling Notebook
- Topic Modeling Comparison with LDA Notebook
- PII Extraction - Custom Train Models.ipynb -PII Extraction
- PII Extraction - Custom-RBR Models.ipynb
- PII Extraction - Pre-Trained Models.ipynb
- PII Extraction - Fine-Tuned Models.ipynb
- MLOps Assets
- Serve Pretrained Models using Docker
- Serve Custom Models using Docker
- Serve Models with Standalone Containers on Kubernetes or OpenShift
- Serve Models with AWS Fargate
- Serve Models with Azure Container Instances
- Serve Models with IBM Code Engine
- Serve Pretrained Models on Kubernetes or OpenShift
- Serve Custom Models with Kubernetes or OpenShift
- Serve Models with KServe ModelMesh
- Create an NLP Python Client
- IBM Watson NLP Library for Embed
- IBM Technology Zone assets
- Embeddable AI
- Watson NLP - Text Classification
- Watson NLP - Entities & Keywords extraction
- Watson NLP - Topic Modeling
- Watson NLP - Sentiment and Emotion Analysis
- Watson NLP - Creating Client Applications
- Watson NLP - Serving Models with Standalone Containers
- Watson NLP - Serving Models with Kubernetes and OpenShift
- IBM Developer Tutorials
Created & Architected By
Kunal Sawarkar, Chief Data Scientist
Builders
Michael Spriggs, Principal Architect Shivam Solanki, Senior Advisory Data Scientist Kevin Huang, Sr. ML-Ops Engineer Abhilasha Mangal, Senior Data Scientist Himadri Talukder - Senior Software Engineer
Disclaimer
This framework is developed by Build Lab, IBM Ecosystem. Please note that this content is made available to foster Embeddable AI technology adoption and serve ecosystem partners. The content may include systems & methods pending patent with the USPTO and protected under US Patent Laws. SuperKnowa is not a product but a framework built on the top of IBM watsonx along with other products like LLAMA models from Meta & ML Flow from Databricks. Using SuperKnowa implicitly requires agreeing to the Terms and conditions of those products. This framework is made available on an as-is basis to accelerate Enterprise GenAI applications development. In case of any questions, please reach out to [email protected].
Copyright @ 2023 IBM Corporation.