Skip to content

Commit

Permalink
Add MLObs onboarding docs to gitbook (#538)
Browse files Browse the repository at this point in the history
<!--  Thanks for sending a pull request!  Here are some tips for you:

1. Run unit tests and ensure that they are passing
2. If your change introduces any API changes, make sure to update the
e2e tests
3. Make sure documentation is updated for your PR!

-->
# Description
Adding gitbook reference to the MLobs related documentation, including
the model schema and the mlobs onboarding guide.

# Modifications
Add gitbook summary reference for new docs, fixed one heading typo in
mlobs onboarding guide.

# Tests

-->

# Checklist
- [ ] Added PR label
- [ ] Added unit test, integration, and/or e2e tests
- [ ] Tested locally
- [ ] Updated documentation
- [ ] Update Swagger spec if the PR introduce API changes
- [ ] Regenerated Golang and Python client if the PR introduces API
changes

# Release Notes
<!--
Does this PR introduce a user-facing change?
If no, just write "NONE" in the release-note block below.
If yes, a release note is required. Enter your extended release note in
the block below.
If the PR requires additional action from users switching to the new
release, include the string "action required".

For more information about release notes, see kubernetes' guide here:
http://git.k8s.io/community/contributors/guide/release-notes.md
-->

```release-note

```
  • Loading branch information
eric-lidong authored and leonlnj committed Feb 20, 2024
1 parent 38aa7c9 commit 98b0dd6
Show file tree
Hide file tree
Showing 2 changed files with 5 additions and 3 deletions.
3 changes: 3 additions & 0 deletions docs/SUMMARY.md
Original file line number Diff line number Diff line change
Expand Up @@ -21,13 +21,16 @@
* [Deleting a Model](/user/generated/04_deleting_a_model.md)
* [Configuring Alerts](/user/generated/05_configuring_alerts.md)
* [Batch Prediction](/user/generated/06_batch_prediction.md)
* [Model Schema](/user/generated/10_model_schema.md)
* [Model Observability](/user/generated/11_model_observability.md)
* [Model Sample Notebooks](/user/generated/07_examples.md)
* [Deploy Standard Models](/user/generated/examples/01_standard_model.md)
* [Deploy PyFunc Model](/user/generated/examples/02_pyfunc_model.md)
* [Using Transformers](/user/generated/examples/03_transformer.md)
* [Run Batch Prediction Job](/user/generated/examples/04_batch_prediction.md)
* [Others examples on Models](/user/generated/examples/05_others.md)
* [Limitations](/user/generated/08_limitations.md)
* [Troubleshooting Deployment Errors](/user/generated/09_troubleshooting_deployment_errors.md)

## Developer Guides

Expand Down
5 changes: 2 additions & 3 deletions docs/user/generated/11_model_observability.md
Original file line number Diff line number Diff line change
Expand Up @@ -19,7 +19,7 @@ From above architecture diagram, we can see that there are three places where th
## Onboarding
As the architecture diagram illustrate, the end to end model onboarding to model observability needs to involving several components. The scope of this section is limited to merlin model modification.

### ### PyFunc modification
### PyFunc modification
Currently the only supported model for model observability is PyFunc model, the model should implements class `PyFuncV3Model` instead of `PyFuncModel`. This `PyFuncV3Model` has difference method signature that must be implemented. Following are the new methods:
| Method Name | Description |
|-------------|-------------|
Expand All @@ -45,8 +45,7 @@ Beside changes in signature, you can see some of those methods returning new typ
Same like `ModelInput`, `ModelOutput` is also essential for model observability, it can be used to calculate prediction drift but more importantly it can calculate performance metrics.

### Configure Model Schema

Model schema is essential for model observability because it is used by the kafka consumer to choose which columns that is relevant to model observability and do necessary preprocessing before publishing the data to model observability system. Users can see more detail of configuring model schema [here](../templates/09_model_schema.md)
Model schema is essential for model observability because it is used by the kafka consumer to choose which columns that is relevant to model observability and do necessary preprocessing before publishing the data to model observability system. Users can see more detail of configuring model schema [here](../generated/10_model_schema.md)

### Deployment
There is not much change on the deployment part, users just needs to set `enable_model_observability` parameter to `True` during model deploy. For clarity, we take one use case for model observability example, suppose a model has 4 features:
Expand Down

0 comments on commit 98b0dd6

Please sign in to comment.