Roadmap

2021

Reports

• Dataset Profiling
• [backlog] Historical Drift
• advanced configurations

Algorithms & Stats

• Regression Performance: segments of underperformance
• Anderson-Darling test for Data and Target Drift
• Barnard's exact test for Data and Target Drift
• Target Drift Analysis: add Kendall and Spearman correlation
• [backlog] "Small Dataset" option for reports
• [backlog] "Big Dataset" option for reports

Examples & Tutorials

• Update all the examples & tutorials with readme
• Update the structure of examples folder

Monitoring

• metrics calculation logic for Production Data Stream
• Grafana: Data Drift Dashboard
• Grafana: Numerical Target Drift Dashboard
• Grafana: Regression Performance Dashboard
• Grafana: Categorical Target Drift Dashboard
• Grafana: Classification Performance Dashboard
• Grafana: Probabilistic Classification Performance Dashboard

Evidently Community

• evidently_community repo for custom reports
• evidently_community contributor Guide
• tests for evidently_community project

Environments

• interactive reports in pylab
• interactive reports in google colaboratory notebooks
• interactive reports in kaggle notebooks

User Interface

• reduce HTML reports size (at least twice, better more)
• UI configuration (color-schema change, etc)
• color-blind mode for reports
• fix UI building issues

[backlog] Run App

• run evidently dashboards from terminal in a "service" mode
• host it somewhere

Testing, CI/CD

• python unit tests for analyzers
• python unit tests for widgets
• python unit tests for dashboard
• automation of running selected examples as a test
• package deployment

Documentation & Repo

• Developer's guide
• Contributor's guide
• Release notes
• Good first issues, issue templates