The SAP Federated ML Python libraries (FedML) applies the Data Federation architecture of SAP Datasphere for intelligently sourcing SAP as well as non-SAP data for Machine Learning experiments done at the Hyperscalers thereby removing the need for replicating or moving data. By abstracting the Data Connection, Data load, and Model training (with flexibility and provision for user provided training scripts), Model Deployment, and Inferencing for Hyperscaler Machine learning processes , the FedML library provides end to end integration with few lines of code .
Here are some high level major feature additions in Version 2.0 of FedML:
- FedML is now pip installable from PyPi repo.
- Support for deployment to hyperscaler environment.
- Support for deployment to SAP Business Technology Platform Kyma environment.
- Support for inferencing with hyperscaler deployed as well as Kyma deployed models.
- Support for writing inferenced results back to SAP Datasphere.
-
SAP Datasphere tenant instance, with connectivity established to the remote data sources, and views exposed, that can be consumed by FedML.
-
Access to corresponding Hyperscaler Machine learning environments with approriate configurations. See Configuration section.
-
Try out examples from the samples-notebooks directory of corresponding Hyperscaler library
-
For setting up the remote models in SAP Datasphere to federate data from hyperscaler data stores for use with FedML , here are some Discovery Mission examples :
- Integrating Amazon Athena and SAP Datasphere
- Integrating Google Big Query and SAP Datasphere
- Integrating Azure Data Explorer and SAP Datasphere
- For AWS FedML library specific pre-requisites, configuration and documentation, please refer here
- For GCP FedML library specific pre-requisites, configuration and documentation, please refer here
- For Azure FedML library specific pre-requisites, configuration and documentation, please refer here
- For Databricks FedML library specific pre-requisites, configuration and documentation, please refer here
None
This project is provided "as-is" with no expectation for major changes or support.
Create an issue in this repository if you find a bug or have questions about the content.
For additional support, ask a question in SAP Community.
Copyright (c) 2021 SAP SE or an SAP affiliate company. All rights reserved. This project is licensed under the Apache Software License, version 2.0 except as noted otherwise in the LICENSE file.