4Paradigm

All

33 repositories

OpenMLDB
Public
OpenMLDB is an open-source machine learning database that provides a feature platform computing consistent features for training and inference.
feature-extraction feature-engineering in-memory-database mlops feature-store featurestore database-for-machine-learning machine-learning-database database-for-ai featureops
C++
•
Apache License 2.0
•322•1.6k•399•18•Updated Dec 20, 2024Dec 20, 2024
zetasql
Public
ZetaSQL - Analyzer Framework for SQL
C++
•
Apache License 2.0
•220•14•0•2•Updated Oct 23, 2024Oct 23, 2024
DemoApps
Public
demo applications that show how to deploy offline feature engineering solutions to online in one minute with fedb and nativespark
machine-learning tensorflow realtime lightgbm sparksql feature-engineering realtime-decision sql
Python
•
Apache License 2.0
•13•35•0•2•Updated Oct 15, 2024Oct 15, 2024
hybridsql-asserts
Public
HybridSQL third-party libraries
Shell
•
Apache License 2.0
•4•3•1•0•Updated Sep 26, 2024Sep 26, 2024
openmldb-exporter
Public
OpenMLDB metric exporter for Prometheus
grafana prometheus prometheus-exporter grafana-dashboard openmldb
Python
•
Apache License 2.0
•1•2•0•11•Updated Sep 11, 2024Sep 11, 2024
spark
Public
This is OpenMLDB's Spark Distribution, which is particularly optimized for feature extraction. It includes a few novel techniques, such as native implementation of last join and multi-window parallelization. Its APIs are fully compatible with the standard Spark. It is designed to be a component of OpenMLDB (https://github.com/4paradigm/OpenMLDB).
spark feature-extraction feature-engineering
Scala
•
Apache License 2.0
•28k•11•1•1•Updated Jul 30, 2024Jul 30, 2024
FeatInsight
Public
FeatInsight is a feature platform based on OpenMLDB
feature-extraction feature feature-store feature-platform
Vue
•
Apache License 2.0
•7•13•24•2•Updated Jul 23, 2024Jul 23, 2024
k8s-vgpu-scheduler
Public
OpenAIOS vGPU device plugin for Kubernetes is originated from the OpenAIOS project to virtualize GPU device memory, in order to allow applications to access larger memory space than its physical capacity. It is designed for ease of use of extended device memory for AI workloads.
Go
•
Apache License 2.0
•94•532•23•1•Updated May 21, 2024May 21, 2024
openmldb-go-sdk
Public
Official OpenMLDB Golang SDK
go sdk openmldb
Go
•
Apache License 2.0
•1•1•4•0•Updated May 19, 2024May 19, 2024
HAMi
Public
Heterogeneous AI Computing Virtualization Middleware
Go
•
Apache License 2.0
•225•1•0•0•Updated May 16, 2024May 16, 2024
OpenMLDBSQLEmulator
Public
Java
•
Apache License 2.0
•2•1•0•0•Updated Apr 24, 2024Apr 24, 2024
openmldb-k8s
Public
This is the tool to support running the OpenMLDB's online engine on Kubernetes
Smarty
•
Apache License 2.0
•3•2•0•0•Updated Feb 29, 2024Feb 29, 2024
OpenEmbedding
Public
OpenEmbedding is an open source framework for Tensorflow distributed training acceleration.
tensorflow-training parameter-server distributed-training model-parallel embedding-layers tensorflow
C++
•
Apache License 2.0
•7•31•0•0•Updated Apr 13, 2023Apr 13, 2023
AutoX
Public
AutoX is an efficient automl tool, which is mainly aimed at data mining tasks with tabular data.
python machine-learning kaggle
Jupyter Notebook
•
Apache License 2.0
•132•502•20•0•Updated Feb 14, 2023Feb 14, 2023
tsfe
Public
Time Series Feature Extraction for Federated Learning
Python
•
Apache License 2.0
•5•8•0•0•Updated Oct 24, 2022Oct 24, 2022
incubator-brpc
Public
Industrial-grade RPC framework used throughout Baidu, with 1,000,000+ instances and thousands kinds of services. "brpc" means "better RPC".
C++
•
Apache License 2.0
•4k•0•0•1•Updated May 31, 2022May 31, 2022
parameter-server
Public
C++
•
Apache License 2.0
•2•3•0•0•Updated May 5, 2022May 5, 2022
prpc
Public
C++
•
Apache License 2.0
•1•8•0•0•Updated May 5, 2022May 5, 2022
openmldb-docs-zh
Public archive
This is the repo for OpenMLDB's Chinese documentations
Python
•
Apache License 2.0
•8•7•0•0•Updated Apr 5, 2022Apr 5, 2022
pafka
Public
Pafka is originated from the OpenAIOS project to leverage an optimized tiered storage access strategy to improve overall performance for streaming/messaging system.
java streaming scala kafka message-queue pmem
Java
•
Apache License 2.0
•14k•67•1•0•Updated Jan 2, 2022Jan 2, 2022
llpl
Public
Low Level Persistence Library
Java
•
Other
•38•0•0•0•Updated Sep 17, 2021Sep 17, 2021
openaios-platform
Public
OpenAIOS is an incubating open-source distributed OS kernel based on Kubernetes for AI workloads. OpenAIOS-Platform is an AI development platform built upon OpenAIOS for enterprises to develop and deploy AI applications for production.
Go
•
Apache License 2.0
•18•95•3•0•Updated Aug 20, 2021Aug 20, 2021
Benchmark
Public
benchmark on in-memory database, streaming and batch system
Apache License 2.0
•1•0•0•1•Updated Jul 19, 2021Jul 19, 2021
oam-kubernetes-runtime
Public
A set of libraries for building OAM runtimes
Go
•
Apache License 2.0
•80•1•0•0•Updated Jul 14, 2021Jul 14, 2021
rfcs
Public
RFCs for 4Paradigm Open Source Community
4•6•0•2•Updated Jun 25, 2021Jun 25, 2021
pmemstore
Public
Key/Value Datastore for Persistent Memory
C++
•
Other
•118•27•1•0•Updated Jun 9, 2021Jun 9, 2021
canopy
Public
Canopy is a machine learning learning compiler stack with the capability of adopting high-end FPGAs. As a part of OpenAIOS project, Canopy is an evolved version of Apache TVM. Canopy is able to support a variety of hardware backends such as PCIE-based cloud FPGAs, CPUs and GPUs.
machine-learning performance fpga deep-learning metal compiler gpu opencl tvm
Python
•
Apache License 2.0
•3.5k•12•0•0•Updated May 7, 2021May 7, 2021
pskiplist
Public
An implementation of the persistent skiplist based on Intel Optane Persistent Memory. It is with Intel's pmemkv as an storage engine
C++
•0•14•0•0•Updated Apr 9, 2021Apr 9, 2021
pcj
Public
Persistent Collections for Java
Java
•
Other
•27•0•0•0•Updated Apr 8, 2021Apr 8, 2021
canopy-hw
Public
Canopy: FPGA-Accelerated Deep Learning Compiler Stack (Hardware Backend)
fpga deep-learning compiler tvm vta
C++
•
Apache License 2.0
•73•4•0•0•Updated Apr 8, 2021Apr 8, 2021