Skip to content

Datafuse is a free Cloud-Native Analytics DBMS(Inspired by ClickHouse) implemented in Rust

License

Notifications You must be signed in to change notification settings

TCeason/datafuse

Β 
Β 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 

Repository files navigation

Databend: The Next-Gen Cloud [Data+AI] Analytics

Zero Disk Architecture

databend

πŸ‹ Introduction

Databend, built in Rust, is an open-source cloud data warehouse that serves as a cost-effective alternative to Snowflake. With its focus on fast query execution and data ingestion, it's designed for complex analysis of the world's largest datasets.

⚑ Performance

Databend vs. Snowflake

Databend vs. Snowflake

πŸš€ Why Databend

  • Full Controlβ€”Cloud + On-Prem: Deploy on cloud or on-prem to suit your needs and maintain full control.

  • Blazing-Fast Performance: Built with Rust for efficient, high-speed vectorized query execution. πŸ‘‰ ClickBench

  • Cost-Effective: Scalable architecture that optimizes performance while reducing storage and compute costs. πŸ‘‰ TPC-H

  • AI-Enhanced Analytics: Leverage built-in AI Functions for smarter data insights.

  • Simplified ETL: Direct data ingestion without the need for external ETL tools, streamlining the process. πŸ‘‰ Data Loading

  • Real-Time Data Updates: Keep your analytics up-to-date with real-time incremental data updates. πŸ‘‰ Stream

  • Advanced Indexing: Boost query performance with Virtual Column, Aggregating Index, and Full-Text Index.

  • ACID Compliance + Version Control: Ensure reliable transactions with full ACID compliance and Git-like versioning.

  • Schema Flexibility: Effortlessly handle semi-structured data with the flexible VARIANT data type.

  • Community-Driven Growth: Open-source and continuously evolving with contributions from a global community.

πŸ“ Architecture

Databend Architecture

πŸš€ Try Databend

1. Databend Serverless Cloud

The fastest way to try Databend, Databend Cloud

2. Install Databend from Docker

Prepare the image (once) from Docker Hub (this will download about 170 MB data):

docker pull datafuselabs/databend

To run Databend quickly:

docker run --net=host  datafuselabs/databend

πŸš€ Getting Started

Connecting to Databend
Data Import and Export
Loading Data From Other Databases
Querying Semi-structured Data
Visualize Tools with Databend
Managing Users
Managing Databases
Managing Tables
Managing Data
Managing Views
AI Functions
Data Management
Accessing Data Lake
Security
Performance

🀝 Contributing

Databend thrives on community contributions! Whether it's through ideas, code, or documentation, every effort helps in enhancing our project. As a token of our appreciation, once your code is merged, your name will be eternally preserved in the system.contributors table.

Here are some resources to help you get started:

πŸ‘₯ Community

For guidance on using Databend, we recommend starting with the official documentation. If you need further assistance, explore the following community channels:

πŸ›£οΈ Roadmap

Stay updated with Databend's development journey. Here are our roadmap milestones:

πŸ“œ License

Databend is released under a combination of two licenses: the Apache License 2.0 and the Elastic License 2.0.

When contributing to Databend, you can find the relevant license header in each file.

For more information, see the LICENSE file and Licensing FAQs.

πŸ™ Acknowledgement

About

Datafuse is a free Cloud-Native Analytics DBMS(Inspired by ClickHouse) implemented in Rust

Resources

License

Stars

Watchers

Forks

Packages

No packages published

Languages

  • Rust 97.2%
  • Shell 1.8%
  • Python 0.8%
  • Jinja 0.2%
  • Dockerfile 0.0%
  • Makefile 0.0%