Databend: a new database engine with Rust

What is Databend?

Databend is an open-source Elastic and Workload-Aware modern cloud data warehouse.

Databend uses the latest techniques in vectorized query processing to allow you to do blazing-fast data analytics on object storage(S3, Azure Blob or MinIO).

Databend uses the latest techniques in vectorized query processing to allow you to do blazing-fast data analytics on object storage(S3, Azure Blob or MinIO).

Instant Elasticity

Databend completely separates storage from compute, which allows you easily scale up or scale down based on your application's needs.

Blazing Performance

Databend leverages data-level parallelism(Vectorized Query Execution) and instruction-level parallelism(SIMD) technology, offering blazing performance data analytics.

Support for Semi-Structured Data

Databend supports ingestion of semi-structured data in various formats like CSV, JSON, and Parquet, which are located in the cloud or your local file system; Databend also supports semi-structured data types: ARRAY, MAP, JSON, which is easy to import and operate on semi-structured.

MySQL/ClickHouse Compatible

Databend is ANSI SQL compliant and MySQL/ClickHouse wire protocol compatible, making it easy to connect with existing tools(MySQL Client, ClickHouse Client, Vector, DBeaver, Jupyter, JDBC, etc.).

Easy to Use

Databend has no indexes to build, no manual tuning required, no manual figuring out partitions or shard data, it’s all done for you as data is loaded into the table.

Design Overview

This is the high-level architecture of Databend. It consists of three components:

  • meta service layer
  • compute layer
  • storage layer


License

Databend is licensed under Apache 2.0.

Resources





Friday is an Open-source Virtual Assistant

Virtual assistant technology defines as an application program that uses semantic and deep learning. It can also call an AI assistant or digital assistant. It helps users or enterprises to assist people or automate tasks. Any virtual assist.......Read more...

15 Open-source Physics Simulation Engine

What is a physics simulation engine?A physics simulation engine is a custom software engine that grants developers add visual effetcs, simulate and tweak objects and enviroments accroding to the law of physics in 2D, 3D or both. With physi.......Read more...

CMS: Is a Self-hosted Open-source Contest Management System

CMS, or Contest Management System, is a distributed system for running and (to some extent) organizing a programming contest. CMS has been designed to be general and to handle many types of contests, tasks, scoring, etc. Nonetheless, CMS ha.......Read more...

18 Open-source Flat-file Wiki Engines

A flat-file system is a solution that save records, and data in a plain files, instead of depending on an external database to store its content. Unlike database dependent systems, which requires you to setup, configure, prepare, and manag.......Read more...

Ace: an Open-source Code Editor for the Web

What is Ace?Ace is a standalone code editor written in JavaScript. Our goal is to create a browser based editor that matches and extends the features, usability and performance of existing native editors such as TextMate, Vim or Eclipse. I.......Read more...