Back to rankings

ytsaurus/ytsaurus

C++ytsaurus.tech

YTsaurus is a scalable and fault-tolerant open-source big data platform.

big-dataclickhousedistributed-databaselakehouseolap-databasesparksqlytsaurus
Star Growth
Stars
2.2k
Forks
212
Weekly Growth
Issues
424
1.5k2k
Mar 2023Apr 2024Jun 2025Jul 2026
README


License Telegram

YTsaurus

Website | Documentation | YouTube

YTsaurus is a distributed storage and processing platform for big data with support for MapReduce model, a distributed file system and a NoSQL key-value database.

You can read post about YTsaurus or check video:

video about YTsaurus

Advantages of the platform

Multitenant ecosystem

  • A set of interrelated subsystems: MapReduce, an SQL query engine, a job schedule, and a key-value store for OLTP workloads.
  • Support for large numbers of users that eliminates multiple installations and streamlines hardware usage

Reliability and stability

  • No single point of failure
  • Automated replication between servers
  • Updates with no loss of computing progress

Scalability

  • Up to 1 million CPU cores and thousands of GPUs
  • Exabytes of data on different media: HDD, SSD, NVME, RAM
  • Tens of thousands of nodes
  • Automated server up and down-scaling

Rich functionality

  • Expansive MapReduce module
  • Distributed ACID transactions
  • A variety of SDKs and APIs
  • Secure isolation for compute resources and storage
  • User-friendly and easy-to-use UI

CHYT powered by ClickHouse®

  • A well-known SQL dialect and familiar functionality
  • Fast analytic queries
  • Integration with popular BI solutions via JDBC and ODBC

SPYT powered by Apache Spark

  • A set of popular tools for writing ETL processes
  • Launch and support for multiple mini SPYT clusters
  • Easy migration for ready-made solutions

Getting Started

Try YTsaurus cluster using Kubernetes or try our online demo.

How to Build from Source Code

How to Contribute

We are glad to welcome new contributors!

Please read the contributor's guide and the styleguide for more details.

Related repositories
binhnguyennus/awesome-scalability

The Patterns of Scalable, Reliable, and Performant Large-Scale Systems

MIT Licensesystem-designbackend
72.6k7k
ClickHouse/ClickHouse

ClickHouse® is a real-time analytics database management system

C++Apache License 2.0dbmsolap
clickhouse.com
48.8k8.7k
apache/spark

Apache Spark - A unified analytics engine for large-scale data processing

ScalaApache License 2.0pythonscala
spark.apache.org
43.7k29.3k
donnemartin/data-science-ipython-notebooks

Data science Python notebooks: Deep learning (TensorFlow, Theano, Caffe, Keras), scikit-learn, Kaggle, big data (Spark, Hadoop MapReduce, HDFS), matplotlib, pandas, NumPy, SciPy, Python essentials, AWS, and various command lines.

PythonPyPIOtherpythonmachine-learning
29.2k8k
apache/flink

Apache Flink

JavaMavenApache License 2.0scalajava
flink.apache.org
26.2k14k
thingsboard/thingsboard

Open-source IoT Platform - Device management, data collection, processing and visualization.

JavaMavenApache License 2.0visualizationiot
thingsboard.io
22.1k6.4k
amark/gun

An open source cybersecurity protocol for syncing decentralized graph data.

JavaScriptnpmOthermachine-learningartificial-intelligence
gun.eco/docs
19.1k1.2k
heibaiying/BigData-Notes

大数据入门指南 :star:

JavaMavenhadoophdfs
16.9k4.3k
prestodb/presto

The official home of the Presto distributed SQL query engine for big data

JavaMavenApache License 2.0javapresto
prestodb.io
16.7k5.5k
andkret/Cookbook

The Data Engineering Cookbook

PythonPyPIApache License 2.0data-engineerdata-engineering
learndataengineering.com
15.2k2.7k
trinodb/trino

Official repository of Trino, the distributed SQL query engine for big data, formerly known as PrestoSQL (https://trino.io)

JavaMavenApache License 2.0javapresto
trino.io
13.1k3.7k
apache/predictionio

PredictionIO, a machine learning server for developers and ML engineers.

ScalaApache License 2.0scalabig-data
predictionio.apache.org
12.5k1.9k