#big-data

apache/hive

Java

97

health

Apache Hive

apache/flink

Java

94

health

Apache Flink

apache/ozone

Java

92

health

Scalable, reliable, distributed storage system optimized for data analytics and object store workloads.

apache/calcite

Java

92

health

Apache Calcite

Eventual-Inc/Daft

Rust

87

health

High-performance data engine for AI and multimodal workloads. Process images, audio, video, and structured data at any scale

StarRocks/starrocks

Java

87

health

The world's fastest open query engine for sub-second analytics both on and off the data lakehouse. With the flexibility to support nearly any scenario, StarRocks provides best-in-class performance for multi-dimensional analytics, real-time analytics, and ad-hoc queries. A Linux Foundation project.

apache/paimon

Java

87

health

Apache Paimon is a lake format that enables building a Realtime Lakehouse Architecture with Flink and Spark for both streaming and batch operations.

prestodb/presto

Java

87

health

The official home of the Presto distributed SQL query engine for big data

apache/hugegraph

Java

87

health

A graph database that supports more than 100+ billion data, high performance and scalability (Include OLTP Engine & REST-API & Backends)

trinodb/trino

Java

86

health

Official repository of Trino, the distributed SQL query engine for big data, formerly known as PrestoSQL (https://trino.io)

ClickHouse/ClickHouse

C++

86

health

ClickHouse® is a real-time analytics database management system

apache/datafusion

Rust

84

health

Apache DataFusion SQL Query Engine

linkedin/openhouse

Java

84

health

Open Control Plane for Tables in Data Lakehouse

apache/beam

Java

83

health

Apache Beam is a unified programming model for Batch and Streaming data processing.

ytsaurus/ytsaurus

C++

83

health

YTsaurus is a scalable and fault-tolerant open-source big data platform.

apache/fluss

Java

79

health

Apache Fluss is a streaming storage built for real-time analytics.