#data-pipeline

apache/shardingsphere

Java

92

health

Empowering Data Intelligence with Distributed SQL for Sharding, Scalability, and Security Across All Databases.

rocketride-org/rocketride-server

Python

91

health

High-performance AI pipeline engine with a C++ core and 50+ Python-extensible nodes. Build, debug, and scale LLM workflows with 13+ model providers, 8+ vector databases, and agent orchestration, all from your IDE. Includes VS Code extension, TypeScript/Python SDKs, and Docker deployment.

debezium/debezium

Java

90

health

Change data capture for a variety of databases. Please log issues at https://github.com/debezium/dbz/issues.

slothflowlabs/duckle

Rust

87

health

Open-source local-first ETL/ELT studio: visual data pipelines, 290+ connectors, dbt and on-device AI, run on DuckDB.

datazip-inc/olake

Go

87

health

OLake - Fastest Databases, Kafka & S3 Replication to Apache Iceberg with Table optimization (Called OLake Fusion). ⚡ Efficient, quick and scalable data ingestion for real-time analytics. Supported sources : Postgres, MongoDB, MySQL, Oracle, MSSql, DB2, Kafka, S3.