StarRankExplorer
랭킹으로 돌아가기

singer-io/getting-started

Makefilesinger.io

This repository is a getting started guide to Singer.

etletl-frameworkpythonsingerdata-analysis
스타 성장
스타
1.3k
포크
140
주간 성장
—
이슈
22
5001k
2017년 3월2020년 4월2023년 6월2026년 7월
README

Singer

Singer is an open source standard for moving data between databases, web APIs, files, queues, and just about anything else you can think of. The Singer spec describes how data extraction scripts — called “Taps” — and data loading scripts — called “Targets” — should communicate using a standard JSON-based data format over stdout. By conforming to this spec, Taps and Targets can be used in any combination to move data from any source to any destination.

Join the Singer Slack channel to get help from members of the Singer community.

Docs

Copyright © 2018 Stitch

관련 저장소
pathwaycom/pathway

Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.

PythonPyPIOtherbatch-processingkafka
pathway.com
62.6k1.7k
apache/airflow

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

PythonPyPIApache License 2.0airflowapache
airflow.apache.org
46.2k17.4k
kestra-io/kestra

Event Driven Orchestration & Scheduling Platform for Mission Critical Applications

JavaMavenApache License 2.0orchestrationdata-orchestration
go.kestra.io/home
27.4k2.8k
vectordotdev/vector

A high-performance observability data pipeline.

Rustcrates.ioMozilla Public License 2.0logsmetrics
vector.dev
22.2k2.2k
airbytehq/airbyte

Open-source data movement for ELT pipelines and AI agents — from APIs, databases & files to warehouses, lakes, and AI applications. Both self-hosted and Cloud.

PythonPyPIOtherdatapipeline
airbyte.com
21.7k5.3k
dagster-io/dagster

An orchestration platform for the development, production, and observation of data assets.

PythonPyPIApache License 2.0data-pipelinesdagster
dagster.io
15.9k2.2k
cocoindex-io/cocoindex

Incremental engine for long horizon agents 🌟 Star if you like it!

Rustcrates.ioApache License 2.0aichange-data-capture
cocoindex.io
11k841
mage-ai/mage-ai

🧙 Build, run, and manage data pipelines for integrating and transforming data.

PythonPyPIApache License 2.0machine-learningartificial-intelligence
mage.ai
8.8k979
redpanda-data/connect

Fancy stream processing made operationally mundane

GoGo Modulesmessage-queuestream-processing
docs.redpanda.com/connect/home/
8.7k951
turbot/steampipe

Zero-ETL, infinite possibilities. Live query APIs, code & more with SQL. No DB required.

GoGo ModulesGNU Affero General Public License v3.0steampipepostgresql
steampipe.io
7.9k339
cloudquery/cloudquery

Data pipelines for cloud config and security data. Build cloud asset inventory, CSPM, FinOps, and vulnerability management solutions. Extract from AWS, Azure, GCP, and 70+ cloud and SaaS sources.

GoGo ModulesMozilla Public License 2.0awsgcp
cloudquery.io
6.5k549
apache/flink-cdc

Flink CDC is a streaming data integration tool

JavaMavenApache License 2.0change-data-capturecdc
nightlies.apache.org/flink/flink-cdc-docs-stable
6.4k2.2k