Retour au classement

meltano/meltano

Pythonmeltano.com

Meltano: the declarative code-first data integration engine that powers your wildest data and ML-powered product ideas. Say goodbye to writing, maintaining, and scaling your own API integrations.

dataopsdataops-platformeltopen-sourceopensourcedatapipelinesextract-datameltanomeltano-sdkconnectorsintegration
Croissance des étoiles
Étoiles
2.6k
Forks
256
Croissance hebdomadaire
Issues
139
1k2k
juin 2021févr. 2023nov. 2024juil. 2026
ArtefactsPyPIpip install meltano
README
Meltano Logo

The declarative code-first data integration engine

Say goodbye to writing, maintaining, and scaling your own API integrations.
Unlock 600+ APIs and DBs and realize your wildest data and ML-powered product ideas.


Integrations

Meltano Hub is the single source of truth to find any Meltano plugins as well as Singer taps and targets. Users are also able to add more plugins to the Hub and have them immediately discoverable and usable within Meltano. The Hub is lovingly curated by Meltano and the wider Meltano community.

Installation

If you're ready to build your ideal data platform and start running data workflows across multiple tools, start by following the Installation guide to have Meltano up and running in your device.

Docker Images

Meltano is available as Docker images on Docker Hub:

  • Slim images (recommended): meltano/meltano:latest-slim - optimized size, includes cloud storage support
  • Full images: meltano/meltano:latest - includes all database connectors and build tools
# Quick start with slim image
docker run --rm meltano/meltano:latest-slim --version

# For projects needing MSSQL/PostgreSQL
docker run --rm meltano/meltano:latest --version

See our Containerization guide for detailed usage instructions.

Documentation

Check out the "Getting Started" guide or find the full documentation at https://docs.meltano.com.

Contributing

Meltano is a truly open-source project, built for and by its community. We happily welcome and encourage your contributions. Start by browsing through our issue tracker to add your ideas to the roadmap. If you're still unsure on what to contribute at the moment, you can always check out the list of open issues labeled as "Accepting Merge Requests".

For more information on how to contribute to Meltano, refer to our contribution guidelines.

Community

We host weekly online events where you can engage with us directly. Check out more information in our Community page.

If you have any questions, want sneak peeks of features or would just like to say hello and network, join our community of over +2,500 data professionals!

👋 Join us on Slack!

Responsible Disclosure Policy

Please refer to the responsible disclosure policy on our website.

License

This code is distributed under the MIT license, see the LICENSE file.

Dépôts similaires
lance-format/lance

Open Lakehouse Format for Multimodal AI. Convert from Parquet in 2 lines of code for 100x faster random access, vector index, and data versioning. Compatible with Pandas, DuckDB, Polars, Pyarrow, and PyTorch with more integrations coming..

Rustcrates.ioApache License 2.0machine-learningcomputer-vision
lance.org
6.8k769
redpanda-data/console

Redpanda Console is a developer-friendly UI for managing your Kafka/Redpanda workloads. Console gives you a simple, interactive approach for gaining visibility into your topics, masking data, managing consumer groups, and exploring real-time data with time-travel debugging.

TypeScriptnpmapache-kafkadataops
redpanda.com
4.3k426
lancedb/lance

Modern columnar data format for ML and LLMs implemented in Rust. Convert from parquet in 2 lines of code for 100x faster random access, vector index, and data versioning. Compatible with Pandas, DuckDB, Polars, Pyarrow, and PyTorch with more integrations coming..

Rustcrates.ioApache License 2.0machine-learningcomputer-vision
lancedb.github.io/lance/
4.2k262
SQLMesh/sqlmesh

Scalable and efficient data transformation framework - backwards compatible with dbt.

PythonPyPIApache License 2.0dataopselt
sqlmesh.readthedocs.io/en/stable/
3.2k414
whylabs/whylogs

An open-source data logging library for machine learning models and data pipelines. 📚 Provides visibility into data quality & model performance over time. 🛡️ Supports privacy-preserving data collection, ensuring safety & robustness. 📈

Jupyter NotebookApache License 2.0ai-pipelinesapproximate-statistics
whylogs.readthedocs.io
2.8k143
elementary-data/elementary

The dbt-native data observability solution for data & analytics engineers. Monitor your data pipelines in minutes. Available as self-hosted or cloud service with premium features.

HTMLApache License 2.0data-lineagedata-governance
elementary-data.com
2.4k223
TobikoData/sqlmesh

Efficient data transformation and modeling framework that is backwards compatible with dbt.

PythonPyPIApache License 2.0dataopselt
sqlmesh.com
2.1k194
lensesio/fast-data-dev

Kafka Docker for development. Kafka, Zookeeper, Schema Registry, Kafka-Connect, , 20+ connectors

ShellApache License 2.0kafka-rest-proxyschema-registry
lenses.io
2.1k341
alibaba/SREWorks

Cloud Native DataOps & AIOps Platform | 云原生数智运维平台

JavaMavenApache License 2.0kubernetessre
sreworks.cn
2k431
datavane/tis

Support agile DataOps Based on Flink, DataX and Flink-CDC, Chunjun with Web-UI

JavaMavenApache License 2.0javadatax
tis.pub
1.3k284
opendatadiscovery/awesome-data-catalogs

📙 Awesome Data Catalogs and Observability Platforms.

MIT Licensedata-catalogdata-discovery
1.1k79