astronomer/dag-factory

Pythonastronomer.github.io/dag-factory/latest/

Construct Apache Airflow DAGs Declaratively via YAML configuration files

airflowapache-airflowpythondags
スター成長
スター
1.5k
フォーク
238
週間成長
+2
Issue
61
5001k
2018年11月2021年6月2024年1月2026年9月
成果物PyPI
README

dag-factory

Github Actions Coverage PyPi Code Style Downloads

analytics

Welcome to dag-factory! dag-factory is a library for Apache Airflow® to construct DAGs declaratively via configuration files.

The minimum requirements for dag-factory are:

For a gentle introduction, please take a look at our Quickstart Guide. For more examples, please see the examples folder.

Benefits

  • Construct DAGs without knowing Python
  • Construct DAGs without learning Airflow primitives
  • Avoid duplicative code
  • Everyone loves YAML! ;)

📢 Dag-Factory 1.0 Released

Version 1.0 introduces important improvements and breaking changes to support modern Airflow usage.

👉 See the Migration Guide to upgrade from earlier versions.

🚀 Dag-Factory Supports Airflow 3

DAG-Factory is compatible with Apache Airflow 3 and supports modern scheduling, and updated import paths.

Community

Join us on the Apache Airflow Slack Workspace at #yaml-dags

License

To learn more about the terms and conditions for use, reproduction and distribution, read the Apache License 2.0.

Privacy Notice

This project follows Astronomer's Privacy Policy.

For further information, read this

Security Policy

Check the project's Security Policy to learn how to report security vulnerabilities in DAG Factory and how security issues reported to the DAG Factory security team are handled.

関連リポジトリ
apache/airflow

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

PythonPyPIApache License 2.0airflowapache
airflow.apache.org
46.8k17.8k
argoproj/argo-workflows

Workflow Engine for Kubernetes

GoGo ModulesApache License 2.0workflowkubernetes
argo-workflows.readthedocs.io
17k3.6k
apache/dolphinscheduler

Apache DolphinScheduler is the modern data orchestration platform. Agile to create high performance workflow with low-code

JavaMavenApache License 2.0workflow-scheduleazkaban
dolphinscheduler.apache.org
14.5k5.1k
orchest/orchest

Build data pipelines, the easy way 🛠️

TypeScriptnpmApache License 2.0data-sciencemachine-learning
orchest.readthedocs.io/en/stable/
4.1k259
jghoman/awesome-apache-airflow

Curated list of resources about Apache Airflow

Shellawesomeairflowapache-airflow
3.9k511
puckel/docker-airflow

Docker Apache Airflow

ShellApache License 2.0docker-airflowairflow
3.8k591
WeBankFinTech/DataSphereStudio

DataSphereStudio is a one stop data application development& management portal, covering scenarios including data exchange, desensitization/cleansing, analysis/mining, quality measurement, visualization, and task scheduling.

JavaMavenApache License 2.0workflowgovernance
github.com/WeBankFinTech/DataSphereStudio-Doc
3.3k1k
elyra-ai/elyra

Elyra extends JupyterLab with an AI centric approach.

PythonPyPIApache License 2.0notebooksnotebook-jupyter
elyra.readthedocs.io/en/stable/
2k370
san089/Udacity-Data-Engineering-Projects

Few projects related to Data Engineering including Data Modeling, Infrastructure setup on cloud, Data Warehousing and Data Lake development.

PythonPyPItutorialOtherdatadata-engineering
2k596
teamclairvoyant/airflow-maintenance-dags

A series of DAGs/Workflows to help maintain the operation of Airflow

PythonPyPIlibraryApache License 2.0airflowdag
1.8k391
OBenner/data-engineering-interview-questions

More than 2000+ Data engineer interview questions.

PythonPyPIinterviewdata-engineeringinterview-questions
1.7k562
san089/goodreads_etl_pipeline

An end-to-end GoodReads Data Pipeline for Building Data Lake, Data Warehouse and Analytics Platform.

PythonPyPIMIT Licenseetl-pipelineetl-framework
1.5k247