airflow-dag-patterns

1# Apache Airflow DAG Patterns
2 
3Production-ready patterns for Apache Airflow including DAG design, operators, sensors, testing, and deployment strategies.
4 
5## Use this skill when
6 
7- Creating data pipeline orchestration with Airflow
8- Designing DAG structures and dependencies
9- Implementing custom operators and sensors
10- Testing Airflow DAGs locally
11- Setting up Airflow in production
12- Debugging failed DAG runs
13 
14## Do not use this skill when
15 
16- You only need a simple cron job or shell script
17- Airflow is not part of the tooling stack
18- The task is unrelated to workflow orchestration
19 
20## Instructions
21 
221. Identify data sources, schedules, and dependencies.
232. Design idempotent tasks with clear ownership and retries.
243. Implement DAGs with observability and alerting hooks.
254. Validate in staging and document operational runbooks.
26 
27Refer to `resources/implementation-playbook.md` for detailed patterns, checklists, and templates.
28 
29## Safety
30 
31- Avoid changing production DAG schedules without approval.
32- Test backfills and retries carefully to prevent data duplication.
33 
34## Resources
35 
36- `resources/implementation-playbook.md` for detailed patterns, checklists, and templates.