Writing
Notes from production — data platforms, orchestration, and engineering in regulated finance.
The scheduler inside the scheduler: an Airflow anti-pattern and its paved-road fix
2026-08-23Why the controller-DAG-plus-generic-executor pattern hurts more than it helps, and how spec-driven DAG factories keep jobs as config without giving up per-job scheduling, backfills, and observability.
airfloworchestrationanti-patternsdata-platformMigrating from enterprise schedulers to Apache Airflow: patterns that hold up
2026-08-22A pattern guide for moving batch workloads off Control-M or Autosys onto Airflow: inventory first, standardize the DAG template, and reconcile before every cutover.
airflowmigrationdata-platform