Airflow

SkaleData runs managed Apache Airflow on your own cloud. These pages cover operating your Airflow instances beyond the basics:

• Executors — Celery vs Kubernetes vs Hybrid: task-start latency, isolation, idle cost, and node-pool capacity planning.
• Worker Queues — run multiple Celery worker pools with different machine shapes, node placement, and autoscaling, and route tasks between them.

Related sections:

• Airflow Image — the maintained base image every instance runs by default, and how to customize it.
• CLI → Airflow — local development and deploying DAGs with skale airflow.