Skill UI

Automates the creation of Airflow DAGs for ETL and streaming data workflows, offering best-practice guidance, production-ready code samples, and validation against common pipeline standards.

Guides building production-ready Apache Airflow DAGs with structured operators, sensors, testing, observability, and deployment patterns to orchestrate reliable data pipelines and batch workflows.

Guides you through building Airflow operators for data pipelines with automated best practices, production-ready code/config generation, and validation for ETL, transformation, orchestration, and streaming scenarios.

Designs scalable batch and streaming pipelines, modern warehouses, and analytics platforms with Spark, dbt, Airflow, cloud data stacks, and governance practices.

Designs production-grade ML pipeline infrastructure covering experiment tracking, feature stores, DAG orchestration, and automated retraining so teams can reliably version data, tune hyperparameters, and deploy models with tools like MLflow, Kubeflow, Airflow, or Feast.

Guides building scalable data pipelines, ETL/ELT workflows, and modern data infrastructure with Python, SQL, Spark, Airflow, dbt, Kafka, and allied tools, covering architecture decisions, modeling, quality, monitoring, and performance optimization.