Skill UI

A comprehensive guide to building production-ready Apache Airflow Directed Acyclic Graphs (DAGs). This skill covers best practices for operators, sensors, testing, deployment, and designing robust data pipelines. Use this when orchestrating complex workflows, managing ETL processes, or ensuring reliable batch job execution in a production environment.

Guides you through building Airflow operators for data pipelines with automated best practices, production-ready code/config generation, and validation for ETL, transformation, orchestration, and streaming scenarios.

This skill guides the construction of robust, production-grade backtesting systems for financial trading strategies. It helps users systematically validate performance, avoid common biases (like look-ahead bias), and implement advanced techniques such as walk-forward analysis, ensuring reliable performance estimates before live deployment.

Automates churn analysis workflows by offering guidance, best practices, and production-ready code for SQL, visualization, statistical work, and BI outputs within data analytics projects.

This comprehensive checklist guides users through validating and preparing Clay enrichment pipelines for a production launch. It covers critical areas including table schema finalization, data quality gates (validation, deduplication), credit cost management, webhook reliability testing, and establishing robust monitoring and alerting procedures before going live.

Guides ML training teams through data augmentation pipelines, offering best practices, code/config generation, validation, and experiment-tracking support so pipelines stay production-ready.

A comprehensive, end-to-end workflow for building product features guided by rigorous data insights. This skill guides users through the entire lifecycle, encompassing exploratory data analysis, forming measurable business hypotheses, designing statistical A/B tests, architecting data pipelines, and implementing robust backend/frontend instrumentation. It ensures that every feature iteration is validated by data and measured for impact.

This comprehensive checklist guides the deployment of Databricks data pipelines and jobs to a production environment. It covers critical stages including pre-deployment security hardening (Service Principals, Unity Catalog), validating infrastructure (cluster types, autoscaling), ensuring code quality (unit/integration tests, Delta Lake best practices), executing controlled deployment, and performing post-deployment health checks and monitoring setup. Ideal for CI/CD pipelines and go-live procedures.

This guide outlines a production-ready lakehouse architecture using Unity Catalog, Delta Lake, and the Medallion pattern. It provides best practices for organizing Databricks workspaces, implementing three-level governance, defining compute strategies, and adopting CI/CD best practices with Asset Bundles for robust team collaboration.

A guide to production-ready patterns for dbt (data build tool). It covers essential practices for robust data pipeline development, including model organization (staging, intermediate, marts), implementing advanced testing strategies, ensuring data quality, and optimizing incremental processing for large datasets.

Automated assistance for Flink job creation in data pipelines, triggered by Flink job creator requests. Guides ETL, streaming, and workflow orchestration, generates production-ready code/configurations, and validates outputs against industry standards.

Automates funnel analysis builder workflows by offering guidance on SQL, visualization, statistics, and BI best practices for data analytics teams needing production-ready insights.