Skill UI

Automates correlation analyzer workflows by offering best-practice guidance, executable SQL, visualization tips, and statistical validation for data analytics requests.

Automates cross validation setup for ML training requests, offering best-practice guidance, production-ready code samples, and validation steps across data preparation, model tuning, and experiment tracking.

Automates common CTE query builder tasks for data analytics, offering best-practice guidance, production-ready SQL snippets, and validation against standard requirements when you need help with BI, visualization, or statistical analysis.

Guides you through building Dagster data pipelines with best-practice advice, ready-to-use configurations, and validation checks for ETL, transformation, orchestration, and streaming workflows whenever the Dagster pipeline creator skill is activated.

Automates dashboard layout planning for data analytics tasks, guiding best practices, generating robust configs, and validating layouts for SQL-driven BI scenarios.

Guides ML training teams through data augmentation pipelines, offering best practices, code/config generation, validation, and experiment-tracking support so pipelines stay production-ready.

Offers automated guidance for implementing data lineage trackers across ETL and streaming pipelines, including best practices on transformations, orchestration, and validation for production environments.

Automated guidance for data normalization tool tasks in ML training, offering best practices, production-ready code/configuration generation, and output validation.

Guides engineers through data partitioner setups within ETL workflows, offering best practice advice, ready-to-run code, and validation for streaming and batch pipelines.

Automated Data Quality Checker offers guidance, best practices, and production-ready code for validating pipelines whenever you work with ETL, streaming, or data transformation scenarios.

This comprehensive checklist guides the deployment of Databricks data pipelines and jobs to a production environment. It covers critical stages including pre-deployment security hardening (Service Principals, Unity Catalog), validating infrastructure (cluster types, autoscaling), ensuring code quality (unit/integration tests, Delta Lake best practices), executing controlled deployment, and performing post-deployment health checks and monitoring setup. Ideal for CI/CD pipelines and go-live procedures.

This guide outlines a production-ready lakehouse architecture using Unity Catalog, Delta Lake, and the Medallion pattern. It provides best practices for organizing Databricks workspaces, implementing three-level governance, defining compute strategies, and adopting CI/CD best practices with Asset Bundles for robust team collaboration.