Skill UI

Automates cross validation setup for ML training requests, offering best-practice guidance, production-ready code samples, and validation steps across data preparation, model tuning, and experiment tracking.

Automates common CTE query builder tasks for data analytics, offering best-practice guidance, production-ready SQL snippets, and validation against standard requirements when you need help with BI, visualization, or statistical analysis.

Guides ML training teams through data augmentation pipelines, offering best practices, code/config generation, validation, and experiment-tracking support so pipelines stay production-ready.

Offers automated guidance for implementing data lineage trackers across ETL and streaming pipelines, including best practices on transformations, orchestration, and validation for production environments.

Automated guidance for data normalization tool tasks in ML training, offering best practices, production-ready code/configuration generation, and output validation.

Automated Data Quality Checker offers guidance, best practices, and production-ready code for validating pipelines whenever you work with ETL, streaming, or data transformation scenarios.

This skill provides production patterns for implementing robust data quality validation using Great Expectations, dbt tests, and formal data contracts. It is essential for building reliable, automated, and verifiable data pipelines, ensuring data integrity throughout the entire ETL/ELT process, and establishing clear data governance rules.

This skill models the expertise of a senior data scientist, covering the entire data science lifecycle. It provides advanced capabilities in statistical modeling, machine learning (deep learning, XGBoost), predictive analytics, and business intelligence. From raw data exploration (EDA) to deploying production-ready models and creating actionable dashboards, it covers technical depth across Python, R, SQL, and cloud platforms, while applying domain knowledge in finance, marketing, and operations.

This skill details how to set up automated CI/CD pipelines for Databricks data pipelines. It leverages Declarative Automation Bundles (DABs) and GitHub Actions to manage the entire deployment lifecycle. Key functionalities include running unit tests on pull requests, validating and deploying to staging environments, and promoting validated code to production upon merge, ensuring reliable and automated data infrastructure.

This comprehensive checklist guides the deployment of Databricks data pipelines and jobs to a production environment. It covers critical stages including pre-deployment security hardening (Service Principals, Unity Catalog), validating infrastructure (cluster types, autoscaling), ensuring code quality (unit/integration tests, Delta Lake best practices), executing controlled deployment, and performing post-deployment health checks and monitoring setup. Ideal for CI/CD pipelines and go-live procedures.

This guide outlines a production-ready lakehouse architecture using Unity Catalog, Delta Lake, and the Medallion pattern. It provides best practices for organizing Databricks workspaces, implementing three-level governance, defining compute strategies, and adopting CI/CD best practices with Asset Bundles for robust team collaboration.

A guide to production-ready patterns for dbt (data build tool). It covers essential practices for robust data pipeline development, including model organization (staging, intermediate, marts), implementing advanced testing strategies, ensuring data quality, and optimizing incremental processing for large datasets.