Skill UI

This guide outlines a production-ready lakehouse architecture using Unity Catalog, Delta Lake, and the Medallion pattern. It provides best practices for organizing Databricks workspaces, implementing three-level governance, defining compute strategies, and adopting CI/CD best practices with Asset Bundles for robust team collaboration.

A comprehensive guide to implementing best practices for security within Databricks. Learn how to manage secrets using scoped storage, enforce the principle of least privilege via Unity Catalog grants, audit API tokens, and apply advanced data protection techniques like column-level masking and row-level security for enhanced data governance and compliance.

This comprehensive guide provides structured steps and code examples for upgrading Databricks Runtime versions and performing critical data migrations. It covers best practices for version compatibility checking, transitioning from Hive Metastore to Unity Catalog using methods like SYNC and CTAS, and updating deprecated API endpoints, ensuring a smooth platform evolution for data pipelines.

This skill provides a comprehensive guide to configuring event-driven workflows and robust notification systems for Databricks jobs. It covers setting up various notification destinations (Slack, Teams, Email, PagerDuty) and triggering alerts based on job lifecycle events (success, failure, start). Furthermore, it demonstrates advanced monitoring using system audit tables and creating automated SQL alerts for critical data pipeline monitoring.

Automates guidance for date range analytics, covering SQL, visualization, statistics, and BI, with code generation and validation to support data analytics workflows.

Automates dbt test creation within data pipelines, offering guided best practices, code generation, and validation to keep ETL, transformation, and streaming workflows reliable.

A guide to production-ready patterns for dbt (data build tool). It covers essential practices for robust data pipeline development, including model organization (staging, intermediate, marts), implementing advanced testing strategies, ensuring data quality, and optimizing incremental processing for large datasets.

Enables Claude to apply anomaly-detection-system workflows for spotting outliers, fraud, or unusual patterns across datasets, selecting tailored algorithms like Isolation Forest and summarizing deviations for any data monitoring or security use case.

Automated guidance for configuring and applying early stopping callbacks across ML training workflows, covering best practices, code generation, and validation for PyTorch, TensorFlow, and scikit-learn experiments.

A comprehensive tool for querying and analyzing deep blockchain data across multiple EVM-compatible networks, including Ethereum, Polygon, Arbitrum, and Optimism. It supports tracking transactions by hash, checking address balances, inspecting blocks, and resolving ERC-20 token holdings. Ideal for crypto analysts, developers, and researchers requiring programmatic, detailed insights into on-chain financial activity and protocol interactions.

Automates guidance for setting up and validating feature store connectors within ML deployment pipelines, covering best practices, code generation, and production monitoring for inference.

Automates file format conversion guidance within data pipelines, covering ETL, workflow orchestration, data transformation, and streaming standards with production-ready examples.