Skill UI

This guide provides expert patterns for building robust, observable infrastructure for database migrations. It covers real-time monitoring using Change Data Capture (CDC), metrics collection (Prometheus/Grafana), and anomaly detection. Use this skill when setting up CDC pipelines (e.g., Debezium with Kafka) or implementing comprehensive observability for database schema changes and data synchronization processes.

This guide provides a comprehensive framework for minimizing cloud expenditure on Databricks. It covers identifying cost drivers via system billing tables, implementing cluster policies, utilizing spot instances for batch processing, right-sizing SQL warehouses, and automating the shutdown of idle development clusters. Use it when managing cloud spending or optimizing data platform usage.

This skill provides a comprehensive guide on implementing robust data governance patterns within Delta Lake, leveraging Unity Catalog. It covers essential compliance topics such as data classification tagging, handling GDPR 'right-to-deletion' requests for PII, and establishing automated data retention policies. Use this when designing secure, compliant, and auditable data pipelines in a data lake environment.

A comprehensive guide for establishing robust, enterprise-grade access control within Databricks. Covers implementing Single Sign-On (SSO) via SCIM, leveraging Unity Catalog for fine-grained Role-Based Access Control (RBAC), defining cluster policies, and enforcing data governance measures like Row-Level Security (RLS) and column masking. Essential for large-scale, secure data platforms.

This skill guides the setup and management of Databricks resources across development, staging, and production environments. It covers best practices for using isolated workspaces, managing environment-specific secrets, implementing Asset Bundles, and integrating with CI/CD pipelines to ensure consistent and reliable data deployments.

This guide outlines a production-ready lakehouse architecture using Unity Catalog, Delta Lake, and the Medallion pattern. It provides best practices for organizing Databricks workspaces, implementing three-level governance, defining compute strategies, and adopting CI/CD best practices with Asset Bundles for robust team collaboration.

A comprehensive guide to production-ready patterns for the Databricks Python SDK. This skill covers essential best practices including singleton client initialization, structured error handling with typed exceptions, context-managed cluster lifecycle control (ensuring cleanup), and implementing type-safe job definitions. It is essential for building robust, maintainable, and idiomatic integrations with the Databricks platform.

A comprehensive guide to implementing best practices for security within Databricks. Learn how to manage secrets using scoped storage, enforce the principle of least privilege via Unity Catalog grants, audit API tokens, and apply advanced data protection techniques like column-level masking and row-level security for enhanced data governance and compliance.

A comprehensive guide detailing best practices for building reliable, fault-tolerant Python applications utilizing DBOS durable workflows. This resource is essential when integrating DBOS into existing Python codebases, defining complex workflows and steps, managing concurrency via queues, or implementing robust workflow communication patterns.

A guide to production-ready patterns for dbt (data build tool). It covers essential practices for robust data pipeline development, including model organization (staging, intermediate, marts), implementing advanced testing strategies, ensuring data quality, and optimizing incremental processing for large datasets.

This skill guides the application of Domain-Driven Design (DDD) tactical patterns, including defining aggregates, modeling value objects, managing repositories, and utilizing domain events. It helps developers translate complex domain rules into clean, robust, and behavior-rich code structures, ensuring invariants are explicitly enforced.

This specialized skill acts as an expert debugger, designed for deep root cause analysis of software errors, test failures, and unexpected behavior. It guides the user through systematic debugging processes, including capturing stack traces, isolating failure points, implementing minimal fixes, and providing comprehensive reports detailing the root cause, evidence, specific code patches, and prevention recommendations. Ideal for complex bug resolution and quality assurance.