Skill UI

This skill provides comprehensive observability for the Databricks platform. It enables users to monitor job run histories, track cluster utilization and associated costs (DBU), detect slow SQL queries, and audit access logs. Use it for setting up robust monitoring dashboards, ensuring pipeline health, and optimizing resource consumption across the entire data stack.

A comprehensive guide detailing optimization techniques for Databricks environments. It covers optimal cluster sizing for various workloads (ETL, ML, Streaming), advanced Spark configurations (AQE, memory management), and deep data optimization strategies for Delta Lake, including Z-Ordering and Liquid Clustering. It also provides methods for query plan analysis and join optimization.

This comprehensive checklist guides the deployment of Databricks data pipelines and jobs to a production environment. It covers critical stages including pre-deployment security hardening (Service Principals, Unity Catalog), validating infrastructure (cluster types, autoscaling), ensuring code quality (unit/integration tests, Delta Lake best practices), executing controlled deployment, and performing post-deployment health checks and monitoring setup. Ideal for CI/CD pipelines and go-live procedures.

A comprehensive guide to production-ready patterns for the Databricks Python SDK. This skill covers essential best practices including singleton client initialization, structured error handling with typed exceptions, context-managed cluster lifecycle control (ensuring cleanup), and implementing type-safe job definitions. It is essential for building robust, maintainable, and idiomatic integrations with the Databricks platform.

This comprehensive guide provides structured steps and code examples for upgrading Databricks Runtime versions and performing critical data migrations. It covers best practices for version compatibility checking, transitioning from Hive Metastore to Unity Catalog using methods like SYNC and CTAS, and updating deprecated API endpoints, ensuring a smooth platform evolution for data pipelines.

Automates dbt test creation within data pipelines, offering guided best practices, code generation, and validation to keep ETL, transformation, and streaming workflows reliable.

A guide to production-ready patterns for dbt (data build tool). It covers essential practices for robust data pipeline development, including model organization (staging, intermediate, marts), implementing advanced testing strategies, ensuring data quality, and optimizing incremental processing for large datasets.

This skill provides a structured methodology for tackling complex bugs, performance bottlenecks, and production incidents. It guides users through reproducing issues, forming hypotheses, performing controlled experiments, and narrowing down the scope using proven strategies and tools. Ideal for deep dive troubleshooting and root cause analysis in complex software systems.

A comprehensive, expert-level workflow for debugging complex software issues in production environments. This skill guides users through initial triage, advanced observability data collection (APM, distributed traces, logs), intelligent hypothesis generation, and full root cause analysis. Use it when dealing with intermittent failures, performance bottlenecks, or needing a complete fix and prevention plan.

Collects comprehensive, sanitized debug evidence for Deepgram support and troubleshooting. This bundle gathers detailed system environment information (Node.js, Python), performs live API connectivity tests, analyzes audio file metadata using ffprobe, and logs request/response data. Essential for preparing detailed support tickets and reproducing bugs related to Deepgram integration.

Provides comprehensive instructions for deploying Deepgram transcription services into various production environments. This guide covers building production-ready Docker images, configuring Docker Compose, setting up robust Kubernetes manifests (including HPA and secrets), and implementing serverless handlers for platforms like AWS Lambda. Essential for scaling Deepgram services reliably and securely in the cloud.

A comprehensive runbook for standardizing incident response to Deepgram production issues. It guides users through automated triage (checking status, API connectivity, and model performance), severity classification (SEV1-SEV4), and implementing mitigation strategies, including building fallback services and replaying failed requests to ensure business continuity during outages or degradation.