Skill UI

This comprehensive workflow guides the entire database lifecycle, from initial architecture design (covering both SQL and NoSQL) to advanced implementation, optimization, and maintenance. It covers crucial stages like schema design, implementing migrations, optimizing query performance, developing robust data pipelines (using tools like Airflow and dbt), and managing data quality and operations. Ideal for engineers building complex, production-grade data systems.

This skill details how to set up automated CI/CD pipelines for Databricks data pipelines. It leverages Declarative Automation Bundles (DABs) and GitHub Actions to manage the entire deployment lifecycle. Key functionalities include running unit tests on pull requests, validating and deploying to staging environments, and promoting validated code to production upon merge, ensuring reliable and automated data infrastructure.

This guide outlines the complete MLOps workflow on Databricks. It covers feature engineering using Feature Store, tracking experiments with MLflow, managing model versions in the Model Registry, and deploying real-time inference endpoints via Mosaic AI Model Serving. Ideal for building robust, production-grade ML pipelines.

This comprehensive diagnostic bundle collects critical evidence from the Databricks environment, including environment setup, cluster state, job run history, and Delta table diagnostics. It generates a redacted, safe tar.gz file specifically designed for submitting detailed support tickets and efficiently troubleshooting complex data pipeline issues.

A comprehensive guide detailing the setup process for Databricks CLI v2 and Python SDK. It covers essential steps for connecting to various Databricks workspaces, including configuring Personal Access Tokens (PAT), interactive OAuth U2M flows, and secure OAuth M2M service principals for CI/CD pipelines. Essential for developers integrating Databricks into their projects.

This skill provides a comprehensive guide to configuring event-driven workflows and robust notification systems for Databricks jobs. It covers setting up various notification destinations (Slack, Teams, Email, PagerDuty) and triggering alerts based on job lifecycle events (success, failure, start). Furthermore, it demonstrates advanced monitoring using system audit tables and creating automated SQL alerts for critical data pipeline monitoring.

This comprehensive guide sets up a robust CI/CD pipeline for Deepgram integrations using GitHub Actions. It covers unit tests (mocked SDK), full integration tests against the live Deepgram API (including transcription, diarization, and TTS), and smoke tests. Use this when establishing automated testing, ensuring deployment stability, or implementing continuous delivery workflows for Deepgram-powered applications.

This skill provides comprehensive methods to optimize Deepgram API usage and manage costs. It implements budget-aware transcription pipelines that preemptively check projected spending against set limits, utilizes audio preprocessing techniques (like silence removal via ffmpeg) to minimize billable minutes, and includes API calls to monitor current usage and spending against defined budgets. Ideal for cost-sensitive, production-grade deployments.

Provides reference architectures for building high-scale, reliable transcription systems using Deepgram. It covers four main patterns: synchronous REST for short files, async queues (BullMQ) for batch processing, WebSocket for real-time streaming, and a hybrid router for mixed workloads. Use this when designing production-grade audio processing pipelines.

Guides engineers through DeepSpeed distributed training and NVMe I/O optimizations, covering ZeRO, pipeline parallelism, mixed precision, and DeepNVMe handles for synchronous and asynchronous tensor storage.

This guide outlines advanced architectural patterns for building multi-stage CI/CD pipelines. It covers best practices for implementing robust deployment gates, including manual approvals, time-based triggers, and multi-approver workflows. It details various deployment strategies like Rolling, Blue-Green, and Canary releases, ensuring controlled, zero-downtime, and highly reliable software releases.

Automates Detrack operations through Composio’s Rube MCP toolkit by discovering available tools, managing connections, and executing workflows with schema-compliant arguments; ideal for teams integrating Detrack tasks inside Rube-driven pipelines.