Skill UI

This comprehensive workflow guides the entire database lifecycle, from initial architecture design (covering both SQL and NoSQL) to advanced implementation, optimization, and maintenance. It covers crucial stages like schema design, implementing migrations, optimizing query performance, developing robust data pipelines (using tools like Airflow and dbt), and managing data quality and operations. Ideal for engineers building complex, production-grade data systems.

This guide provides expert patterns for building robust, observable infrastructure for database migrations. It covers real-time monitoring using Change Data Capture (CDC), metrics collection (Prometheus/Grafana), and anomaly detection. Use this skill when setting up CDC pipelines (e.g., Debezium with Kafka) or implementing comprehensive observability for database schema changes and data synchronization processes.

This comprehensive guide outlines the end-to-end process of building production-grade ETL data pipelines using Databricks and Delta Lake. It implements the robust Medallion Architecture (Bronze, Silver, Gold) for scalable data management. Techniques covered include Auto Loader for incremental streaming ingestion, MERGE INTO for upsert semantics, data cleansing, and advanced aggregation into analytics-ready layers. Ideal for establishing reliable data pipelines in a data lakehouse environment.

This skill provides a comprehensive guide on implementing robust data governance patterns within Delta Lake, leveraging Unity Catalog. It covers essential compliance topics such as data classification tagging, handling GDPR 'right-to-deletion' requests for PII, and establishing automated data retention policies. Use this when designing secure, compliant, and auditable data pipelines in a data lake environment.

A comprehensive guide detailing the setup process for Databricks CLI v2 and Python SDK. It covers essential steps for connecting to various Databricks workspaces, including configuring Personal Access Tokens (PAT), interactive OAuth U2M flows, and secure OAuth M2M service principals for CI/CD pipelines. Essential for developers integrating Databricks into their projects.

This skill guides the setup and management of Databricks resources across development, staging, and production environments. It covers best practices for using isolated workspaces, managing environment-specific secrets, implementing Asset Bundles, and integrating with CI/CD pipelines to ensure consistent and reliable data deployments.

This skill provides comprehensive observability for the Databricks platform. It enables users to monitor job run histories, track cluster utilization and associated costs (DBU), detect slow SQL queries, and audit access logs. Use it for setting up robust monitoring dashboards, ensuring pipeline health, and optimizing resource consumption across the entire data stack.

This comprehensive guide sets up a robust CI/CD pipeline for Deepgram integrations using GitHub Actions. It covers unit tests (mocked SDK), full integration tests against the live Deepgram API (including transcription, diarization, and TTS), and smoke tests. Use this when establishing automated testing, ensuring deployment stability, or implementing continuous delivery workflows for Deepgram-powered applications.

This skill provides comprehensive methods to optimize Deepgram API usage and manage costs. It implements budget-aware transcription pipelines that preemptively check projected spending against set limits, utilizes audio preprocessing techniques (like silence removal via ffmpeg) to minimize billable minutes, and includes API calls to monitor current usage and spending against defined budgets. Ideal for cost-sensitive, production-grade deployments.

Implements best practices for secure audio transcription using Deepgram. This guide covers PII redaction (built-in and custom patterns), secure audio upload to S3 with encryption, managing data retention policies, and ensuring compliance with major regulations like GDPR and HIPAA. It provides a comprehensive pipeline for handling sensitive audio data in enterprise applications.

Provides reference architectures for building high-scale, reliable transcription systems using Deepgram. It covers four main patterns: synchronous REST for short files, async queues (BullMQ) for batch processing, WebSocket for real-time streaming, and a hybrid router for mixed workloads. Use this when designing production-grade audio processing pipelines.

Provides production-ready coding patterns for integrating Deepgram using TypeScript and Python. This guide covers essential best practices, including implementing singleton client management, performing text-to-speech synthesis with Aura, and setting up advanced audio intelligence pipelines (e.g., summarization, topic detection, sentiment analysis). Use this when establishing robust Deepgram integration standards, refactoring existing SDK usage, or migrating to newer SDK versions.