Skill UI

A comprehensive, end-to-end workflow for building product features guided by rigorous data insights. This skill guides users through the entire lifecycle, encompassing exploratory data analysis, forming measurable business hypotheses, designing statistical A/B tests, architecting data pipelines, and implementing robust backend/frontend instrumentation. It ensures that every feature iteration is validated by data and measured for impact.

This skill provides production patterns for implementing robust data quality validation using Great Expectations, dbt tests, and formal data contracts. It is essential for building reliable, automated, and verifiable data pipelines, ensuring data integrity throughout the entire ETL/ELT process, and establishing clear data governance rules.

Automates database schema design guidance for backend projects, activating whenever you ask about schema patterns, best practices, or implementation in node.js, Python, Go, microservices, caching, or messaging contexts.

This comprehensive guide outlines the end-to-end process of building production-grade ETL data pipelines using Databricks and Delta Lake. It implements the robust Medallion Architecture (Bronze, Silver, Gold) for scalable data management. Techniques covered include Auto Loader for incremental streaming ingestion, MERGE INTO for upsert semantics, data cleansing, and advanced aggregation into analytics-ready layers. Ideal for establishing reliable data pipelines in a data lakehouse environment.

This skill provides a comprehensive guide on implementing robust data governance patterns within Delta Lake, leveraging Unity Catalog. It covers essential compliance topics such as data classification tagging, handling GDPR 'right-to-deletion' requests for PII, and establishing automated data retention policies. Use this when designing secure, compliant, and auditable data pipelines in a data lake environment.

A comprehensive guide for establishing robust, enterprise-grade access control within Databricks. Covers implementing Single Sign-On (SSO) via SCIM, leveraging Unity Catalog for fine-grained Role-Based Access Control (RBAC), defining cluster policies, and enforcing data governance measures like Row-Level Security (RLS) and column masking. Essential for large-scale, secure data platforms.

This comprehensive checklist guides the deployment of Databricks data pipelines and jobs to a production environment. It covers critical stages including pre-deployment security hardening (Service Principals, Unity Catalog), validating infrastructure (cluster types, autoscaling), ensuring code quality (unit/integration tests, Delta Lake best practices), executing controlled deployment, and performing post-deployment health checks and monitoring setup. Ideal for CI/CD pipelines and go-live procedures.

This guide outlines a production-ready lakehouse architecture using Unity Catalog, Delta Lake, and the Medallion pattern. It provides best practices for organizing Databricks workspaces, implementing three-level governance, defining compute strategies, and adopting CI/CD best practices with Asset Bundles for robust team collaboration.

A comprehensive guide to implementing best practices for security within Databricks. Learn how to manage secrets using scoped storage, enforce the principle of least privilege via Unity Catalog grants, audit API tokens, and apply advanced data protection techniques like column-level masking and row-level security for enhanced data governance and compliance.

This guide provides essential best practices for building reliable, fault-tolerant applications in Go using DBOS durable workflows. It covers architectural patterns for integrating DBOS into existing Go code, defining complex workflows, managing steps, and utilizing queues for robust concurrency control. Essential reading for developers setting up, configuring, or testing mission-critical asynchronous processes.

This guide offers a comprehensive deep dive into migrating existing voice transcription workflows from multiple major providers, including AWS Transcribe, Google Cloud STT, OpenAI Whisper, and others, to Deepgram. It details feature mapping, best practices, and implements an adapter pattern, enabling seamless, reliable, and validated service switching.

A comprehensive checklist and guide for deploying Deepgram integrations into a production environment. It covers critical areas including robust authentication practices, system resilience design (e.g., backoff strategies, circuit breakers), performance optimization (singleton clients, audio preprocessing), security measures (PII redaction), and mandatory monitoring setup (Prometheus metrics and alert rules). Essential for any go-live phase.