Skill UI

This skill provides expert guidance for modern, multi-cloud database administration. It covers comprehensive knowledge across AWS, Azure, and GCP platforms, spanning relational, NoSQL, and graph databases. Key areas include Infrastructure as Code (Terraform, Flyway), achieving high availability, disaster recovery, advanced performance optimization, and ensuring strict regulatory compliance (HIPAA, GDPR). It is essential for managing complex, highly reliable cloud data architectures.

An expert architect specializing in designing, optimizing, and scaling entire data layers from inception (greenfield) to re-architecture. Proficient in selecting the optimal database technology (SQL, NoSQL, Graph, Time-series), designing robust schemas, implementing sophisticated indexing strategies, and planning complex migration paths. Suitable for defining data storage solutions that meet high performance, scalability, and data integrity requirements.

This skill simulates a cloud cost optimization expert specializing in reducing infrastructure expenses across AWS, Azure, and GCP. It analyzes complex cloud spending patterns, identifies waste, overprovisioning, and potential savings opportunities. It provides actionable recommendations, implements cost controls, and proposes cost-effective, reliable architectures, ensuring cost efficiency without sacrificing performance or reliability.

This skill automates the creation of comprehensive documentation for relational databases (PostgreSQL/MySQL). By introspecting live schemas, it extracts detailed metadata including table structures, column descriptions, primary/foreign key relationships, indexes, views, and stored procedures. The output provides a data dictionary, entity-relationship map, and schema statistics, crucial for knowledge transfer and database lifecycle management.

A comprehensive guide covering best practices for database migrations. It addresses schema changes, data migrations, and rollbacks for major databases (PostgreSQL, MySQL) and modern ORMs (Prisma, Drizzle, etc.). Learn how to implement safe, reversible, and zero-downtime schema updates for production environments.

This guide provides expert patterns for building robust, observable infrastructure for database migrations. It covers real-time monitoring using Change Data Capture (CDC), metrics collection (Prometheus/Grafana), and anomaly detection. Use this skill when setting up CDC pipelines (e.g., Debezium with Kafka) or implementing comprehensive observability for database schema changes and data synchronization processes.

Actionable guidance for analyzing plans, indexing, connection pooling, partitioning, and detecting N+1 queries to keep PostgreSQL and MySQL workloads fast and reliable.

This skill details how to set up automated CI/CD pipelines for Databricks data pipelines. It leverages Declarative Automation Bundles (DABs) and GitHub Actions to manage the entire deployment lifecycle. Key functionalities include running unit tests on pull requests, validating and deploying to staging environments, and promoting validated code to production upon merge, ensuring reliable and automated data infrastructure.

This guide provides comprehensive, code-based solutions for diagnosing and fixing common errors encountered in Databricks environments. It covers critical issues such as cluster state failures, Spark OutOfMemory errors, Delta Lake concurrency conflicts, permission problems, and schema mismatches, offering tailored fixes in Python, SQL, and Bash.

This comprehensive guide outlines the end-to-end process of building production-grade ETL data pipelines using Databricks and Delta Lake. It implements the robust Medallion Architecture (Bronze, Silver, Gold) for scalable data management. Techniques covered include Auto Loader for incremental streaming ingestion, MERGE INTO for upsert semantics, data cleansing, and advanced aggregation into analytics-ready layers. Ideal for establishing reliable data pipelines in a data lakehouse environment.

This guide provides a comprehensive framework for minimizing cloud expenditure on Databricks. It covers identifying cost drivers via system billing tables, implementing cluster policies, utilizing spot instances for batch processing, right-sizing SQL warehouses, and automating the shutdown of idle development clusters. Use it when managing cloud spending or optimizing data platform usage.

This skill provides a comprehensive guide on implementing robust data governance patterns within Delta Lake, leveraging Unity Catalog. It covers essential compliance topics such as data classification tagging, handling GDPR 'right-to-deletion' requests for PII, and establishing automated data retention policies. Use this when designing secure, compliant, and auditable data pipelines in a data lake environment.