Skill UI

An expert architect specializing in designing, optimizing, and scaling entire data layers from inception (greenfield) to re-architecture. Proficient in selecting the optimal database technology (SQL, NoSQL, Graph, Time-series), designing robust schemas, implementing sophisticated indexing strategies, and planning complex migration paths. Suitable for defining data storage solutions that meet high performance, scalability, and data integrity requirements.

This skill simulates a cloud cost optimization expert specializing in reducing infrastructure expenses across AWS, Azure, and GCP. It analyzes complex cloud spending patterns, identifies waste, overprovisioning, and potential savings opportunities. It provides actionable recommendations, implements cost controls, and proposes cost-effective, reliable architectures, ensuring cost efficiency without sacrificing performance or reliability.

A comprehensive, expert-level skill for designing, analyzing, and optimizing robust database schemas. It covers normalization, index tuning, choosing between SQL/NoSQL, and implementing zero-downtime data migrations. Provides systematic workflows for schema analysis, performance modeling, and advanced SQL pattern generation.

Master the advanced process of database schema and data migrations across major ORMs (Sequelize, TypeORM, Prisma). This skill provides best practices for handling complex transformations, including implementing zero-downtime deployments, renaming columns, changing data types, and executing complex data restructuring. It emphasizes robust rollback strategies to ensure data integrity during critical database updates.

Specializes in generating production-grade SQL database migrations with zero-downtime strategies for PostgreSQL, MySQL, and SQL Server. Provides comprehensive plans covering data integrity, detailed rollback procedures, performance optimization, and validation checks for critical schema changes.

A specialized skill for optimizing database performance and scalability across PostgreSQL and MySQL. It guides users through analyzing slow queries, interpreting execution plans (EXPLAIN ANALYZE), designing optimal indexing strategies, tuning configuration parameters, and resolving bottlenecks like lock contention. Essential for DevOps engineers, database administrators, and backend developers.

Offers automated guidance for database query profiler tasks in performance testing, including best practices, code/config generation, and validation when working with load/stress benchmarking.

This guide provides a comprehensive framework for minimizing cloud expenditure on Databricks. It covers identifying cost drivers via system billing tables, implementing cluster policies, utilizing spot instances for batch processing, right-sizing SQL warehouses, and automating the shutdown of idle development clusters. Use it when managing cloud spending or optimizing data platform usage.

A comprehensive guide for establishing robust, enterprise-grade access control within Databricks. Covers implementing Single Sign-On (SSO) via SCIM, leveraging Unity Catalog for fine-grained Role-Based Access Control (RBAC), defining cluster policies, and enforcing data governance measures like Row-Level Security (RLS) and column masking. Essential for large-scale, secure data platforms.

This comprehensive guide details strategies for migrating enterprise data platforms to Databricks. It provides PySpark examples for discovery, schema mapping (converting types from Hadoop, Snowflake, etc.), and executing robust data transfer methods like SYNC, DEEP CLONE, and CTAS. Use this when moving data from legacy sources like Hadoop, Snowflake, or Redshift to a modern Delta Lake environment.

This skill provides comprehensive observability for the Databricks platform. It enables users to monitor job run histories, track cluster utilization and associated costs (DBU), detect slow SQL queries, and audit access logs. Use it for setting up robust monitoring dashboards, ensuring pipeline health, and optimizing resource consumption across the entire data stack.

A comprehensive guide detailing optimization techniques for Databricks environments. It covers optimal cluster sizing for various workloads (ETL, ML, Streaming), advanced Spark configurations (AQE, memory management), and deep data optimization strategies for Delta Lake, including Z-Ordering and Liquid Clustering. It also provides methods for query plan analysis and join optimization.