Skill UI

Expert in designing, building, and optimizing scalable data pipelines, modern data warehouses, and real-time streaming architectures. Mastery covers the complete modern data stack, including Spark, dbt, Airflow, and cloud services (AWS, Azure, GCP). Focuses on ELT/ETL, data lakehouse implementation (Delta Lake, Iceberg), data governance, and ensuring high data quality and operational reliability.

An expert in designing, implementing, and optimizing scalable, reliable, and cost-effective data pipelines for both batch and streaming data. Covers advanced topics including ETL/ELT patterns, Kappa/Lambda architectures, workflow orchestration (Airflow/Prefect), transformation using dbt/Spark, and managing modern storage formats like Delta Lake and Iceberg. Focuses heavily on data quality, monitoring, and cost optimization strategies.

This skill provides production patterns for implementing robust data quality validation using Great Expectations, dbt tests, and formal data contracts. It is essential for building reliable, automated, and verifiable data pipelines, ensuring data integrity throughout the entire ETL/ELT process, and establishing clear data governance rules.

This comprehensive workflow guides the entire database lifecycle, from initial architecture design (covering both SQL and NoSQL) to advanced implementation, optimization, and maintenance. It covers crucial stages like schema design, implementing migrations, optimizing query performance, developing robust data pipelines (using tools like Airflow and dbt), and managing data quality and operations. Ideal for engineers building complex, production-grade data systems.

Guides you through generating dbt models inside data pipelines, covering setup, code generation, configuration, and validation while following best practices for ETL, orchestration, and streaming workloads.

Automates dbt test creation within data pipelines, offering guided best practices, code generation, and validation to keep ETL, transformation, and streaming workflows reliable.

A guide to production-ready patterns for dbt (data build tool). It covers essential practices for robust data pipeline development, including model organization (staging, intermediate, marts), implementing advanced testing strategies, ensuring data quality, and optimizing incremental processing for large datasets.

This comprehensive guide details the expertise needed for a Senior Data Engineer. It covers building, optimizing, and governing scalable data pipelines and robust ETL/ELT systems using modern tools like Spark, Kafka, Airflow, and dbt. Includes decision frameworks for architecting data solutions (Batch vs Streaming, Lakehouse vs Warehouse) and implementing advanced data modeling patterns.

Comprehensive Snowflake development assistant covering SQL best practices, dynamic tables, streams, tasks, Snowpipe, Cortex AI functions/agents, Snowpark Python, dbt integration, performance tuning, and security hardening for production data platforms.

Surfaces Monte Carlo data observability insights—health, lineage, alerts, and monitors-as-code—before developers edit dbt models or SQL pipelines, ensuring risk-aware code changes.

This skill automatically generates an interactive SQL Notebook designed to validate changes in dbt models or snapshots. It processes changes identified from a GitHub PR or local repository, generating comparison queries that compare 'before' (production) and 'after' (development) data states. It is essential for embedding data observability and quality checks into CI/CD pipelines.

Satori is a sophisticated AI wisdom companion that merges advanced clinical psychology frameworks (such as IFS, DBT, and Schema Therapy) with diverse philosophical traditions (like Stoicism, Jungian depth psychology, and Buddhism). It functions as a structured thinking partner, guiding users through deep self-exploration, internal conflicts, and existential questions to foster profound personal insight.