Skill UI

Guides data engineering patterns for ETL pipelines, Spark analytics, and quality checks, showcasing Python and SQL snippets to extract, transform, load, validate, and model sales data in modern warehouses.

An expert in designing, implementing, and optimizing scalable, reliable, and cost-effective data pipelines for both batch and streaming data. Covers advanced topics including ETL/ELT patterns, Kappa/Lambda architectures, workflow orchestration (Airflow/Prefect), transformation using dbt/Spark, and managing modern storage formats like Delta Lake and Iceberg. Focuses heavily on data quality, monitoring, and cost optimization strategies.

Offers automated guidance for implementing data lineage trackers across ETL and streaming pipelines, including best practices on transformations, orchestration, and validation for production environments.

Automated Data Quality Checker offers guidance, best practices, and production-ready code for validating pipelines whenever you work with ETL, streaming, or data transformation scenarios.

This skill guides the process of transforming complex, raw data into compelling, actionable narratives. It covers the core structure (Setup, Conflict, Resolution), narrative arcs, and the three pillars (Data, Narrative, Visuals) needed to create high-impact presentations for executives, investors, and non-technical stakeholders. It ensures insights drive clear decisions.

This skill automates the creation of comprehensive documentation for relational databases (PostgreSQL/MySQL). By introspecting live schemas, it extracts detailed metadata including table structures, column descriptions, primary/foreign key relationships, indexes, views, and stored procedures. The output provides a data dictionary, entity-relationship map, and schema statistics, crucial for knowledge transfer and database lifecycle management.

Master the advanced process of database schema and data migrations across major ORMs (Sequelize, TypeORM, Prisma). This skill provides best practices for handling complex transformations, including implementing zero-downtime deployments, renaming columns, changing data types, and executing complex data restructuring. It emphasizes robust rollback strategies to ensure data integrity during critical database updates.

This comprehensive guide details strategies for migrating enterprise data platforms to Databricks. It provides PySpark examples for discovery, schema mapping (converting types from Hadoop, Snowflake, etc.), and executing robust data transfer methods like SYNC, DEEP CLONE, and CTAS. Use this when moving data from legacy sources like Hadoop, Snowflake, or Redshift to a modern Delta Lake environment.

Automates dbt test creation within data pipelines, offering guided best practices, code generation, and validation to keep ETL, transformation, and streaming workflows reliable.

A guide to production-ready patterns for dbt (data build tool). It covers essential practices for robust data pipeline development, including model organization (staging, intermediate, marts), implementing advanced testing strategies, ensuring data quality, and optimizing incremental processing for large datasets.

Automate Dnsfilter operations by discovering current Rube MCP schemas, checking toolkit connections, and orchestrating RUBE_MULTI_EXECUTE_TOOL calls with schema-compliant arguments while always reusing sessions and memory placeholders.

A comprehensive guide for selecting and optimizing embedding models for advanced vector search and retrieval-augmented generation (RAG) applications. This guide covers model comparison, chunking strategies, dimension reduction techniques, and provides runnable Python templates for both OpenAI and local Sentence Transformer implementations.