Skill UI

This comprehensive checklist guides users through validating and preparing Clay enrichment pipelines for a production launch. It covers critical areas including table schema finalization, data quality gates (validation, deduplication), credit cost management, webhook reliability testing, and establishing robust monitoring and alerting procedures before going live.

Automates schema validation within data pipelines, providing guidance on best practices, workflow orchestration, and streaming ETL scenarios while producing production-ready code and configurations.

LaminDB is a Python-driven open-source framework for managing biological datasets, ensuring traceable, reproducible, FAIR data through lineage tracking, schema validation, ontology annotation, workflow integration, and lakehouse-style querying.

This skill safely randomizes the order of repetitive JSON objects within an array without corrupting the data or breaking the JSON syntax. It acts as a data engineer, rigorously validating the input schema (checking for property consistency and lack of nesting) before performing the shuffle. It ensures data integrity is maintained while reordering records, making it ideal for testing, simulation, or data preparation workflows.

A comprehensive guide detailing the process of migrating data warehouses to Snowflake from major sources like Amazon Redshift, Google BigQuery, or on-premise databases. This resource covers critical steps including schema conversion (handling dialect differences like STRUCT/ARRAY to VARIANT), robust data transfer methods (S3/Cloud Storage, Python/Pandas), data validation techniques (checksums, row counts), and essential SQL syntax translation patterns.

This powerful tool compares identical tables across two SQL Server instances (e.g., Production vs. Staging). It efficiently detects missing rows, extra columns, schema drifts, and data mismatches. Leveraging Python and Apache Arrow for fast columnar data transfer, it provides a comprehensive reconciliation report, making it essential for data migration validation and ETL verification.

A comprehensive guide on querying data stored in Fabric's OneLake using DuckDB. This skill supports two operational modes: local command line interface (CLI) for ad-hoc analysis, and in-notebook mode for seamless integration within Fabric notebooks. It can read Delta Lake tables and various raw formats (Parquet, CSV, JSON), making it ideal for data exploration, validation, and schema discovery in a read-only fashion.

Generates SQL validation notebooks for dbt PR changes with before/after comparison queries. Supports GitHub PR URLs and local repositories. Creates interactive notebooks for database validation across Snowflake, BigQuery, Redshift, and Athena. Includes schema inference from dbt_project.yml and model configs.

This skill helps plan and review read-only data warehouse analysis with explicit scope, privacy, and validation checks. It turns business questions into reproducible analysis plans without assuming specific schemas. It identifies needed data, reviews proposed queries for risks like grain or privacy, and ensures results are communicated accurately. Suitable for authorized data warehouse usage, query review, and analysis documentation while avoiding administrative tasks.