Skill UI

This comprehensive checklist guides users through validating and preparing Clay enrichment pipelines for a production launch. It covers critical areas including table schema finalization, data quality gates (validation, deduplication), credit cost management, webhook reliability testing, and establishing robust monitoring and alerting procedures before going live.

Automates schema validation within data pipelines, providing guidance on best practices, workflow orchestration, and streaming ETL scenarios while producing production-ready code and configurations.

LaminDB is a Python-driven open-source framework for managing biological datasets, ensuring traceable, reproducible, FAIR data through lineage tracking, schema validation, ontology annotation, workflow integration, and lakehouse-style querying.

This skill safely randomizes the order of repetitive JSON objects within an array without corrupting the data or breaking the JSON syntax. It acts as a data engineer, rigorously validating the input schema (checking for property consistency and lack of nesting) before performing the shuffle. It ensures data integrity is maintained while reordering records, making it ideal for testing, simulation, or data preparation workflows.

A comprehensive guide detailing the process of migrating data warehouses to Snowflake from major sources like Amazon Redshift, Google BigQuery, or on-premise databases. This resource covers critical steps including schema conversion (handling dialect differences like STRUCT/ARRAY to VARIANT), robust data transfer methods (S3/Cloud Storage, Python/Pandas), data validation techniques (checksums, row counts), and essential SQL syntax translation patterns.

This powerful tool compares identical tables across two SQL Server instances (e.g., Production vs. Staging). It efficiently detects missing rows, extra columns, schema drifts, and data mismatches. Leveraging Python and Apache Arrow for fast columnar data transfer, it provides a comprehensive reconciliation report, making it essential for data migration validation and ETL verification.

This skill enables querying Delta Lake tables and raw files stored in OneLake using DuckDB. It supports two primary modes: local execution via CLI/Python for ad-hoc analysis, and in-notebook execution within Fabric, combining DuckDB's speed with notebook context. Ideal for data exploration, schema discovery, and data quality validation across the Fabric ecosystem.