Skill UI

Guides users through setting up monitoring for data pipelines, covering ETL, transformation, orchestration, streaming, and validation with best-practice code and configuration.

Automated assistance for pyspark transformer work within data pipelines, activating when you request transformer patterns or best practices and covering ETL, data transformation, orchestration, and streaming scenarios.

Automates spark job creation within data pipelines by guiding etl, transformation, orchestration, and streaming workflows; includes industry best practices, code templates, and validation to deliver production-ready jobs.

Automates Spark SQL optimizer tasks in data pipelines by guiding best practices, producing production-ready code and configurations, and validating ETL, transformation, orchestration, and streaming workflows.

Automated guidance for SQL transform helper tasks within data pipelines, covering ETL, data transformation, workflow orchestration, and streaming, while following best practices, generating production-ready code, and validating results.

A comprehensive skill for managing the entire lifecycle of datasets on the Hugging Face Hub. It allows users to initialize, configure, and stream updates for datasets of various types (Chat, Text Classification, Tabular). Crucially, it extends data handling capabilities by enabling powerful SQL-based querying and transformation directly on Hub datasets using the DuckDB engine, facilitating advanced data exploration and pipeline creation.

Astropy is the fundamental Python package for astronomical research and astrophysics data processing. It provides essential tools for handling physical units, performing coordinate transformations across celestial frames (ICRS, Galactic, etc.), managing FITS files, conducting cosmological calculations, and precise time handling. It is indispensable for any task involving celestial coordinates, unit conversions, or analyzing large astronomical catalogs.

This comprehensive guide provides advanced workflows for interacting with ClickHouse. It covers efficient bulk data insertion (CSV, JSON), complex analytical querying (funnel analysis, retention), implementing materialized views for pre-aggregation, and utilizing powerful window functions. Ideal for building high-performance OLAP dashboards and executing large-scale data transformations.

This skill guides the setup of CI/CD pipelines for Hex data analytics projects using GitHub Actions. It enables running automated unit tests on pull requests and triggering live project runs on the main branch merge. Use this when establishing automated testing workflows, validating data transformation logic, or integrating Hex outputs into a continuous delivery process.

A comprehensive guide for migrating data to, from, and between Notion workspaces. This skill covers complex data pipelines, including rate-limited bulk imports (CSV/JSON), full database exports with pagination, cross-database syncing, and data transformation patterns for integrating content from sources like Confluence and Google Docs. Essential for building robust Notion ETL workflows.

Master the creation of robust ELT (Extract, Load, Transform) data pipelines within Snowflake. This guide demonstrates advanced data orchestration using Snowflake Streams for Change Data Capture (CDC), Tasks for scheduled transformations and DAG management, and Dynamic Tables for declarative, auto-refreshing data models. Ideal for building sophisticated, scalable data warehousing solutions.

Run arbitrary PySpark or pure Python code directly on Fabric Spark compute using the Livy API. These sessions are ephemeral, meaning no notebook artifacts are created or persisted, making it ideal for automated ETL processes, programmatic data transformations, or agent-driven compute workflows. Provides full read/write access to lakehouse Delta tables via Spark SQL.