Skill UI

A comprehensive guide to building production-ready Apache Airflow Directed Acyclic Graphs (DAGs). This skill covers best practices for operators, sensors, testing, deployment, and designing robust data pipelines. Use this when orchestrating complex workflows, managing ETL processes, or ensuring reliable batch job execution in a production environment.

Guides you through building Airflow operators for data pipelines with automated best practices, production-ready code/config generation, and validation for ETL, transformation, orchestration, and streaming scenarios.

Automates building and evaluating classification models by analyzing datasets, selecting features, tuning hyperparameters, and reporting metrics via the classification-model-builder plugin for supervised learning requests.

Builds AutoML pipelines by analyzing user requests, generating code for data preparation, model selection, hyperparameter tuning, validation, and metrics, then documenting artifacts for streamlined automated machine learning workflows.

Generates Python code and workflows for collaborative, content-based, or hybrid recommendation models, handling data prep, training, evaluation, and scalability so Claude can deliver tailored suggestions across domains.

Guides you through building Dagster data pipelines with best-practice advice, ready-to-use configurations, and validation checks for ETL, transformation, orchestration, and streaming workflows whenever the Dagster pipeline creator skill is activated.

A comprehensive, end-to-end workflow for building product features guided by rigorous data insights. This skill guides users through the entire lifecycle, encompassing exploratory data analysis, forming measurable business hypotheses, designing statistical A/B tests, architecting data pipelines, and implementing robust backend/frontend instrumentation. It ensures that every feature iteration is validated by data and measured for impact.

This skill provides production patterns for implementing robust data quality validation using Great Expectations, dbt tests, and formal data contracts. It is essential for building reliable, automated, and verifiable data pipelines, ensuring data integrity throughout the entire ETL/ELT process, and establishing clear data governance rules.

A comprehensive workflow for executing advanced, semantic web searches using Exa. This tool moves beyond simple keyword matching, enabling deep context retrieval by understanding the intent behind the query. Key features include RAG context retrieval, content extraction (summaries, highlights, full text), and robust filtering by date range, specific domains, and content categories. Ideal for building knowledge base search features and complex research pipelines.

This workflow provides the primary mechanism for converting complex, live websites into clean, LLM-ready markdown content. It supports single-page scraping using `scrapeUrl`, deep multi-page site crawling with `crawlUrl`, and scalable async crawling for large datasets. Ideal for building robust content ingestion pipelines and reliably extracting structured information from the web.

Firecrawl provides a comprehensive API for web data harvesting. It enables users to perform single-page scraping, multi-page crawling, site mapping (URL discovery), and advanced structured data extraction using Large Language Models (LLMs). Ideal for integrating data pipelines, building web monitoring tools, or conducting market research.

Master the implementation of Firecrawl webhooks for robust, real-time handling of asynchronous crawling and batch scraping jobs. Instead of inefficiently polling the crawl status, configure webhook endpoints to receive instant POST events (e.g., `crawl.page`, `crawl.completed`). This guide covers event types, signature verification using HMAC-SHA256, and processing streamed data for building advanced data pipelines.