Skill UI

A comprehensive guide to selecting and implementing the optimal Firecrawl architecture pattern for various data ingestion needs. Learn to choose between On-Demand, Scheduled Crawl Pipelines, and Real-Time Ingestion Pipelines based on data volume, required latency, and complexity. This is essential for designing scalable, production-grade scraping infrastructure, including RAG and knowledge base applications.

Firecrawl Automation lets you use Claude Code to scrape pages, crawl sites, batch URLs, extract structured data, and monitor jobs via the Composio integration, ideal for terminal-driven web data pipelines.

This workflow provides the primary mechanism for converting complex, live websites into clean, LLM-ready markdown content. It supports single-page scraping using `scrapeUrl`, deep multi-page site crawling with `crawlUrl`, and scalable async crawling for large datasets. Ideal for building robust content ingestion pipelines and reliably extracting structured information from the web.

This advanced workflow executes sophisticated web data gathering tasks. It supports three primary functions: LLM-powered structured data extraction using custom JSON schemas or prompts; efficient batch scraping of multiple known URLs; and rapid site mapping to discover all reachable URLs on a domain. Use this when you require reliable, typed data structures rather than raw markdown content.

A comprehensive pipeline for processing, validating, and optimizing scraped web content from Firecrawl. This tool handles markdown cleaning, structured data extraction using Zod validation, content deduplication, and chunking tailored for Large Language Models (LLMs) and Retrieval-Augmented Generation (RAG) systems. It ensures crawled data is standardized, clean, and ready for downstream consumption or knowledge base indexing.

Firecrawl provides a comprehensive API for web data harvesting. It enables users to perform single-page scraping, multi-page crawling, site mapping (URL discovery), and advanced structured data extraction using Large Language Models (LLMs). Ideal for integrating data pipelines, building web monitoring tools, or conducting market research.

A comprehensive guide for migrating web scraping pipelines from tools like Puppeteer, Playwright, and Cheerio to Firecrawl. This skill demonstrates how to replace complex, browser-intensive code with simple API calls, handling single-page scraping, structured data extraction using LLMs, and large-scale site crawling, while eliminating the need for manual browser management and anti-bot workarounds.

This comprehensive reference architecture details a multi-stage pipeline for web scraping and content ingestion using Firecrawl. It seamlessly integrates single-page scraping, site-wide crawling, URL mapping, and structured data extraction. The subsequent processing layer handles cleaning, deduplication, and chunking, making this blueprint ideal for designing robust knowledge bases, RAG systems, and complex AI data pipelines.

Comprehensive guide for upgrading the Firecrawl SDK and migrating between major API versions (v0 to v1/v2). It details breaking changes across key functions like `crawlUrl`, `scrapeUrl`, and the new extract schema format. Use this when updating dependencies or transitioning from legacy API structures to the latest v2 standard.

This workflow connects to the Fireflies.ai API via GraphQL to fetch and process detailed meeting transcripts. It handles speaker-diarized data, extracting structured insights such as action items, key topics, sentiment analysis, and speaker breakdowns. It enables the creation of comprehensive meeting intelligence reports and robust downstream pipelines. Use this when you need to automate the retrieval, summarization, or deep analysis of recorded meeting content.

A comprehensive runbook for rapidly responding to Fireflies.ai integration failures. Provides structured triage steps, P1-P4 severity assessment, and detailed remediation guides for common issues like API key expirations, rate limiting, and webhook discrepancies. Essential for on-call engineers during platform outages.

This guide details a complete local development workflow for integrating with Fireflies.ai GraphQL. It outlines setting up the project structure, recording real API responses as mock fixtures, creating a custom mock client, and writing robust unit tests. Use this methodology to ensure fast, reliable, and isolated development cycles without dependency on live APIs or worrying about rate limits.