Skill UI

This skill provides robust, automated guardrails for web scraping pipelines using Firecrawl. It enforces critical policies to ensure compliance and stability, including domain blocklists (preventing scraping prohibited sites), managing API credit budgets, filtering low-quality content (e.g., error pages, thin content), and implementing granular per-domain rate limiting. Use this when building highly reliable, legal, and cost-efficient scraping solutions.

A comprehensive checklist for securely deploying and validating applications using Firecrawl's core APIs (scrape, crawl, map, extract) in a production environment. It covers critical areas including secure credential management, implementing crawl safety limits, robust error handling (rate limits, authentication failures), establishing monitoring alerts, and executing necessary rollback procedures.

This comprehensive reference architecture details a multi-stage pipeline for web scraping and content ingestion using Firecrawl. It seamlessly integrates single-page scraping, site-wide crawling, URL mapping, and structured data extraction. The subsequent processing layer handles cleaning, deduplication, and chunking, making this blueprint ideal for designing robust knowledge bases, RAG systems, and complex AI data pipelines.

A comprehensive guide to implementing production-grade reliability patterns for web scraping pipelines using Firecrawl. Learn techniques such as circuit breakers, crawl fallbacks, content quality validation, and robust backoff strategies to handle timeouts, API failures, and inconsistent data quality, ensuring maximum uptime and data integrity.

This skill provides deep web scraping capabilities, allowing users to extract complex content, take screenshots, and parse PDFs from web pages. It handles advanced interactions like clicking and scrolling, making it ideal for detailed data gathering, batch URL processing, and complex web content analysis.

Comprehensive guide for upgrading the Firecrawl SDK and migrating between major API versions (v0 to v1/v2). It details breaking changes across key functions like `crawlUrl`, `scrapeUrl`, and the new extract schema format. Use this when updating dependencies or transitioning from legacy API structures to the latest v2 standard.

A comprehensive skill designed to perform deep SEO audits for any website type, including SaaS, e-commerce, and local businesses. It covers technical SEO (crawlability, Core Web Vitals), content quality (E-E-A-T), schema markup, image optimization, local SEO, and readiness for AI Overviews. Provides actionable reports and optimized content briefs.

A comprehensive audit tool covering critical aspects of technical SEO, including crawlability, indexability, security headers, Core Web Vitals (LCP, INP, CLS), and robust structured data implementation. It provides expert guidance on modern challenges, such as managing AI-specific web crawlers (e.g., GPTBot, ClaudeBot) and optimizing for mobile-first indexing and JavaScript rendering best practices.

Performs a full GEO audit of any website by discovering business type, crawling prioritized pages, and delegating parallel subagents to evaluate AI visibility, platform readiness, technical infrastructure, EEAT content, and schema markup, then outputs a composite GEO score with prioritized actions.

Analyzes a website's accessibility to major AI crawlers (e.g., GPTBot, ClaudeBot). It checks robots.txt, meta tags, and HTTP headers to generate a complete access map. This helps users optimize their site structure to maximize visibility in AI-generated search results while maintaining appropriate control over data usage.

Generates and validates llms.txt files, the emerging standard that tells AI systems how to prioritize and understand a website; crawls content, ranks pages, and enforces formatting so your brand narrative stays consistent.

Performs a GEO-focused technical SEO audit covering crawlability, indexability, security, performance, SSR, and AI crawler access to keep both search engines and AI agents from losing visibility.