Skill UI

This skill provides advanced techniques to significantly reduce API costs when using Firecrawl for web scraping. It covers best practices such as setting crawl limits, utilizing batch scraping for known URLs, implementing local caching, and monitoring credit usage. Learn how to efficiently scrape large sites while managing budgets and minimizing unexpected billing spikes.

This guide outlines how to implement robust Role-Based Access Control (RBAC) for Firecrawl scraping resources. It allows enterprises to manage multiple API keys, enforce per-team credit consumption limits, and restrict scraping to specific allowed domains (allowlisting). Use this when scaling scraping operations across various departments or services that require granular resource governance and budget tracking.

This guide details how to configure Firecrawl for reliable multi-environment operations (Development, Staging, Production). It addresses critical operational concerns, such as managing credit budgets and ensuring separation between environments. Users learn how to implement self-hosted Docker setups for development, manage environment-specific API keys, and integrate safe scraping wrappers into CI/CD pipelines.

This skill provides robust, automated guardrails for web scraping pipelines using Firecrawl. It enforces critical policies to ensure compliance and stability, including domain blocklists (preventing scraping prohibited sites), managing API credit budgets, filtering low-quality content (e.g., error pages, thin content), and implementing granular per-domain rate limiting. Use this when building highly reliable, legal, and cost-efficient scraping solutions.

A senior-level tool for performing deep-dive technical SEO audits and site architecture mapping. It analyzes crawl health, indexing blocks, sitemap integrity, and structural issues (like canonicalization, link flow, and crawl budget waste). Use this to diagnose complex Google Search Console errors and propose a full, engineered roadmap for website stabilization and optimization.

A comprehensive guide for optimizing SEO indexing and managing crawl budget specifically for Next.js applications. Covers fixing Google Search Console coverage errors, implementing proper canonical tags, auditing sitemaps, managing static rendering, and optimizing internal linking for maximum search visibility.