Skill UI

A comprehensive expert resource for building high-performance, async-first APIs using FastAPI, SQLAlchemy 2.0, and Pydantic V2. Covers advanced topics like microservices architecture, WebSockets, advanced security (OAuth2, RBAC), robust testing strategies (pytest), performance optimization, and modern DevOps practices (Docker, Kubernetes). Ideal for mastering scalable, production-ready Python web services.

This skill provides structured guidance and patterns for performing comprehensive web fuzzing using the powerful command-line tool, ffuf. Web fuzzing is an essential security testing technique used by penetration testers to discover hidden directories, unlinked endpoints, or sensitive files on a web server by systematically brute-forcing potential paths and parameters. Use this skill when you need to audit the security posture of a web application or map out unknown parts of a website.

Performs authorized file path traversal assessments to map web inputs, craft traversal payloads, and document sensitive files that can be read, aiding defenders in hardening filesystem handling during security reviews.

Run targeted file path traversal assessments to find directory traversal and LFI vulnerabilities across web parameters, verify exploitation payloads, and document sensitive files exposed via automated fuzzing and manual checks.

A systematic guide for debugging complex, hard-to-diagnose issues with Firecrawl. Use this when standard troubleshooting fails, such as when scrapes return empty content, crawl jobs hang indefinitely, or webhooks fail to fire. It employs layer-by-layer isolation techniques, covering API connectivity, target URL accessibility, and content quality to pinpoint failure points.

Firecrawl Automation lets you use Claude Code to scrape pages, crawl sites, batch URLs, extract structured data, and monitor jobs via the Composio integration, ideal for terminal-driven web data pipelines.

A comprehensive quick-reference guide for diagnosing and fixing common Firecrawl API errors and response codes. Covers critical issues such as API key validation (401), rate limiting (429), credit exhaustion (402), and handling dynamic content rendering failures in Single Page Applications (SPA). Use this when debugging failed web scraping or crawl job runs.

This workflow provides the primary mechanism for converting complex, live websites into clean, LLM-ready markdown content. It supports single-page scraping using `scrapeUrl`, deep multi-page site crawling with `crawlUrl`, and scalable async crawling for large datasets. Ideal for building robust content ingestion pipelines and reliably extracting structured information from the web.

This advanced workflow executes sophisticated web data gathering tasks. It supports three primary functions: LLM-powered structured data extraction using custom JSON schemas or prompts; efficient batch scraping of multiple known URLs; and rapid site mapping to discover all reachable URLs on a domain. Use this when you require reliable, typed data structures rather than raw markdown content.

This skill provides advanced techniques to significantly reduce API costs when using Firecrawl for web scraping. It covers best practices such as setting crawl limits, utilizing batch scraping for known URLs, implementing local caching, and monitoring credit usage. Learn how to efficiently scrape large sites while managing budgets and minimizing unexpected billing spikes.

A comprehensive pipeline for processing, validating, and optimizing scraped web content from Firecrawl. This tool handles markdown cleaning, structured data extraction using Zod validation, content deduplication, and chunking tailored for Large Language Models (LLMs) and Retrieval-Augmented Generation (RAG) systems. It ensures crawled data is standardized, clean, and ready for downstream consumption or knowledge base indexing.

A comprehensive guide for deploying web scraping applications powered by Firecrawl to various production environments. Covers Vercel serverless functions, Google Cloud Run, and self-hosted Docker setups. Learn how to configure platform-specific secrets, implement API routes, and handle asynchronous crawl results via webhooks for scalable, reliable production service.