Download

Skill UI

Browse and discover 18950+ curated skills

All Development Artificial Intelligence Design & Creative Product & Business Data Science Marketing Soft Skills Productivity Engineering Languages

Search Scraping , found 72 results

Default Newest Most Downloaded

Apiflash Automation Guide

apiflash-automation

ComposioHQ/awesome-claude-skills

Automates Apiflash operations through Composio's Rube MCP, guiding you to search tools, manage connections, and run schema-compliant workflows for scraping or screenshot tasks.

Apify Automation Toolkit

apify-automation

ComposioHQ/awesome-claude-skills

Automate Apify web scraping Actors inside Claude Code to run crawlers synchronously or asynchronously, manage datasets, inspect logs, create reusable tasks, and pull structured results without leaving your workflow.

Dev Browser CLI Automation

SawyerHood/dev-browser

Controls headful browsers via a CLI that runs sandboxed JavaScript, keeping page state persistent while navigating, form-filling, screenshots, scraping, or web testing flows.

Firecrawl Architecture Variants Guide

firecrawl-architecture-variants

jeremylongshore/claude-code-plugins-plus-skills

A comprehensive guide to selecting and implementing the optimal Firecrawl architecture pattern for various data ingestion needs. Learn to choose between On-Demand, Scheduled Crawl Pipelines, and Real-Time Ingestion Pipelines based on data volume, required latency, and complexity. This is essential for designing scalable, production-grade scraping infrastructure, including RAG and knowledge base applications.

Automated Testing for Firecrawl CI/CD

firecrawl-ci-integration

jeremylongshore/claude-code-plugins-plus-skills

This guide details setting up automated Continuous Integration/Continuous Deployment (CI/CD) pipelines for Firecrawl scraping services. It covers configuring GitHub Actions, managing API keys, and implementing both mock unit tests and live integration tests. Use this when ensuring scraping behavior is validated automatically across pull requests and merges.

Firecrawl Error Debugging and Troubleshooting Guide

firecrawl-common-errors

jeremylongshore/claude-code-plugins-plus-skills

A comprehensive quick-reference guide for diagnosing and fixing common Firecrawl API errors and response codes. Covers critical issues such as API key validation (401), rate limiting (429), credit exhaustion (402), and handling dynamic content rendering failures in Single Page Applications (SPA). Use this when debugging failed web scraping or crawl job runs.

Structured Data Extraction, Batch Scraping, and Mapping

firecrawl-core-workflow-b

jeremylongshore/claude-code-plugins-plus-skills

This advanced workflow executes sophisticated web data gathering tasks. It supports three primary functions: LLM-powered structured data extraction using custom JSON schemas or prompts; efficient batch scraping of multiple known URLs; and rapid site mapping to discover all reachable URLs on a domain. Use this when you require reliable, typed data structures rather than raw markdown content.

Deploying Firecrawl Web Scraping Integrations

firecrawl-deploy-integration

jeremylongshore/claude-code-plugins-plus-skills

A comprehensive guide for deploying web scraping applications powered by Firecrawl to various production environments. Covers Vercel serverless functions, Google Cloud Run, and self-hosted Docker setups. Learn how to configure platform-specific secrets, implement API routes, and handle asynchronous crawl results via webhooks for scalable, reliable production service.

Manage Firecrawl Access Control

firecrawl-enterprise-rbac

jeremylongshore/claude-code-plugins-plus-skills

This guide outlines how to implement robust Role-Based Access Control (RBAC) for Firecrawl scraping resources. It allows enterprises to manage multiple API keys, enforce per-team credit consumption limits, and restrict scraping to specific allowed domains (allowlisting). Use this when scaling scraping operations across various departments or services that require granular resource governance and budget tracking.

Configure Firecrawl SDK for Web Scraping

firecrawl-install-auth

jeremylongshore/claude-code-plugins-plus-skills

This guide provides comprehensive instructions for setting up the Firecrawl SDK, covering both Node.js and Python environments. It details how to install the necessary packages via npm or pip, and how to securely configure the API key using environment variables. Use this guide when initializing web scraping functionality or integrating Firecrawl into a new development project.

Firecrawl Anti-Patterns and Best Practices

firecrawl-known-pitfalls

jeremylongshore/claude-code-plugins-plus-skills

This comprehensive guide identifies common anti-patterns and integration mistakes when using Firecrawl for web scraping and content extraction. It serves as a vital code review checklist, helping developers avoid pitfalls such as unbounded crawling, unspecified output formats, or aggressive API polling, ensuring robust and efficient data pipelines.

Scaling and Load Testing Web Crawling

firecrawl-load-scale

jeremylongshore/claude-code-plugins-plus-skills

This skill provides advanced methods for load testing and scaling web scraping pipelines using Firecrawl. It manages rate limits and optimizes throughput by implementing concurrency control, batch processing, and queue-based request throttling. Essential for capacity planning, stress-testing scraping performance, or maximizing data ingestion efficiency across various service plans.

12 3 4 5 6 Next

Language