Download

Skill UI

Browse and discover 9201+ curated skills

All Development Artificial Intelligence Design & Creative Product & Business Data Science Marketing Soft Skills Productivity Engineering Languages

Search Web Scraping , found 57 results

Default Newest Most Downloaded

Apify Automation Toolkit

apify-automation

ComposioHQ/awesome-claude-skills

Automate Apify web scraping Actors inside Claude Code to run crawlers synchronously or asynchronously, manage datasets, inspect logs, create reusable tasks, and pull structured results without leaving your workflow.

Claygent AI Research For Outreach Personalization

clay-core-workflow-b

jeremylongshore/claude-code-plugins-plus-skills

This advanced workflow uses Claygent AI to perform deep research on target companies by scraping websites. It extracts critical data points such as funding rounds, tech stacks, and potential pain points. These insights are then leveraged to generate highly personalized, human-sounding email openers at scale, ensuring high relevance for targeted outreach campaigns.

Dev Browser CLI Automation

SawyerHood/dev-browser

Controls headful browsers via a CLI that runs sandboxed JavaScript, keeping page state persistent while navigating, form-filling, screenshots, scraping, or web testing flows.

Firecrawl Error Debugging and Troubleshooting Guide

firecrawl-common-errors

jeremylongshore/claude-code-plugins-plus-skills

A comprehensive quick-reference guide for diagnosing and fixing common Firecrawl API errors and response codes. Covers critical issues such as API key validation (401), rate limiting (429), credit exhaustion (402), and handling dynamic content rendering failures in Single Page Applications (SPA). Use this when debugging failed web scraping or crawl job runs.

Website Scraping and Crawling Pipeline

firecrawl-core-workflow-a

jeremylongshore/claude-code-plugins-plus-skills

This workflow provides the primary mechanism for converting complex, live websites into clean, LLM-ready markdown content. It supports single-page scraping using `scrapeUrl`, deep multi-page site crawling with `crawlUrl`, and scalable async crawling for large datasets. Ideal for building robust content ingestion pipelines and reliably extracting structured information from the web.

Structured Data Extraction, Batch Scraping, and Mapping

firecrawl-core-workflow-b

jeremylongshore/claude-code-plugins-plus-skills

This advanced workflow executes sophisticated web data gathering tasks. It supports three primary functions: LLM-powered structured data extraction using custom JSON schemas or prompts; efficient batch scraping of multiple known URLs; and rapid site mapping to discover all reachable URLs on a domain. Use this when you require reliable, typed data structures rather than raw markdown content.

Firecrawl Cost Optimization Guide

firecrawl-cost-tuning

jeremylongshore/claude-code-plugins-plus-skills

This skill provides advanced techniques to significantly reduce API costs when using Firecrawl for web scraping. It covers best practices such as setting crawl limits, utilizing batch scraping for known URLs, implementing local caching, and monitoring credit usage. Learn how to efficiently scrape large sites while managing budgets and minimizing unexpected billing spikes.

Deploying Firecrawl Web Scraping Integrations

firecrawl-deploy-integration

jeremylongshore/claude-code-plugins-plus-skills

A comprehensive guide for deploying web scraping applications powered by Firecrawl to various production environments. Covers Vercel serverless functions, Google Cloud Run, and self-hosted Docker setups. Learn how to configure platform-specific secrets, implement API routes, and handle asynchronous crawl results via webhooks for scalable, reliable production service.

Web Scraping, Crawling, and Data Extraction API

firecrawl-hello-world

jeremylongshore/claude-code-plugins-plus-skills

Firecrawl provides a comprehensive API for web data harvesting. It enables users to perform single-page scraping, multi-page crawling, site mapping (URL discovery), and advanced structured data extraction using Large Language Models (LLMs). Ideal for integrating data pipelines, building web monitoring tools, or conducting market research.

Configure Firecrawl SDK for Web Scraping

firecrawl-install-auth

jeremylongshore/claude-code-plugins-plus-skills

This guide provides comprehensive instructions for setting up the Firecrawl SDK, covering both Node.js and Python environments. It details how to install the necessary packages via npm or pip, and how to securely configure the API key using environment variables. Use this guide when initializing web scraping functionality or integrating Firecrawl into a new development project.

Firecrawl Anti-Patterns and Best Practices

firecrawl-known-pitfalls

jeremylongshore/claude-code-plugins-plus-skills

This comprehensive guide identifies common anti-patterns and integration mistakes when using Firecrawl for web scraping and content extraction. It serves as a vital code review checklist, helping developers avoid pitfalls such as unbounded crawling, unspecified output formats, or aggressive API polling, ensuring robust and efficient data pipelines.

Scaling and Load Testing Web Crawling

firecrawl-load-scale

jeremylongshore/claude-code-plugins-plus-skills

This skill provides advanced methods for load testing and scaling web scraping pipelines using Firecrawl. It manages rate limits and optimizes throughput by implementing concurrency control, batch processing, and queue-based request throttling. Essential for capacity planning, stress-testing scraping performance, or maximizing data ingestion efficiency across various service plans.

Language