Download

Skill UI

Browse and discover 18671+ curated skills

All Development Artificial Intelligence Design & Creative Product & Business Data Science Marketing Soft Skills Productivity Engineering Languages

Search Data Scraping , found 70 results

Default Newest Most Downloaded

Apify Automation Toolkit

apify-automation

ComposioHQ/awesome-claude-skills

Automate Apify web scraping Actors inside Claude Code to run crawlers synchronously or asynchronously, manage datasets, inspect logs, create reusable tasks, and pull structured results without leaving your workflow.

Claygent AI Research For Outreach Personalization

clay-core-workflow-b

jeremylongshore/claude-code-plugins-plus-skills

This advanced workflow uses Claygent AI to perform deep research on target companies by scraping websites. It extracts critical data points such as funding rounds, tech stacks, and potential pain points. These insights are then leveraged to generate highly personalized, human-sounding email openers at scale, ensuring high relevance for targeted outreach campaigns.

Firecrawl Architecture Variants Guide

firecrawl-architecture-variants

jeremylongshore/claude-code-plugins-plus-skills

A comprehensive guide to selecting and implementing the optimal Firecrawl architecture pattern for various data ingestion needs. Learn to choose between On-Demand, Scheduled Crawl Pipelines, and Real-Time Ingestion Pipelines based on data volume, required latency, and complexity. This is essential for designing scalable, production-grade scraping infrastructure, including RAG and knowledge base applications.

Website Scraping and Crawling Pipeline

firecrawl-core-workflow-a

jeremylongshore/claude-code-plugins-plus-skills

This workflow provides the primary mechanism for converting complex, live websites into clean, LLM-ready markdown content. It supports single-page scraping using `scrapeUrl`, deep multi-page site crawling with `crawlUrl`, and scalable async crawling for large datasets. Ideal for building robust content ingestion pipelines and reliably extracting structured information from the web.

Structured Data Extraction, Batch Scraping, and Mapping

firecrawl-core-workflow-b

jeremylongshore/claude-code-plugins-plus-skills

This advanced workflow executes sophisticated web data gathering tasks. It supports three primary functions: LLM-powered structured data extraction using custom JSON schemas or prompts; efficient batch scraping of multiple known URLs; and rapid site mapping to discover all reachable URLs on a domain. Use this when you require reliable, typed data structures rather than raw markdown content.

Web Scraping, Crawling, and Data Extraction API

firecrawl-hello-world

jeremylongshore/claude-code-plugins-plus-skills

Firecrawl provides a comprehensive API for web data harvesting. It enables users to perform single-page scraping, multi-page crawling, site mapping (URL discovery), and advanced structured data extraction using Large Language Models (LLMs). Ideal for integrating data pipelines, building web monitoring tools, or conducting market research.

Firecrawl Anti-Patterns and Best Practices

firecrawl-known-pitfalls

jeremylongshore/claude-code-plugins-plus-skills

This comprehensive guide identifies common anti-patterns and integration mistakes when using Firecrawl for web scraping and content extraction. It serves as a vital code review checklist, helping developers avoid pitfalls such as unbounded crawling, unspecified output formats, or aggressive API polling, ensuring robust and efficient data pipelines.

Scaling and Load Testing Web Crawling

firecrawl-load-scale

jeremylongshore/claude-code-plugins-plus-skills

This skill provides advanced methods for load testing and scaling web scraping pipelines using Firecrawl. It manages rate limits and optimizes throughput by implementing concurrency control, batch processing, and queue-based request throttling. Essential for capacity planning, stress-testing scraping performance, or maximizing data ingestion efficiency across various service plans.

Firecrawl Local Dev Workflow Setup

firecrawl-local-dev-loop

jeremylongshore/claude-code-plugins-plus-skills

This comprehensive guide details how to set up a robust, local development environment for Firecrawl integrations. It utilizes self-hosted Docker containers and Redis to eliminate reliance on paid API credits during development. The setup supports both unit testing (with mocked SDK) and full integration testing against the local instance, ensuring a seamless and efficient workflow for scraping and web data extraction projects.

Firecrawl Migration Deep Dive

firecrawl-migration-deep-dive

jeremylongshore/claude-code-plugins-plus-skills

A comprehensive guide for migrating web scraping pipelines from tools like Puppeteer, Playwright, and Cheerio to Firecrawl. This skill demonstrates how to replace complex, browser-intensive code with simple API calls, handling single-page scraping, structured data extraction using LLMs, and large-scale site crawling, while eliminating the need for manual browser management and anti-bot workarounds.

Firecrawl Content Ingestion Pipeline Architecture

firecrawl-reference-architecture

jeremylongshore/claude-code-plugins-plus-skills

This comprehensive reference architecture details a multi-stage pipeline for web scraping and content ingestion using Firecrawl. It seamlessly integrates single-page scraping, site-wide crawling, URL mapping, and structured data extraction. The subsequent processing layer handles cleaning, deduplication, and chunking, making this blueprint ideal for designing robust knowledge bases, RAG systems, and complex AI data pipelines.

Building Reliable Web Scraping Patterns

firecrawl-reliability-patterns

jeremylongshore/claude-code-plugins-plus-skills

A comprehensive guide to implementing production-grade reliability patterns for web scraping pipelines using Firecrawl. Learn techniques such as circuit breakers, crawl fallbacks, content quality validation, and robust backoff strategies to handle timeouts, API failures, and inconsistent data quality, ensuring maximum uptime and data integrity.

12 3 4 5 6 Next

Language