Download

Skill UI

Browse and discover 18950+ curated skills

All Development Artificial Intelligence Design & Creative Product & Business Data Science Marketing Soft Skills Productivity Engineering Languages

Search Data Scraping , found 38 results

Default Newest Most Downloaded

Apify Automation Toolkit

apify-automation

ComposioHQ/awesome-claude-skills

Automate Apify web scraping Actors inside Claude Code to run crawlers synchronously or asynchronously, manage datasets, inspect logs, create reusable tasks, and pull structured results without leaving your workflow.

Firecrawl Architecture Variants Guide

firecrawl-architecture-variants

jeremylongshore/claude-code-plugins-plus-skills

A comprehensive guide to selecting and implementing the optimal Firecrawl architecture pattern for various data ingestion needs. Learn to choose between On-Demand, Scheduled Crawl Pipelines, and Real-Time Ingestion Pipelines based on data volume, required latency, and complexity. This is essential for designing scalable, production-grade scraping infrastructure, including RAG and knowledge base applications.

Structured Data Extraction, Batch Scraping, and Mapping

firecrawl-core-workflow-b

jeremylongshore/claude-code-plugins-plus-skills

This advanced workflow executes sophisticated web data gathering tasks. It supports three primary functions: LLM-powered structured data extraction using custom JSON schemas or prompts; efficient batch scraping of multiple known URLs; and rapid site mapping to discover all reachable URLs on a domain. Use this when you require reliable, typed data structures rather than raw markdown content.

Firecrawl Anti-Patterns and Best Practices

firecrawl-known-pitfalls

jeremylongshore/claude-code-plugins-plus-skills

This comprehensive guide identifies common anti-patterns and integration mistakes when using Firecrawl for web scraping and content extraction. It serves as a vital code review checklist, helping developers avoid pitfalls such as unbounded crawling, unspecified output formats, or aggressive API polling, ensuring robust and efficient data pipelines.

Scaling and Load Testing Web Crawling

firecrawl-load-scale

jeremylongshore/claude-code-plugins-plus-skills

This skill provides advanced methods for load testing and scaling web scraping pipelines using Firecrawl. It manages rate limits and optimizes throughput by implementing concurrency control, batch processing, and queue-based request throttling. Essential for capacity planning, stress-testing scraping performance, or maximizing data ingestion efficiency across various service plans.

Firecrawl Local Dev Workflow Setup

firecrawl-local-dev-loop

jeremylongshore/claude-code-plugins-plus-skills

This comprehensive guide details how to set up a robust, local development environment for Firecrawl integrations. It utilizes self-hosted Docker containers and Redis to eliminate reliance on paid API credits during development. The setup supports both unit testing (with mocked SDK) and full integration testing against the local instance, ensuring a seamless and efficient workflow for scraping and web data extraction projects.

Firecrawl Migration Deep Dive

firecrawl-migration-deep-dive

jeremylongshore/claude-code-plugins-plus-skills

A comprehensive guide for migrating web scraping pipelines from tools like Puppeteer, Playwright, and Cheerio to Firecrawl. This skill demonstrates how to replace complex, browser-intensive code with simple API calls, handling single-page scraping, structured data extraction using LLMs, and large-scale site crawling, while eliminating the need for manual browser management and anti-bot workarounds.

Building Reliable Web Scraping Patterns

firecrawl-reliability-patterns

jeremylongshore/claude-code-plugins-plus-skills

A comprehensive guide to implementing production-grade reliability patterns for web scraping pipelines using Firecrawl. Learn techniques such as circuit breakers, crawl fallbacks, content quality validation, and robust backoff strategies to handle timeouts, API failures, and inconsistent data quality, ensuring maximum uptime and data integrity.

Deep Web Scraping and Content Extraction

firecrawl-scraper

sickn33/antigravity-awesome-skills

This skill provides deep web scraping capabilities, allowing users to extract complex content, take screenshots, and parse PDFs from web pages. It handles advanced interactions like clicking and scrolling, making it ideal for detailed data gathering, batch URL processing, and complex web content analysis.

Apify Actor Development and Deployment

apify-actor-development

sickn33/antigravity-awesome-skills

This guide provides a comprehensive walkthrough for developing and deploying Apify Actors. Actors are serverless, containerized applications designed for powerful tasks like web scraping, data processing, and complex automation. Learn the mandatory setup, template selection (Python, JS, TS), step-by-step development workflow, and crucial security best practices for building robust, production-ready data pipelines.

Universal Web Scraper Selector Tool

apify-ultimate-scraper

sickn33/antigravity-awesome-skills

An AI-driven utility that guides users through selecting the most suitable Apify Actor for complex web scraping tasks. It provides comprehensive coverage across major social media platforms and websites, including Instagram, Facebook, TikTok, YouTube, and Google Maps, ensuring a unified workflow for efficient data extraction.

Browser Automation Toolkit

browser-automation

alirezarezvani/claude-skills

Provides Playwright-driven browser automation for scraping structured data, driving multi-step workflows, managing sessions and anti-detection tactics, and capturing screenshots/PDFs in production pipelines.

Language