Download

Skill UI

Browse and discover 19412+ curated skills

All Development Artificial Intelligence Design & Creative Product & Business Data Science Marketing Soft Skills Productivity Engineering Languages

Search Scraper , found 15 results

Default Newest Most Downloaded

Browser Automation Expert

browser-automation

sickn33/antigravity-awesome-skills

Browser automation expert for debugging flaky tests and running long-lived scrapers using Playwright/Puppeteer, focusing on robust selectors, auto-waits, isolation, and anti-detection practices.

Deep Web Scraping and Content Extraction

firecrawl-scraper

sickn33/antigravity-awesome-skills

This skill provides deep web scraping capabilities, allowing users to extract complex content, take screenshots, and parse PDFs from web pages. It handles advanced interactions like clicking and scrolling, making it ideal for detailed data gathering, batch URL processing, and complex web content analysis.

Universal Web Scraper Selector Tool

apify-ultimate-scraper

sickn33/antigravity-awesome-skills

An AI-driven utility that guides users through selecting the most suitable Apify Actor for complex web scraping tasks. It provides comprehensive coverage across major social media platforms and websites, including Instagram, Facebook, TikTok, YouTube, and Google Maps, ensuring a unified workflow for efficient data extraction.

Intelligent Multi-Strategy Web Scraper

sickn33/antigravity-awesome-skills

Intelligent multi-strategy web scraper that selects between static WebFetch, browser automation, curl/bash, and WebSearch paths to extract structured tables, lists, pricing, and other data, with pagination handling, validation confidence, transforms, and CSV/JSON output for monitoring workflows.

Deploy Bright Data Scrapers To Cloud

brightdata-deploy-integration

jeremylongshore/claude-code-plugins-plus-skills

Provides comprehensive instructions and code examples for deploying Bright Data-powered scraping applications to major cloud platforms, including Vercel, Fly.io, and Google Cloud Run. This guide covers critical aspects such as managing environment secrets, configuring proxy connectivity (TCP ports 33335/9222), and adapting code for serverless vs. long-running environments, ensuring successful production deployment.

Apify SDK Setup and Authentication

apify-install-auth

jeremylongshore/claude-code-plugins-plus-skills

This guide provides comprehensive instructions for setting up and authenticating the Apify ecosystem. It covers installing and configuring core components including the apify-client library, the native Apify SDK, and the Apify CLI. Learn how to manage API tokens, use environment variables, and initialize the necessary tools for building web scrapers and automation workflows.

Apify Reference Architecture Patterns

apify-reference-architecture

jeremylongshore/claude-code-plugins-plus-skills

Learn production-grade, scalable architectural patterns for building robust scraping systems using Apify. This guide details structures for standalone scrapers, complex multi-stage pipelines (Discover, Scrape, Transform), and integrating Apify into full-stack applications for powerful data extraction.

End-to-End Web Scraping Workflow on Apify

apify-core-workflow-a

jeremylongshore/claude-code-plugins-plus-skills

This workflow provides a complete, end-to-end solution for building and deploying robust web scrapers using Crawlee on the Apify platform. It guides users through every stage: defining input schemas, setting up the Actor with a sophisticated router pattern, extracting structured data (e.g., product details), saving results to datasets, and managing the full lifecycle from local testing to cloud deployment via apify-cli.

Local Apify Actor Development and Testing

apify-local-dev-loop

jeremylongshore/claude-code-plugins-plus-skills

This guide details how to set up and test Apify Actors locally using the Apify CLI. It emulates the full platform environment (including datasets, key-value stores, and request queues), allowing developers to run scrapers, test data handling, and debug the entire development lifecycle before deploying to the cloud. Perfect for rapid iteration and rigorous local testing.

Implementing Bright Data Rate Limit Handling

brightdata-rate-limits

jeremylongshore/claude-code-plugins-plus-skills

This technical guide provides patterns for handling rate limits, throttling, and concurrency issues when scraping data using Bright Data services. It demonstrates implementing concurrency control using queuing, applying exponential backoff for transient errors (like 429 or 503), and managing specific API trigger rate limits (e.g., 20/min, 60/hr). Essential for building robust, large-scale web scrapers.

Bright Data Webhook and Event Handling

brightdata-webhooks-events

jeremylongshore/claude-code-plugins-plus-skills

This comprehensive guide details how to implement robust webhook endpoints to receive, validate, and process data deliveries from Bright Data's Web Scraper and Datasets APIs. Learn best practices for handling large JSON/NDJSON payloads, verifying authorization headers, processing status notifications, and ensuring data deduplication in automated scraping pipelines.

X Twitter API Scraper Tool

x-twitter-scraper

github/awesome-copilot

This skill enables developers to integrate X (Twitter) data extraction into applications and AI workflows. It supports SDKs, REST APIs, Apify Actors, and MCP tools for searching tweets, exporting followers, and automating account actions with secure webhooks.

Language