Download

Skill UI

Browse and discover 11173+ curated skills

All Development Artificial Intelligence Design & Creative Product & Business Data Science Marketing Soft Skills Productivity Engineering Languages

Search web-scraping , found 65 results

Default Newest Most Downloaded

PhantomBuster Automation Toolkit

phantombuster-automation

ComposioHQ/awesome-claude-skills

Orchestrate PhantomBuster cloud agents through the Composio MCP integration, automating lead generation, web scraping, usage monitoring, container tracking, CSV exports, and hCaptcha solving in a single workflow.

Web Search, Crawling, and Content Extraction

sickn33/antigravity-awesome-skills

This skill provides comprehensive capabilities for web searching, content extraction, and web crawling using the Tavily API. It is ideal for tasks requiring up-to-date information retrieval, deep content scraping from specific URLs, or comprehensive website crawling for research purposes, making it a powerful research augmentation tool.

Rube Webscraping Automation

webscraping-ai-automation

ComposioHQ/awesome-claude-skills

Guide for automating Webscraping AI workflows through Composio’s Webscraping AI toolkit using Rube MCP, covering connection checks, tool discovery, execution patterns, and schema compliance best practices.

Apify Actor Development and Deployment

apify-actor-development

sickn33/antigravity-awesome-skills

This guide provides a comprehensive walkthrough for developing and deploying Apify Actors. Actors are serverless, containerized applications designed for powerful tasks like web scraping, data processing, and complex automation. Learn the mandatory setup, template selection (Python, JS, TS), step-by-step development workflow, and crucial security best practices for building robust, production-ready data pipelines.

Universal Web Scraper Selector Tool

apify-ultimate-scraper

sickn33/antigravity-awesome-skills

An AI-driven utility that guides users through selecting the most suitable Apify Actor for complex web scraping tasks. It provides comprehensive coverage across major social media platforms and websites, including Instagram, Facebook, TikTok, YouTube, and Google Maps, ensuring a unified workflow for efficient data extraction.

X/Twitter Data Scraping and Automation Suite

x-twitter-scraper

sickn33/antigravity-awesome-skills

A comprehensive toolkit designed for advanced data scraping and automation workflows on X/Twitter. Capabilities include deep tweet search, user profile analysis, bulk follower/media export, automated posting (replies, DMs), real-time account monitoring via webhooks, and integration with multiple AI agent platforms (Hermes, OpenClaw). Ideal for market research, social listening, and content automation.

Browser Automation and DevTools Inspection

chrome-devtools

github/awesome-copilot

This skill provides expert-level control over a live Chrome browser. It enables full web automation (clicking, form filling, navigation), deep debugging (analyzing console logs, network requests), visual inspection (screenshots, snapshots), and detailed performance profiling. Ideal for QA engineers, web scraping, and front-end development testing.

Control Browser Launch Modes

browser-visible

agentscope-ai/QwenPaw

This skill provides granular control over the browser launch environment. Users can specify whether the browser window should be visible (`headed`) or if the underlying automation mechanism should switch from default managed CDP to Playwright management (`private_mode`). This is essential for complex automation, testing, and web scraping scenarios requiring specific environmental setups.

Apify Error Troubleshooting Guide

apify-common-errors

jeremylongshore/claude-code-plugins-plus-skills

A comprehensive diagnostic reference for resolving common technical failures encountered when running web scraping and automation tasks on the Apify platform. Covers issues such as Actor run failures, API rate limits (429), authentication errors (401), anti-bot blocks, and memory allocation issues, providing structured fixes and best practices for robust scraping pipelines.

Apify Core Storage and Workflow Management

apify-core-workflow-b

jeremylongshore/claude-code-plugins-plus-skills

Provides comprehensive programmatic control over Apify's core data infrastructure, including Datasets, Key-Value Stores, and Request Queues. This skill allows users to perform CRUD operations on various storage types, manage data persistence, and orchestrate complex, multi-stage data pipelines (e.g., scrape -> transform -> export). Ideal for building robust, end-to-end web scraping and data processing automation workflows.

Debugging Bright Data Errors And Solutions

brightdata-common-errors

jeremylongshore/claude-code-plugins-plus-skills

A comprehensive diagnostic reference for common Bright Data proxy and API errors, including 407, 502, SSL Certificate errors, and rate limit issues. This guide provides specific causes, detailed fixes, and command-line solutions (cURL, Python, JavaScript) to ensure uninterrupted web scraping and API integration.

Scraping Dynamic Data With Bright Data

brightdata-core-workflow-a

jeremylongshore/claude-code-plugins-plus-skills

Utilize Bright Data's Scraping Browser with Playwright or Puppeteer to reliably scrape structured data from JavaScript-rendered pages, Single Page Applications (SPAs), and anti-bot-protected sites. This tool manages proxy routing, CAPTCHA solving, and fingerprint management, ensuring robust data collection from complex web environments.

Prev 1 234 5 6 Next

Language