Download

Skill UI

Browse and discover 9651+ curated skills

All Development Artificial Intelligence Design & Creative Product & Business Data Science Marketing Soft Skills Productivity Engineering Languages

Search Web Scraping , found 42 results

Default Newest Most Downloaded

Apify Error Troubleshooting Guide

apify-common-errors

jeremylongshore/claude-code-plugins-plus-skills

A comprehensive diagnostic reference for resolving common technical failures encountered when running web scraping and automation tasks on the Apify platform. Covers issues such as Actor run failures, API rate limits (429), authentication errors (401), anti-bot blocks, and memory allocation issues, providing structured fixes and best practices for robust scraping pipelines.

Debugging Bright Data Errors And Solutions

brightdata-common-errors

jeremylongshore/claude-code-plugins-plus-skills

A comprehensive diagnostic reference for common Bright Data proxy and API errors, including 407, 502, SSL Certificate errors, and rate limit issues. This guide provides specific causes, detailed fixes, and command-line solutions (cURL, Python, JavaScript) to ensure uninterrupted web scraping and API integration.

Bright Data Scraping Development Workflow

brightdata-local-dev-loop

jeremylongshore/claude-code-plugins-plus-skills

A comprehensive guide and setup for establishing a fast, reproducible local development loop for web scraping projects using Bright Data. It includes configuring proxy modules, implementing response caching to save credits, and setting up mocked test suites (using Vitest) for robust, isolated testing without requiring live proxy access or consuming resources.

Guide to Apify Cost Optimization

apify-cost-tuning

jeremylongshore/claude-code-plugins-plus-skills

This skill provides comprehensive guidance on optimizing operational costs on the Apify platform. It covers analyzing Compute Units (CU) usage, managing proxy consumption (residential vs. datacenter), and optimizing scraping logic (memory, concurrency) to ensure efficient and cost-effective web scraping workflows.

Apify Deployment and Web Integration

apify-deploy-integration

jeremylongshore/claude-code-plugins-plus-skills

This comprehensive guide covers the full lifecycle of Apify Actors, enabling deployment from local environments to production platforms. Learn to trigger scraping tasks via APIs (e.g., Next.js routes), consume structured data, and handle results asynchronously using webhooks in frameworks like Express.js. Ideal for building robust, data-driven web services and automating data pipelines.

Implementing Apify Webhooks for Automation

apify-webhooks-events

jeremylongshore/claude-code-plugins-plus-skills

This guide details how to configure and implement Apify webhooks for robust, event-driven data pipelines. Learn to receive real-time notifications when Actor runs start, succeed, fail, or time out. By supporting both persistent (all runs) and ad-hoc (single run) webhooks, this pattern is ideal for building highly reliable and scalable production scraping integrations.

End-to-End Web Scraping Workflow on Apify

apify-core-workflow-a

jeremylongshore/claude-code-plugins-plus-skills

This workflow provides a complete, end-to-end solution for building and deploying robust web scrapers using Crawlee on the Apify platform. It guides users through every stage: defining input schemas, setting up the Actor with a sophisticated router pattern, extracting structured data (e.g., product details), saving results to datasets, and managing the full lifecycle from local testing to cloud deployment via apify-cli.

Apify Client: Running Actors and Scraping Data

apify-hello-world

jeremylongshore/claude-code-plugins-plus-skills

A comprehensive guide to using the Apify Client SDK. Learn the fundamental pattern of executing remote web scraping Actors (like content crawling or general scraping), managing asynchronous run states, and retrieving structured data from resulting datasets and key-value stores. Essential for integrating powerful web scraping capabilities into applications.

Optimize Apify Actor Performance Tuning

apify-performance-tuning

jeremylongshore/claude-code-plugins-plus-skills

This comprehensive guide details how to optimize Apify Actors for maximum efficiency, cost-effectiveness, and reliability. Learn to select the appropriate crawler (e.g., Cheerio, Playwright), tune concurrency limits, manage memory consumption, and implement robust proxy rotation strategies for diverse web scraping workloads, ensuring your scraping tasks are fast and stable.

Bright Data CI/CD GitHub Integration

brightdata-ci-integration

jeremylongshore/claude-code-plugins-plus-skills

This guide details setting up continuous integration and continuous deployment (CI/CD) pipelines for web scraping projects. It integrates Bright Data proxy testing into GitHub Actions, allowing developers to run both mocked unit tests (for quick checks) and live integration tests (verifying actual proxy connectivity) automatically upon code push or pull request.

Setting Up Bright Data Proxy Credentials

brightdata-install-auth

jeremylongshore/claude-code-plugins-plus-skills

This comprehensive guide details the end-to-end process for integrating Bright Data into development projects. It covers gathering zone credentials, setting up environment variables, downloading necessary SSL certificates, and configuring both Node.js and Python environments for robust and reliable web scraping proxy authentication.

Bright Data Production Deployment Checklist

brightdata-prod-checklist

jeremylongshore/claude-code-plugins-plus-skills

This comprehensive checklist guides the secure and systematic deployment of web scraping integrations using Bright Data. It covers critical stages including production zone verification, code quality checks (e.g., rate limiting, error logging), infrastructure setup, robust monitoring configuration, and safe gradual rollout procedures, ensuring reliable, mission-critical data collection processes into production.

Prev 1 234 Next

Language