Download

Skill UI

Browse and discover 15857+ curated skills

All Development Artificial Intelligence Design & Creative Product & Business Data Science Marketing Soft Skills Productivity Engineering Languages

Search Data Scraping , found 34 results

Default Newest Most Downloaded

Debugging Bright Data Errors And Solutions

brightdata-common-errors

jeremylongshore/claude-code-plugins-plus-skills

A comprehensive diagnostic reference for common Bright Data proxy and API errors, including 407, 502, SSL Certificate errors, and rate limit issues. This guide provides specific causes, detailed fixes, and command-line solutions (cURL, Python, JavaScript) to ensure uninterrupted web scraping and API integration.

Bright Data Performance Tuning Strategies

brightdata-performance-tuning

jeremylongshore/claude-code-plugins-plus-skills

This comprehensive guide details advanced techniques for optimizing Bright Data API scraping performance. It covers implementing connection pooling, robust response caching layers (LRU Cache), and managing concurrent requests with backpressure control. Use this when facing slow API responses or requiring high-throughput, scalable data extraction.

Deploy Bright Data Scrapers To Cloud

brightdata-deploy-integration

jeremylongshore/claude-code-plugins-plus-skills

Provides comprehensive instructions and code examples for deploying Bright Data-powered scraping applications to major cloud platforms, including Vercel, Fly.io, and Google Cloud Run. This guide covers critical aspects such as managing environment secrets, configuring proxy connectivity (TCP ports 33335/9222), and adapting code for serverless vs. long-running environments, ensuring successful production deployment.

Bright Data Scraping Development Workflow

brightdata-local-dev-loop

jeremylongshore/claude-code-plugins-plus-skills

A comprehensive guide and setup for establishing a fast, reproducible local development loop for web scraping projects using Bright Data. It includes configuring proxy modules, implementing response caching to save credits, and setting up mocked test suites (using Vitest) for robust, isolated testing without requiring live proxy access or consuming resources.

Guide to Apify Cost Optimization

apify-cost-tuning

jeremylongshore/claude-code-plugins-plus-skills

This skill provides comprehensive guidance on optimizing operational costs on the Apify platform. It covers analyzing Compute Units (CU) usage, managing proxy consumption (residential vs. datacenter), and optimizing scraping logic (memory, concurrency) to ensure efficient and cost-effective web scraping workflows.

Apify Deployment and Web Integration

apify-deploy-integration

jeremylongshore/claude-code-plugins-plus-skills

This comprehensive guide covers the full lifecycle of Apify Actors, enabling deployment from local environments to production platforms. Learn to trigger scraping tasks via APIs (e.g., Next.js routes), consume structured data, and handle results asynchronously using webhooks in frameworks like Express.js. Ideal for building robust, data-driven web services and automating data pipelines.

Apify Reference Architecture Patterns

apify-reference-architecture

jeremylongshore/claude-code-plugins-plus-skills

Learn production-grade, scalable architectural patterns for building robust scraping systems using Apify. This guide details structures for standalone scrapers, complex multi-stage pipelines (Discover, Scrape, Transform), and integrating Apify into full-stack applications for powerful data extraction.

Implementing Apify Webhooks for Automation

apify-webhooks-events

jeremylongshore/claude-code-plugins-plus-skills

This guide details how to configure and implement Apify webhooks for robust, event-driven data pipelines. Learn to receive real-time notifications when Actor runs start, succeed, fail, or time out. By supporting both persistent (all runs) and ad-hoc (single run) webhooks, this pattern is ideal for building highly reliable and scalable production scraping integrations.

End-to-End Web Scraping Workflow on Apify

apify-core-workflow-a

jeremylongshore/claude-code-plugins-plus-skills

This workflow provides a complete, end-to-end solution for building and deploying robust web scrapers using Crawlee on the Apify platform. It guides users through every stage: defining input schemas, setting up the Actor with a sophisticated router pattern, extracting structured data (e.g., product details), saving results to datasets, and managing the full lifecycle from local testing to cloud deployment via apify-cli.

Apify Client: Running Actors and Scraping Data

apify-hello-world

jeremylongshore/claude-code-plugins-plus-skills

A comprehensive guide to using the Apify Client SDK. Learn the fundamental pattern of executing remote web scraping Actors (like content crawling or general scraping), managing asynchronous run states, and retrieving structured data from resulting datasets and key-value stores. Essential for integrating powerful web scraping capabilities into applications.

Bright Data CI/CD GitHub Integration

brightdata-ci-integration

jeremylongshore/claude-code-plugins-plus-skills

This guide details setting up continuous integration and continuous deployment (CI/CD) pipelines for web scraping projects. It integrates Bright Data proxy testing into GitHub Actions, allowing developers to run both mocked unit tests (for quick checks) and live integration tests (verifying actual proxy connectivity) automatically upon code push or pull request.

Setting Up Bright Data Proxy Credentials

brightdata-install-auth

jeremylongshore/claude-code-plugins-plus-skills

This comprehensive guide details the end-to-end process for integrating Bright Data into development projects. It covers gathering zone credentials, setting up environment variables, downloading necessary SSL certificates, and configuring both Node.js and Python environments for robust and reliable web scraping proxy authentication.

Language