Skill UI

This guide details how to set up and test Apify Actors locally using the Apify CLI. It emulates the full platform environment (including datasets, key-value stores, and request queues), allowing developers to run scrapers, test data handling, and debug the entire development lifecycle before deploying to the cloud. Perfect for rapid iteration and rigorous local testing.

This skill provides comprehensive access to Bright Data's SERP API and Web Scraper API. It allows users to collect structured search engine results (Google, Bing, Yahoo) synchronously, or trigger large-scale, asynchronous data collections with webhooks. Ideal for market research, SEO analysis, and large-scale data scraping projects.

This technical guide provides patterns for handling rate limits, throttling, and concurrency issues when scraping data using Bright Data services. It demonstrates implementing concurrency control using queuing, applying exponential backoff for transient errors (like 429 or 503), and managing specific API trigger rate limits (e.g., 20/min, 60/hr). Essential for building robust, large-scale web scrapers.

This guide provides production-ready patterns for integrating with Bright Data proxy services. It covers critical aspects like setting up a proxy client, implementing robust retry logic for transient errors (e.g., 502, 503), managing sticky sessions for consistent IPs, and parsing complex HTML responses. Essential for building reliable, high-scale web scrapers using TypeScript and Python.

This comprehensive guide details how to implement robust webhook endpoints to receive, validate, and process data deliveries from Bright Data's Web Scraper and Datasets APIs. Learn best practices for handling large JSON/NDJSON payloads, verifying authorization headers, processing status notifications, and ensuring data deduplication in automated scraping pipelines.

This skill enables developers to integrate X (Twitter) data extraction into applications and AI workflows. It supports SDKs, REST APIs, Apify Actors, and MCP tools for searching tweets, exporting followers, and automating account actions with secure webhooks.

HasData is a comprehensive cloud platform designed for extracting structured public web data. It supports three core execution modes: Web Scraping API for arbitrary URLs (including JS rendering), pre-parsed Scraper APIs for known platforms (like Google or Amazon), and asynchronous Scraper Jobs for bulk or recursive crawling. Ideal for market research, e-commerce intelligence, job data collection, and local business lead generation.

This skill scrapes Substack Notes analytics by extracting key engagement metrics (likes, comments, restacks) and content details. It overcomes the lack of a public API, allowing users to analyze performance data from a specified date range into a highly formatted, actionable Excel spreadsheet. The output includes detailed per-note data, total engagement calculations, and summary statistics.

Build a production-ready, AI-powered data collection agent for any public source (job boards, prices, news, etc.). This agent automatically scrapes data, enriches it using free LLMs (like Gemini Flash), and stores the results in databases such as Notion, Sheets, or Supabase. It runs on a free schedule using GitHub Actions and learns from user feedback, making it ideal for continuous data monitoring and tracking.

This SDK allows asynchronous Python programming to control a live web browser, simulating user interactions for web automation, testing, and data extraction. Users can navigate pages, locate elements, fill forms, click buttons, and capture snapshots of the current page's content. It enforces a 'perceive → act → verify' cycle, making it ideal for building robust web scrapers and end-to-end testing tools.

Selects and runs the best Apify Actor for multi-platform web data extraction, checking schema, pricing, provenance, and limits before execution.

Deep web scraping, screenshots, PDF parsing, and website crawling using Firecrawl API. Use when you need deep content extraction from web pages, page interaction (clicking, scrolling), screenshots, PDF parsing, or batch scraping multiple URLs.