Skill UI

This skill provides robust, automated guardrails for web scraping pipelines using Firecrawl. It enforces critical policies to ensure compliance and stability, including domain blocklists (preventing scraping prohibited sites), managing API credit budgets, filtering low-quality content (e.g., error pages, thin content), and implementing granular per-domain rate limiting. Use this when building highly reliable, legal, and cost-efficient scraping solutions.

A comprehensive guide to implementing production-grade reliability patterns for web scraping pipelines using Firecrawl. Learn techniques such as circuit breakers, crawl fallbacks, content quality validation, and robust backoff strategies to handle timeouts, API failures, and inconsistent data quality, ensuring maximum uptime and data integrity.

This skill provides deep web scraping capabilities, allowing users to extract complex content, take screenshots, and parse PDFs from web pages. It handles advanced interactions like clicking and scrolling, making it ideal for detailed data gathering, batch URL processing, and complex web content analysis.

This guide provides production-ready patterns for integrating the Firecrawl SDK in TypeScript and Python. It covers essential architectural best practices, such as implementing singleton clients, typed service wrappers, automatic retries with exponential backoff, concurrency management, and robust response validation using Zod. Ideal for building scalable, reliable web scraping services.

A production-grade framework for executing high-performance, robust browser automation and web scraping using Playwright with the Go language. This skill specializes in handling complex Single Page Applications (SPAs), emulating human behavior (e.g., random typing delays, Bezier mouse movements), and implementing advanced stealth techniques to bypass anti-bot systems like Cloudflare. It emphasizes architectural best practices, such as using contexts for isolation and structured logging.

Comprehensive Go guidance for browser automation and web scraping using Rod’s direct Chrome DevTools Protocol integration plus stealth anti-detection patterns, ideal for headless SPA testing, concurrent scraping, and request interception.

Orchestrate PhantomBuster cloud agents through the Composio MCP integration, automating lead generation, web scraping, usage monitoring, container tracking, CSV exports, and hCaptcha solving in a single workflow.

This guide provides a comprehensive walkthrough for developing and deploying Apify Actors. Actors are serverless, containerized applications designed for powerful tasks like web scraping, data processing, and complex automation. Learn the mandatory setup, template selection (Python, JS, TS), step-by-step development workflow, and crucial security best practices for building robust, production-ready data pipelines.

An AI-driven utility that guides users through selecting the most suitable Apify Actor for complex web scraping tasks. It provides comprehensive coverage across major social media platforms and websites, including Instagram, Facebook, TikTok, YouTube, and Google Maps, ensuring a unified workflow for efficient data extraction.

This skill provides expert-level control over a live Chrome browser. It enables full web automation (clicking, form filling, navigation), deep debugging (analyzing console logs, network requests), visual inspection (screenshots, snapshots), and detailed performance profiling. Ideal for QA engineers, web scraping, and front-end development testing.

A comprehensive diagnostic reference for resolving common technical failures encountered when running web scraping and automation tasks on the Apify platform. Covers issues such as Actor run failures, API rate limits (429), authentication errors (401), anti-bot blocks, and memory allocation issues, providing structured fixes and best practices for robust scraping pipelines.

A comprehensive diagnostic reference for common Bright Data proxy and API errors, including 407, 502, SSL Certificate errors, and rate limit issues. This guide provides specific causes, detailed fixes, and command-line solutions (cURL, Python, JavaScript) to ensure uninterrupted web scraping and API integration.