Skill UI

This skill provides robust, automated guardrails for web scraping pipelines using Firecrawl. It enforces critical policies to ensure compliance and stability, including domain blocklists (preventing scraping prohibited sites), managing API credit budgets, filtering low-quality content (e.g., error pages, thin content), and implementing granular per-domain rate limiting. Use this when building highly reliable, legal, and cost-efficient scraping solutions.

A comprehensive guide to implementing production-grade reliability patterns for web scraping pipelines using Firecrawl. Learn techniques such as circuit breakers, crawl fallbacks, content quality validation, and robust backoff strategies to handle timeouts, API failures, and inconsistent data quality, ensuring maximum uptime and data integrity.

This skill provides deep web scraping capabilities, allowing users to extract complex content, take screenshots, and parse PDFs from web pages. It handles advanced interactions like clicking and scrolling, making it ideal for detailed data gathering, batch URL processing, and complex web content analysis.

This guide provides production-ready patterns for integrating the Firecrawl SDK in TypeScript and Python. It covers essential architectural best practices, such as implementing singleton clients, typed service wrappers, automatic retries with exponential backoff, concurrency management, and robust response validation using Zod. Ideal for building scalable, reliable web scraping services.

A production-grade framework for executing high-performance, robust browser automation and web scraping using Playwright with the Go language. This skill specializes in handling complex Single Page Applications (SPAs), emulating human behavior (e.g., random typing delays, Bezier mouse movements), and implementing advanced stealth techniques to bypass anti-bot systems like Cloudflare. It emphasizes architectural best practices, such as using contexts for isolation and structured logging.

Comprehensive Go guidance for browser automation and web scraping using Rod’s direct Chrome DevTools Protocol integration plus stealth anti-detection patterns, ideal for headless SPA testing, concurrent scraping, and request interception.

Orchestrate PhantomBuster cloud agents through the Composio MCP integration, automating lead generation, web scraping, usage monitoring, container tracking, CSV exports, and hCaptcha solving in a single workflow.

A comprehensive guide for developing, configuring, and deploying Apify Actors. Learn how to create serverless, isolated programs for web scraping, data processing, and automation workflows. Covers prerequisites, setup procedures (CLI authentication), development lifecycle, output schema configuration, and critical security best practices for handling untrusted web data.

This guide details the process of converting standalone software or command-line interfaces (CLIs) into structured, reusable serverless Actors compatible with the Apify platform. Actors are packaged as Docker images, accepting defined JSON inputs and producing structured JSON outputs. This methodology enables scalable web scraping, data processing, and complex automation on Apify.

An AI-driven utility that guides users through selecting the most suitable Apify Actor for complex web scraping tasks. It provides comprehensive coverage across major social media platforms and websites, including Instagram, Facebook, TikTok, YouTube, and Google Maps, ensuring a unified workflow for efficient data extraction.

This skill provides expert-level control over a live Chrome browser. It enables full web automation (clicking, form filling, navigation), deep debugging (analyzing console logs, network requests), visual inspection (screenshots, snapshots), and detailed performance profiling. Ideal for QA engineers, web scraping, and front-end development testing.

This skill provides granular control over the browser launch environment. Users can specify whether the browser window should be visible (`headed`) or if the underlying automation mechanism should switch from default managed CDP to Playwright management (`private_mode`). This is essential for complex automation, testing, and web scraping scenarios requiring specific environmental setups.