Skill UI

A comprehensive guide to implementing production-grade reliability patterns for web scraping pipelines using Firecrawl. Learn techniques such as circuit breakers, crawl fallbacks, content quality validation, and robust backoff strategies to handle timeouts, API failures, and inconsistent data quality, ensuring maximum uptime and data integrity.

This skill provides deep web scraping capabilities, allowing users to extract complex content, take screenshots, and parse PDFs from web pages. It handles advanced interactions like clicking and scrolling, making it ideal for detailed data gathering, batch URL processing, and complex web content analysis.

This guide provides production-ready patterns for integrating the Firecrawl SDK in TypeScript and Python. It covers essential architectural best practices, such as implementing singleton clients, typed service wrappers, automatic retries with exponential backoff, concurrency management, and robust response validation using Zod. Ideal for building scalable, reliable web scraping services.

Master the implementation of Firecrawl webhooks for robust, real-time handling of asynchronous crawling and batch scraping jobs. Instead of inefficiently polling the crawl status, configure webhook endpoints to receive instant POST events (e.g., `crawl.page`, `crawl.completed`). This guide covers event types, signature verification using HMAC-SHA256, and processing streamed data for building advanced data pipelines.

A production-grade framework for executing high-performance, robust browser automation and web scraping using Playwright with the Go language. This skill specializes in handling complex Single Page Applications (SPAs), emulating human behavior (e.g., random typing delays, Bezier mouse movements), and implementing advanced stealth techniques to bypass anti-bot systems like Cloudflare. It emphasizes architectural best practices, such as using contexts for isolation and structured logging.

Comprehensive Go guidance for browser automation and web scraping using Rod’s direct Chrome DevTools Protocol integration plus stealth anti-detection patterns, ideal for headless SPA testing, concurrent scraping, and request interception.

Orchestrate PhantomBuster cloud agents through the Composio MCP integration, automating lead generation, web scraping, usage monitoring, container tracking, CSV exports, and hCaptcha solving in a single workflow.

Tools for automating Scrapingant operations through Rube MCP and Composio, with guidance on discovering schemas, managing connections, executing workflows, and handling pagination in a compliant way.

Automates Scrapingbee tasks through Composio via Rube MCP, ensuring each workflow begins with RUBE_SEARCH_TOOLS, validates connections, and executes schema-compliant tool calls with consistent sessions.

This skill provides comprehensive capabilities for web searching, content extraction, and web crawling using the Tavily API. It is ideal for tasks requiring up-to-date information retrieval, deep content scraping from specific URLs, or comprehensive website crawling for research purposes, making it a powerful research augmentation tool.

Guide for automating Webscraping AI workflows through Composio’s Webscraping AI toolkit using Rube MCP, covering connection checks, tool discovery, execution patterns, and schema compliance best practices.

This guide provides a comprehensive walkthrough for developing and deploying Apify Actors. Actors are serverless, containerized applications designed for powerful tasks like web scraping, data processing, and complex automation. Learn the mandatory setup, template selection (Python, JS, TS), step-by-step development workflow, and crucial security best practices for building robust, production-ready data pipelines.