Skill UI

Provides comprehensive programmatic control over Apify's core data infrastructure, including Datasets, Key-Value Stores, and Request Queues. This skill allows users to perform CRUD operations on various storage types, manage data persistence, and orchestrate complex, multi-stage data pipelines (e.g., scrape -> transform -> export). Ideal for building robust, end-to-end web scraping and data processing automation workflows.

Utilize Bright Data's Scraping Browser with Playwright or Puppeteer to reliably scrape structured data from JavaScript-rendered pages, Single Page Applications (SPAs), and anti-bot-protected sites. This tool manages proxy routing, CAPTCHA solving, and fingerprint management, ensuring robust data collection from complex web environments.

This skill provides comprehensive methods and code examples for optimizing spending on Bright Data services. It covers product selection (Proxy vs. API), implementing caching strategies, bulk usage monitoring, and setting budget alerts, ensuring cost efficiency in large-scale web scraping projects.

This skill provides comprehensive access to Bright Data's SERP API and Web Scraper API. It allows users to collect structured search engine results (Google, Bing, Yahoo) synchronously, or trigger large-scale, asynchronous data collections with webhooks. Ideal for market research, SEO analysis, and large-scale data scraping projects.

This comprehensive guide demonstrates how to scrape live webpages using Bright Data's Web Unlocker proxy. It details how to bypass advanced anti-scraping mechanisms, such as CAPTCHAs and fingerprinting, automatically. Users are provided with full code examples in both Node.js and Python, showing methods for scraping via the proxy endpoint and through the dedicated REST API. Ideal for starting new scraping projects or integrating Bright Data into existing workflows.

This guide provides production-ready patterns for integrating with Bright Data proxy services. It covers critical aspects like setting up a proxy client, implementing robust retry logic for transient errors (e.g., 502, 503), managing sticky sessions for consistent IPs, and parsing complex HTML responses. Essential for building reliable, high-scale web scrapers using TypeScript and Python.

This guide provides comprehensive technical instructions for optimizing Palantir Foundry costs. Learn to use incremental transforms to drastically reduce compute rebuilds, right-size Spark profiles based on data volume, and migrate from expensive API polling to efficient, event-driven webhooks, ensuring both cost efficiency and system stability.

This comprehensive guide details the process of implementing a secure and robust system for handling Palantir Foundry webhook events. It covers key steps including API-based webhook registration, mandatory signature verification with replay protection, sophisticated event routing for various object lifecycles (create, update, delete), and ensuring idempotent processing using caching mechanisms like Redis. Use this when external microservices must react reliably and immediately to changes within the Foundry Ontology or data assets.

Direct access to Google's SEO data APIs, including Search Console, PageSpeed Insights, CrUX field data, URL Inspection, Indexing API, and GA4 organic traffic for real search and Core Web Vitals analysis.

HasData is a comprehensive cloud platform designed for extracting structured public web data. It supports three core execution modes: Web Scraping API for arbitrary URLs (including JS rendering), pre-parsed Scraper APIs for known platforms (like Google or Amazon), and asynchronous Scraper Jobs for bulk or recursive crawling. Ideal for market research, e-commerce intelligence, job data collection, and local business lead generation.

Use the HasData CLI to access real-time, structured web data from major platforms. This tool provides dedicated subcommands for various APIs (including Google SERP, Amazon, Zillow, Booking, etc.), enabling users to automate data collection, scrape specific URLs, and retrieve structured information like local business listings, product pricing, and real estate data directly from the command line.

A powerful command-line utility that transforms virtually any website into a structured CLI command. By utilizing OpenClaw's browser, it allows users to scrape and extract structured data (such as JSON) from over 36 platforms—including social media, finance, and developer communities—directly from the terminal. This tool eliminates the need for complex scraping code or browser extensions, making web data accessible via simple one-liners.