Skill UI

This comprehensive guide details strategies for migrating enterprise data platforms to Databricks. It provides PySpark examples for discovery, schema mapping (converting types from Hadoop, Snowflake, etc.), and executing robust data transfer methods like SYNC, DEEP CLONE, and CTAS. Use this when moving data from legacy sources like Hadoop, Snowflake, or Redshift to a modern Delta Lake environment.

This comprehensive guide provides structured steps and code examples for upgrading Databricks Runtime versions and performing critical data migrations. It covers best practices for version compatibility checking, transitioning from Hive Metastore to Unity Catalog using methods like SYNC and CTAS, and updating deprecated API endpoints, ensuring a smooth platform evolution for data pipelines.

This workflow provides the primary mechanism for converting complex, live websites into clean, LLM-ready markdown content. It supports single-page scraping using `scrapeUrl`, deep multi-page site crawling with `crawlUrl`, and scalable async crawling for large datasets. Ideal for building robust content ingestion pipelines and reliably extracting structured information from the web.

Master the implementation of Firecrawl webhooks for robust, real-time handling of asynchronous crawling and batch scraping jobs. Instead of inefficiently polling the crawl status, configure webhook endpoints to receive instant POST events (e.g., `crawl.page`, `crawl.completed`). This guide covers event types, signature verification using HMAC-SHA256, and processing streamed data for building advanced data pipelines.

This skill guides you through integrating PostHog's Customer Data Platform (CDP) features. It covers setting up webhooks to trigger real-time actions (e.g., syncing to CRM, sending notifications) when specific user events occur. Furthermore, it demonstrates how to query event data using the Events API and perform complex funnel analysis using HogQL, allowing for deep, custom insights into user behavior.

This skill provides comprehensive access to Bright Data's SERP API and Web Scraper API. It allows users to collect structured search engine results (Google, Bing, Yahoo) synchronously, or trigger large-scale, asynchronous data collections with webhooks. Ideal for market research, SEO analysis, and large-scale data scraping projects.

A comprehensive guide for migrating data to, from, and between Notion workspaces. This skill covers complex data pipelines, including rate-limited bulk imports (CSV/JSON), full database exports with pagination, cross-database syncing, and data transformation patterns for integrating content from sources like Confluence and Google Docs. Essential for building robust Notion ETL workflows.

A comprehensive guide for executing core Snowflake data loading workflows. This covers setting up stages (S3, GCS, Azure), defining file formats (CSV, JSON, Parquet), and using COPY INTO for bulk loading. It also details advanced continuous ingestion using Snowpipe, enabling real-time data synchronization from cloud storage into Snowflake tables.

A dedicated skill for performing manual data synchronization and knowledge recall with OpenViking. It allows users to explicitly trigger chat transcript syncing from OpenClaw sessions and perform targeted memory searches via command line, without disrupting normal conversation flow or occupying the standard context engine slot.

HasData is a comprehensive cloud platform designed for extracting structured public web data. It supports three core execution modes: Web Scraping API for arbitrary URLs (including JS rendering), pre-parsed Scraper APIs for known platforms (like Google or Amazon), and asynchronous Scraper Jobs for bulk or recursive crawling. Ideal for market research, e-commerce intelligence, job data collection, and local business lead generation.

This skill facilitates the extraction of population-scale (cohort-level) clinical text from Electronic Health Records (EHR) or FHIR data warehouses using the FHIR Bulk Data Access ($export) operation. It manages the asynchronous job kickoff, polling, and downloading of NDJSON files. The resulting data stream is designed to be fed in batches into OpenMed for mandatory de-identification and Named Entity Recognition (NER) analysis.

HasData is a comprehensive cloud platform designed for extracting structured public web data. It supports three core execution modes: Web Scraping API for arbitrary URLs (including JS rendering), pre-parsed Scraper APIs for known platforms (like Google or Amazon), and asynchronous Scraper Jobs for bulk or recursive crawling. Ideal for market research, e-commerce intelligence, job data collection, and local business lead generation.