Skill UI

This comprehensive guide details strategies for migrating enterprise data platforms to Databricks. It provides PySpark examples for discovery, schema mapping (converting types from Hadoop, Snowflake, etc.), and executing robust data transfer methods like SYNC, DEEP CLONE, and CTAS. Use this when moving data from legacy sources like Hadoop, Snowflake, or Redshift to a modern Delta Lake environment.

This comprehensive guide provides structured steps and code examples for upgrading Databricks Runtime versions and performing critical data migrations. It covers best practices for version compatibility checking, transitioning from Hive Metastore to Unity Catalog using methods like SYNC and CTAS, and updating deprecated API endpoints, ensuring a smooth platform evolution for data pipelines.

This workflow provides the primary mechanism for converting complex, live websites into clean, LLM-ready markdown content. It supports single-page scraping using `scrapeUrl`, deep multi-page site crawling with `crawlUrl`, and scalable async crawling for large datasets. Ideal for building robust content ingestion pipelines and reliably extracting structured information from the web.

Master the implementation of Firecrawl webhooks for robust, real-time handling of asynchronous crawling and batch scraping jobs. Instead of inefficiently polling the crawl status, configure webhook endpoints to receive instant POST events (e.g., `crawl.page`, `crawl.completed`). This guide covers event types, signature verification using HMAC-SHA256, and processing streamed data for building advanced data pipelines.

This skill guides you through integrating PostHog's Customer Data Platform (CDP) features. It covers setting up webhooks to trigger real-time actions (e.g., syncing to CRM, sending notifications) when specific user events occur. Furthermore, it demonstrates how to query event data using the Events API and perform complex funnel analysis using HogQL, allowing for deep, custom insights into user behavior.

Trackio is a comprehensive library for logging, visualizing, and managing ML experiment metrics and alerts. It allows developers to use a Python API to log metrics and set diagnostic alerts (INFO/WARN/ERROR) during training. Furthermore, a dedicated CLI enables metric retrieval and dashboard viewing, syncing data to Hugging Face Spaces for persistent, remote monitoring, making it ideal for autonomous ML agent workflows.

This framework manages the ingestion, organization, synchronization, and search of knowledge across multiple storage layers, including local files, persistent memory, vector stores, and Git repositories. It provides a structured approach for ensuring knowledge durability, deduplication, and maintaining a 'single source of truth' across complex development and operational contexts.

Execute comprehensive, asynchronous transcription workflows using AssemblyAI. This tool handles file upload, queues jobs, and provides advanced audio intelligence features. Capabilities include speaker diarization, sentiment analysis, named entity recognition (NER), topic categorization (IAB), content safety moderation, and sensitive PII redaction. Ideal for processing meeting recordings, interviews, and large volumes of spoken content.

This skill provides comprehensive access to Bright Data's SERP API and Web Scraper API. It allows users to collect structured search engine results (Google, Bing, Yahoo) synchronously, or trigger large-scale, asynchronous data collections with webhooks. Ideal for market research, SEO analysis, and large-scale data scraping projects.

This workflow automates the extraction of key insights from meeting recordings using Fathom transcripts and summaries. It builds a robust pipeline to identify action items, sync tasks to project management tools, and analyze overall meeting patterns, streamlining post-meeting follow-up and record-keeping.

A comprehensive guide for migrating data to, from, and between Notion workspaces. This skill covers complex data pipelines, including rate-limited bulk imports (CSV/JSON), full database exports with pagination, cross-database syncing, and data transformation patterns for integrating content from sources like Confluence and Google Docs. Essential for building robust Notion ETL workflows.

A comprehensive guide for executing core Snowflake data loading workflows. This covers setting up stages (S3, GCS, Azure), defining file formats (CSV, JSON, Parquet), and using COPY INTO for bulk loading. It also details advanced continuous ingestion using Snowpipe, enabling real-time data synchronization from cloud storage into Snowflake tables.