Skill UI

A comprehensive system for implementing policy guardrails in data enrichment pipelines. It enforces critical controls including credit spending limits, blocks the enrichment of sensitive PII (e.g., SSN, bank details), and validates input data quality. Essential for maintaining compliance (GDPR/CCPA) and managing costs when processing large volumes of personal and business data.

A comprehensive pipeline for processing, validating, and optimizing scraped web content from Firecrawl. This tool handles markdown cleaning, structured data extraction using Zod validation, content deduplication, and chunking tailored for Large Language Models (LLMs) and Retrieval-Augmented Generation (RAG) systems. It ensures crawled data is standardized, clean, and ready for downstream consumption or knowledge base indexing.

This comprehensive reference architecture details a multi-stage pipeline for web scraping and content ingestion using Firecrawl. It seamlessly integrates single-page scraping, site-wide crawling, URL mapping, and structured data extraction. The subsequent processing layer handles cleaning, deduplication, and chunking, making this blueprint ideal for designing robust knowledge bases, RAG systems, and complex AI data pipelines.

This skill provides a comprehensive guide and implementation for deploying a production-ready, containerized integration service using Docker. It connects to the Juicebox API to manage datasets, execute advanced AI-powered analyses, and retrieve structured business insights. The service includes health check mechanisms and supports zero-downtime rolling updates, ensuring reliable real-time data processing and analysis.

Ray Data offers scalable distributed data processing for ML workloads, streaming across CPU/GPU clusters and integrating with PyTorch, TensorFlow, and Ray Train. Use it for batch inference, ETL, and multi-modal preprocessing from a laptop up to hundreds of nodes.

Histolab streamlines whole-slide microscopy by automating tissue detection, tile extraction, and stain normalization for H&E scans, making it ideal for lightweight dataset prep and quick tile-based analysis.

PathML is a Python toolkit for computational pathology workflows, loading 160+ slide formats, preprocessing H&E images, constructing spatial graphs, training HoVer-Net/HACTNet models, and analyzing multiplex imaging for ML-ready pathology data.

This guide details how to write advanced correlation searches using Splunk's Search Processing Language (SPL). It covers techniques like threshold-based detection, sequence analysis, and anomaly detection to identify sophisticated security threats (e.g., brute force, data exfiltration, lateral movement) in a Security Operations Center (SOC) environment. Mastery of SPL is essential for closing SIEM detection gaps and ensuring compliance.

Dask is a Python library for parallel and distributed computing that scales pandas, NumPy, and custom workflows beyond memory limits. It supports DataFrames, Arrays, and Bags for processing large datasets across single machines or clusters. Ideal for scientific computing, ETL tasks, and parallelizing operations when data exceeds available RAM or requires distributed execution.

Vaex is a high-performance Python library designed for processing and analyzing large tabular datasets that exceed available RAM. It supports out-of-core DataFrame operations, lazy evaluation, fast aggregations, and efficient visualization of big data. Ideal for working with massive CSV, HDF5, Arrow, or Parquet files, performing statistics on billions of rows, and building machine learning pipelines without memory constraints.

This comprehensive guide details the process of implementing a secure and robust system for handling Palantir Foundry webhook events. It covers key steps including API-based webhook registration, mandatory signature verification with replay protection, sophisticated event routing for various object lifecycles (create, update, delete), and ensuring idempotent processing using caching mechanisms like Redis. Use this when external microservices must react reliably and immediately to changes within the Foundry Ontology or data assets.

This utility detects and redacts sensitive personally identifiable information (PII) from screenshots and images. It can mask various data types, including IDs, credit card numbers, API keys, phone numbers, and emails. Crucially, all processing is conducted locally and offline, ensuring that sensitive data never leaves the user's machine. It is essential for secure debugging, data sharing, and analysis workflows.