Skill UI

A comprehensive pipeline for processing, validating, and optimizing scraped web content from Firecrawl. This tool handles markdown cleaning, structured data extraction using Zod validation, content deduplication, and chunking tailored for Large Language Models (LLMs) and Retrieval-Augmented Generation (RAG) systems. It ensures crawled data is standardized, clean, and ready for downstream consumption or knowledge base indexing.

Firecrawl provides a comprehensive API for web data harvesting. It enables users to perform single-page scraping, multi-page crawling, site mapping (URL discovery), and advanced structured data extraction using Large Language Models (LLMs). Ideal for integrating data pipelines, building web monitoring tools, or conducting market research.

bdistill transforms AI interactions into a structured, queryable knowledge base. It extracts, structures, and quality-scores domain knowledge from both closed-source AI models (in-session) and local open-source models (via Ollama). Users can build comprehensive reference datasets, Q&A pairs, or generate structured training data for traditional machine learning, ensuring validated and exportable domain expertise.

Histolab is a specialized Python library for digital pathology research, enabling robust processing of Whole Slide Images (WSI). It automates complex workflows including tissue detection, sophisticated segmentation, and flexible tile extraction from various formats (SVS, TIFF). This tool is crucial for preparing structured, high-quality datasets required for deep learning models and advanced computational pathology analysis.

This skill allows users to extract structured data (text, tables, attributes) from rendered web pages. It enhances traditional web scraping by ensuring all extracted strings pass mandatory AIDefence PII checks and prompt-injection gates before being stored or returned to the model. It supports building reusable extraction templates and running one-shot queries.