Skill UI

A comprehensive guide covering advanced offensive techniques for AWS cloud environments. Techniques include detailed IAM enumeration, privilege escalation paths, SSRF exploitation targeting metadata endpoints (IMDSv1/v2), S3 bucket exploitation, and Lambda function code extraction. Essential for security professionals and red team operations conducting authorized cloud vulnerability assessments.

A comprehensive Python SDK for accessing Azure AI Language service capabilities. It enables advanced Natural Language Processing (NLP) features, including sentiment analysis, named entity recognition (NER), key phrase extraction, language detection, and sensitive PII detection. Ideal for building sophisticated text analysis applications and data pipelines.

A comprehensive Python SDK for accessing Azure AI Language service capabilities. It enables advanced Natural Language Processing (NLP) features, including sentiment analysis, named entity recognition (NER), key phrase extraction, language detection, and sensitive PII detection. Ideal for building sophisticated text analysis applications and data pipelines.

This skill manages and refines search results obtained from Exa's neural search API. It provides comprehensive control over content extraction scope, allowing users to selectively retrieve metadata, highlights, full text, or structured summaries. Key features include implementing result caching with TTL, deduplicating citations, and crucial token budget management, ensuring the retrieved context fits within LLM context window limits for robust RAG pipelines.

A comprehensive guide containing minimal working examples for all core Exa search operations. It demonstrates basic metadata search, deep content extraction (text, highlights, summary), finding semantically similar pages, and retrieving content for specified URLs. Ideal for developers starting a new Exa integration or learning advanced RAG patterns.

This advanced workflow executes sophisticated web data gathering tasks. It supports three primary functions: LLM-powered structured data extraction using custom JSON schemas or prompts; efficient batch scraping of multiple known URLs; and rapid site mapping to discover all reachable URLs on a domain. Use this when you require reliable, typed data structures rather than raw markdown content.

A comprehensive pipeline for processing, validating, and optimizing scraped web content from Firecrawl. This tool handles markdown cleaning, structured data extraction using Zod validation, content deduplication, and chunking tailored for Large Language Models (LLMs) and Retrieval-Augmented Generation (RAG) systems. It ensures crawled data is standardized, clean, and ready for downstream consumption or knowledge base indexing.

Firecrawl provides a comprehensive API for web data harvesting. It enables users to perform single-page scraping, multi-page crawling, site mapping (URL discovery), and advanced structured data extraction using Large Language Models (LLMs). Ideal for integrating data pipelines, building web monitoring tools, or conducting market research.

This comprehensive guide identifies common anti-patterns and integration mistakes when using Firecrawl for web scraping and content extraction. It serves as a vital code review checklist, helping developers avoid pitfalls such as unbounded crawling, unspecified output formats, or aggressive API polling, ensuring robust and efficient data pipelines.

This comprehensive guide details how to set up a robust, local development environment for Firecrawl integrations. It utilizes self-hosted Docker containers and Redis to eliminate reliance on paid API credits during development. The setup supports both unit testing (with mocked SDK) and full integration testing against the local instance, ensuring a seamless and efficient workflow for scraping and web data extraction projects.

A comprehensive guide for migrating web scraping pipelines from tools like Puppeteer, Playwright, and Cheerio to Firecrawl. This skill demonstrates how to replace complex, browser-intensive code with simple API calls, handling single-page scraping, structured data extraction using LLMs, and large-scale site crawling, while eliminating the need for manual browser management and anti-bot workarounds.

This comprehensive reference architecture details a multi-stage pipeline for web scraping and content ingestion using Firecrawl. It seamlessly integrates single-page scraping, site-wide crawling, URL mapping, and structured data extraction. The subsequent processing layer handles cleaning, deduplication, and chunking, making this blueprint ideal for designing robust knowledge bases, RAG systems, and complex AI data pipelines.