Skill UI

A comprehensive toolkit for building production-grade AI agents focused on crypto business development. This skill guides users through the entire token listing lifecycle: autonomously discovering promising assets across multiple chains, applying a weighted 100-point scoring model, verifying safety via advanced wallet forensics, and managing outreach pipelines with necessary human oversight and LLM cascade patterns.

Orchestrates PyTorch-native TorchTitan 4D parallelism (FSDP2, TP, PP, CP) for large-scale LLM pretraining, scaling from 8 to 512+ GPUs with Float8, torch.compile, and distributed checkpointing to boot Llama 3.1, DeepSeek V3, or custom models.

A comprehensive toolkit for evaluating the performance of code generation models. It supports benchmarking against industry standards like HumanEval, MBPP, and MultiPL-E across multiple languages. Use this tool to quantitatively compare different LLM coding abilities and measure code synthesis quality using pass@k metrics.

Evaluates large language models across 60+ academic benchmarks (MMLU, HumanEval, GSM8K, TruthfulQA, HellaSwag) with standardized prompts and metrics, making it easy to benchmark HuggingFace or API models, compare releases, and track training progress.

This skill manages and refines search results obtained from Exa's neural search API. It provides comprehensive control over content extraction scope, allowing users to selectively retrieve metadata, highlights, full text, or structured summaries. Key features include implementing result caching with TTL, deduplicating citations, and crucial token budget management, ensuring the retrieved context fits within LLM context window limits for robust RAG pipelines.

Guides ML engineers through dataset prep, PEFT strategy selection, LoRA/QLoRA adapter setup, training monitoring, and deployment checks for practical LLM fine-tuning, quantization, and adapter merge workflows.

Fine-tune LLMs with TRL’s RLHF toolkit, covering SFT, DPO, PPO/GRPO and reward model training so you can align HuggingFace Transformers with human preferences or feedback in post-training workflows.

This guide details the use of the GGUF format and quantization techniques for running large language models (LLMs) efficiently. GGUF enables optimal inference on consumer hardware, Apple Silicon, and systems requiring CPU-only operation. By compressing models using various K-quant methods (like Q4_K_M), developers can significantly reduce memory footprint and hardware requirements while maintaining high performance.

GPTQ enables post-training 4-bit quantization for large LLMs, delivering up to 4× memory reduction and 3-4× faster inference with under 2% perplexity loss on consumer GPUs through AutoGPTQ, PEFT, and Transformer integrations.

A comprehensive guide to implementing advanced LLM patterns using the Groq API. This workflow demonstrates how to handle chat completions, robust tool/function calling for integrating external services (like weather or search), and enforcing structured data output using JSON mode and strict schemas. Ideal for building real-time, production-grade AI features.

This guide details a production-ready reference architecture for applications built on Groq's LPU inference API. It covers sophisticated model routing based on latency, quality, or cost needs, implementing streaming pipelines, and establishing robust multi-provider fallback chains (e.g., Groq primary to OpenAI backup). Ideal for designing and reviewing complex, resilient LLM systems.

Provides calibration-free weight quantization for LLMs down to 1-bit precision with multiple optimized backends, ideal for fast deployments with vLLM/HuggingFace and LoRA/PEFT fine-tuning without collecting calibration data.