Skill UI

Evaluates large language models across 60+ academic benchmarks (MMLU, HumanEval, GSM8K, TruthfulQA, HellaSwag) with standardized prompts and metrics, making it easy to benchmark HuggingFace or API models, compare releases, and track training progress.

Fine-tune LLMs with TRL’s RLHF toolkit, covering SFT, DPO, PPO/GRPO and reward model training so you can align HuggingFace Transformers with human preferences or feedback in post-training workflows.

Provides calibration-free weight quantization for LLMs down to 1-bit precision with multiple optimized backends, ideal for fast deployments with vLLM/HuggingFace and LoRA/PEFT fine-tuning without collecting calibration data.

Execute complex and compute-intensive workloads directly on fully managed Hugging Face cloud infrastructure. This skill eliminates the need for local setup, allowing users to run jobs using cloud CPUs, GPUs, or TPUs. Ideal for large-scale data processing, batch inference, reproducible model training, and scheduled automation tasks, while persisting results to the Hugging Face Hub.

High-performance Rust-backed tokenization toolkit with Python bindings, offering BPE/WordPiece/Unigram, custom vocabulary training, alignment tracking, and production-ready integrations for NLP pipelines.

Provides expert guidance for using llama-factory to fine-tune LLMs through its WebUI, covering QLoRA/LoRA quantized setups, multimodal models, and automation tips for developers exploring models like Llama, Qwen, or Gemma.

LlamaGuard is Meta’s 7–8B safety-specialized LLM that filters both prompts and responses by classifying six threat categories, enabling fast inference via vLLM/SageMaker and integration into NeMo Guardrails for end-to-end moderation.

This skill provides comprehensive guidance on training Mixture of Experts (MoE) models, including architectures like Mixtral and DeepSeek-V3. It details techniques for achieving large-scale model capacity with significantly reduced computational costs (e.g., 5x reduction vs. dense models). Topics covered include top-k routing, load balancing, expert parallelism, and integration with frameworks like DeepSpeed and HuggingFace for efficient, resource-constrained training.

Covers HuggingFace PEFT workflows for LoRA/QLoRA-based LLM fine-tuning, enabling sub-1% parameter updates on limited GPUs plus adapter serving tips.

Quantizes HuggingFace LLMs to 8-bit or 4-bit with bitsandbytes, cutting memory by up to 75% while keeping accuracy, and supports QLoRA fine-tuning plus 8-bit optimizers for faster, memory-efficient training.

A comprehensive guide to leveraging Stable Diffusion models via the HuggingFace Diffusers library. This skill facilitates state-of-the-art image creation, including Text-to-Image generation from prompts, Image-to-Image translation, inpainting, outpainting, and advanced workflow building. Supports various models like SDXL and SD 3.0, ideal for professional creative and computational vision tasks.

Weights & Biases (W&B) automates experiment logging, real-time dashboards, hyperparameter sweeps, artifact tracking, and model registry/versioning for ML teams using PyTorch, TensorFlow, or HuggingFace workflows.