Skill UI

llama.cpp is a pure C/C++ library designed for efficient LLM inference, optimized to run on resource-constrained environments. It excels in scenarios where high-end NVIDIA GPUs (CUDA) are unavailable, making it ideal for Apple Silicon Macs, AMD/Intel GPUs, or edge deployment devices like Raspberry Pi. It supports GGUF quantization formats, enabling significant memory reduction and speed improvements for local, cross-platform AI applications.

RWKV is an RNN+Transformer hybrid architecture with linear-time inference, infinite context, and GPT-style training. It delivers constant-memory, streaming generation on CUDA and CPU, ideal for long-context, memory-constrained deployments.

This comprehensive skill manages the entire computer vision pipeline, from custom dataset annotation to model deployment. Users can fine-tune YOLO models on proprietary COCO-formatted datasets using an agent-driven workflow. Key features include hardware-aware training (supporting CUDA, MPS, ROCm), automatic export to optimized formats (TensorRT, CoreML, OpenVINO, ONNX), and seamless, one-click deployment as an active detection skill.

A state-of-the-art solution for real-time object detection using the advanced YOLO 2026 model. This skill detects 80+ COCO object classes (people, vehicles, animals) and outputs bounding boxes with high precision. It features automatic hardware acceleration, optimizing the model for various platforms (CUDA, MPS, OpenVINO, ROCm) to ensure maximum speed and efficiency, whether running on CPU, GPU, or Neural Engine.

A comprehensive guide and skill for deploying large language models (LLMs) locally using the llama.cpp framework and GGUF quantization format. It covers searching the Hugging Face Hub, selecting optimal quantizations (e.g., Q4_K_M), running local servers, and achieving OpenAI-compatible API endpoints. Supports various hardware backends including CPU, Mac Metal, CUDA, and ROCm. Ideal for developers needing offline, private LLM inference.