Skill UI

This guide details the use of the GGUF format and quantization techniques for running large language models (LLMs) efficiently. GGUF enables optimal inference on consumer hardware, Apple Silicon, and systems requiring CPU-only operation. By compressing models using various K-quant methods (like Q4_K_M), developers can significantly reduce memory footprint and hardware requirements while maintaining high performance.

Execute complex and compute-intensive workloads directly on fully managed Hugging Face cloud infrastructure. This skill eliminates the need for local setup, allowing users to run jobs using cloud CPUs, GPUs, or TPUs. Ideal for large-scale data processing, batch inference, reproducible model training, and scheduled automation tasks, while persisting results to the Hugging Face Hub.

llama.cpp is a pure C/C++ library designed for efficient LLM inference, optimized to run on resource-constrained environments. It excels in scenarios where high-end NVIDIA GPUs (CUDA) are unavailable, making it ideal for Apple Silicon Macs, AMD/Intel GPUs, or edge deployment devices like Raspberry Pi. It supports GGUF quantization formats, enabling significant memory reduction and speed improvements for local, cross-platform AI applications.

RWKV is an RNN+Transformer hybrid architecture with linear-time inference, infinite context, and GPT-style training. It delivers constant-memory, streaming generation on CUDA and CPU, ideal for long-context, memory-constrained deployments.

OpenAI’s Whisper provides robust multilingual speech-to-text transcriptions, translations to English, and language detection across 99 languages, suitable for podcasts, meetings, and noisy audio workflows with CPU/GPU acceleration and batch or streaming modes.

A state-of-the-art solution for real-time object detection using the advanced YOLO 2026 model. This skill detects 80+ COCO object classes (people, vehicles, animals) and outputs bounding boxes with high precision. It features automatic hardware acceleration, optimizing the model for various platforms (CUDA, MPS, OpenVINO, ROCm) to ensure maximum speed and efficiency, whether running on CPU, GPU, or Neural Engine.

This skill provides high-performance, real-time object detection using the Intel OpenVINO runtime. It operates via a Docker container, ensuring cross-platform compatibility. Supports detection across various Intel accelerators (NCS2, iGPU, Arc GPU) and CPUs. Users can customize parameters like confidence threshold, target classes, processing FPS, and model precision to optimize performance for specific hardware and accuracy needs.