Skill UI

llama.cpp is a pure C/C++ library designed for efficient LLM inference, optimized to run on resource-constrained environments. It excels in scenarios where high-end NVIDIA GPUs (CUDA) are unavailable, making it ideal for Apple Silicon Macs, AMD/Intel GPUs, or edge deployment devices like Raspberry Pi. It supports GGUF quantization formats, enabling significant memory reduction and speed improvements for local, cross-platform AI applications.

A comprehensive skill for fine-tuning and training large language and vision models using advanced techniques like TRL (SFT, DPO, GRPO) or Unsloth. This process runs entirely on managed Hugging Face cloud GPUs, eliminating the need for local GPU setup. It supports modern training workflows, model conversion (GGUF for local deployment), and ensures seamless artifact storage to the Hugging Face Hub.

An expert guide for deploying and optimizing Large Language Models (LLMs) entirely on local hardware. Mastering the entire local AI ecosystem, including inference engines like Ollama, vLLM, and llama.cpp. Provides deep knowledge on quantization formats (GGUF, EXL2, AWQ), VRAM calculation, and ensuring privacy-first, offline deployment for state-of-the-art models.

This guide helps determine the optimal deployment strategy for Qdrant, a vector database. It compares four main options—Local Mode, Self-Hosted (Docker), Qdrant Cloud (Zero-Ops), and Qdrant EDGE—based on project requirements such as control needs, operational overhead, data residency, and required latency. Use it to decide whether to prototype, manage full infrastructure, or prioritize minimal latency.

A comprehensive guide and skill for deploying large language models (LLMs) locally using the llama.cpp framework and GGUF quantization format. It covers searching the Hugging Face Hub, selecting optimal quantizations (e.g., Q4_K_M), running local servers, and achieving OpenAI-compatible API endpoints. Supports various hardware backends including CPU, Mac Metal, CUDA, and ROCm. Ideal for developers needing offline, private LLM inference.

A comprehensive guide detailing the entire model lifecycle for RuView. It supports multiple advanced tracking methods including camera-free pose estimation (WiFlow), camera-supervised methods using MediaPipe, robust contrastive embeddings (RuVector), and domain generalization (MERIDIAN). Covers training, evaluation, and deployment across local GPU and cloud platforms.

This skill deploys the OpenMed Model Context Protocol (MCP) server, exposing critical clinical NLP tools such as NER, PII extraction, and de-identification. It enables AI coding agents and chat clients to interact with OpenMed's capabilities via simple tool calls, running locally on-device to ensure user data privacy and security. Supports both stdio and Streamable HTTP deployment modes.

Guides users to select a local, on-device Personally Identifiable Information (PII) detection model from a committed registry. It filters models based on language, required runtime environment (e.g., PyTorch, MLX), and size constraints. The process emphasizes building an offline shortlist and mandates rigorous pre-deployment recall validation and performance benchmarking to ensure secure, privacy-preserving deployment.