Skill UI

An expert guide for deploying and optimizing Large Language Models (LLMs) entirely on local hardware. Mastering the entire local AI ecosystem, including inference engines like Ollama, vLLM, and llama.cpp. Provides deep knowledge on quantization formats (GGUF, EXL2, AWQ), VRAM calculation, and ensuring privacy-first, offline deployment for state-of-the-art models.

This tool formats prompts for various Large Language Model (LLM) providers, including Anthropic, OpenAI, Gemini, and Ollama. It is essential for building robust Retrieval-Augmented Generation (RAG) pipelines. Users can format messages, create HNSW indexes from documents, route relevant context, and manage provider status, ensuring compatibility across different AI ecosystems.

An expert guide for deploying and optimizing Large Language Models (LLMs) entirely on local hardware. Mastering the entire local AI ecosystem, including inference engines like Ollama, vLLM, and llama.cpp. Provides deep knowledge on quantization formats (GGUF, EXL2, AWQ), VRAM calculation, and ensuring privacy-first, offline deployment for state-of-the-art models.