Skill UI

Automates comprehensive regression testing for all enabled cloud Large Language Model (LLM) providers. This includes verifying core connectivity, standard chat completion, structured JSON output, and Server-Sent Events (SSE) streaming capabilities. Essential for ensuring the reliability and stability of multi-cloud AI integrations in a CI/CD pipeline.

A comprehensive guide and skill for deploying large language models (LLMs) locally using the llama.cpp framework and GGUF quantization format. It covers searching the Hugging Face Hub, selecting optimal quantizations (e.g., Q4_K_M), running local servers, and achieving OpenAI-compatible API endpoints. Supports various hardware backends including CPU, Mac Metal, CUDA, and ROCm. Ideal for developers needing offline, private LLM inference.