huggingface-local-models
sickn33/antigravity-awesome-skills
A comprehensive guide and skill for deploying large language models (LLMs) locally using the llama.cpp framework and GGUF quantization format. It covers searching the Hugging Face Hub, selecting optimal quantizations (e.g., Q4_K_M), running local servers, and achieving OpenAI-compatible API endpoints. Supports various hardware backends including CPU, Mac Metal, CUDA, and ROCm. Ideal for developers needing offline, private LLM inference.
