Download

Skill UI

Browse and discover 9978+ curated skills

All Development Artificial Intelligence Design & Creative Product & Business Data Science Marketing Soft Skills Productivity Engineering Languages

Search AutoGPTQ , found 1 results

Default Newest Most Downloaded

GPTQ Quantization Guide

Orchestra-Research/AI-Research-SKILLs

GPTQ enables post-training 4-bit quantization for large LLMs, delivering up to 4× memory reduction and 3-4× faster inference with under 2% perplexity loss on consumer GPUs through AutoGPTQ, PEFT, and Transformer integrations.

1

Language