Download

Skill UI

Browse and discover 5145+ curated skills

All Development Artificial Intelligence Design & Creative Product & Business Data Science Marketing Soft Skills Productivity Engineering Languages

Search Reverse KLD , found 1 results

Default Newest Most Downloaded

LLM Knowledge Distillation

knowledge-distillation

Orchestra-Research/AI-Research-SKILLs

Compress large language models via teacher-student distillation, covering temperature scaling, soft targets, reverse KLD, and response distillation so you can deploy smaller LLMs with GPT-4-level behavior and lower inference cost.

1

Language