Download

Skill UI

Browse and discover 19721+ curated skills

All Development Artificial Intelligence Design & Creative Product & Business Data Science Marketing Soft Skills Productivity Engineering Languages

Search Lookahead Decoding , found 2 results

Default Newest Most Downloaded

Speculative Decoding Acceleration

speculative-decoding

Orchestra-Research/AI-Research-SKILLs

Speeds up LLM inference by combining speculative decoding with Medusa multiple heads and lookahead techniques so chatbots, code assistants, and other real-time workloads can run with 1.5-3.6× lower latency while preserving target-model quality.

Speculative Decoding for LLM Inference

emerging-techniques-speculative-decoding

davila7/claude-code-templates

Accelerate LLM inference with speculative decoding, Medusa multiple heads, and lookahead decoding to achieve 1.5-3.6x speedup and lower latency.

1

Language