Download

Skill UI

Browse and discover 19740+ curated skills

All Development Artificial Intelligence Design & Creative Product & Business Data Science Marketing Soft Skills Productivity Engineering Languages

Search Positional Encoding , found 2 results

Default Newest Most Downloaded

Long Context Extensions

Orchestra-Research/AI-Research-SKILLs

Extends transformer context windows using RoPE, YaRN, ALiBi, and position interpolation so long documents (32k-128k+ tokens) can be processed, pre-trained models lengthened, and efficient positional encodings or extrapolation strategies deployed.

Long Context Extension Techniques

emerging-techniques-long-context

davila7/claude-code-templates

Master techniques to extend transformer model context windows beyond original limits using RoPE, YaRN, and ALiBi. Ideal for processing long documents (32k-128k+ tokens) and implementing efficient positional encodings for LLMs. Covers rotary embeddings, attention biases, and interpolation strategies.

1

Language