Download

Skill UI

Browse and discover 11130+ curated skills

All Development Artificial Intelligence Design & Creative Product & Business Data Science Marketing Soft Skills Productivity Engineering Languages

Search Flash Attention , found 1 results

Default Newest Most Downloaded

Flash Attention Optimizer

optimizing-attention-flash

Orchestra-Research/AI-Research-SKILLs

Flash Attention optimizer delivers 2-4x speedup and 10-20x memory savings for transformer attention, ideal when training or running long-context models that hit GPU memory or latency limits; supports PyTorch native scaled_dot_product_attention, the flash-attn library, H100 FP8 precision, and sliding-window attention.

1

Language