Download

Skill UI

Browse and discover 5145+ curated skills

All Development Artificial Intelligence Design & Creative Product & Business Data Science Marketing Soft Skills Productivity Engineering Languages

Search Pipeline Parallelism , found 2 results

Default Newest Most Downloaded

DeepSpeed Training Assistant

Orchestra-Research/AI-Research-SKILLs

Provides expert guidance for DeepSpeed distributed training, covering ZeRO optimizations, pipeline parallelism, mixed precision, DeepNVMe I/O, and best practices for debugging or deploying large-scale models.

Megatron LLM Training

training-llms-megatron

Orchestra-Research/AI-Research-SKILLs

Megatron-Core orchestrates training of 2B–462B parameter LLMs with tensor/pipeline/context/expert parallelism, maximizing H100 MFU for production-grade distributed training pipelines.

1

Language