Download

Skill UI

Browse and discover 16569+ curated skills

All Development Artificial Intelligence Design & Creative Product & Business Data Science Marketing Soft Skills Productivity Engineering Languages

Search Tensor Parallelism , found 3 results

Default Newest Most Downloaded

DeepSpeed Distributed I/O Guide

Orchestra-Research/AI-Research-SKILLs

Guides engineers through DeepSpeed distributed training and NVMe I/O optimizations, covering ZeRO, pipeline parallelism, mixed precision, and DeepNVMe handles for synchronous and asynchronous tensor storage.

High Throughput LLM Serving

serving-llms-vllm

Orchestra-Research/AI-Research-SKILLs

Serve production-grade LLM APIs with vLLM, leveraging PagedAttention, continuous batching, quantization, and tensor parallelism to maximize throughput while keeping latency, GPU usage, and scalability under control for OpenAI-compatible deployments.

Megatron Core LLM Training

training-llms-megatron

Orchestra-Research/AI-Research-SKILLs

Provides production-ready Megatron-Core workflows for training 2B–462B parameter LLMs with tensor/pipeline/expert/context parallelism, maximizing GPU efficiency on H100 clusters.

1

Language