Skill UI

Guides engineers through DeepSpeed distributed training and NVMe I/O optimizations, covering ZeRO, pipeline parallelism, mixed precision, and DeepNVMe handles for synchronous and asynchronous tensor storage.

This tool provides comprehensive Python solutions for processing batches of text-to-video requests using the Kling AI API. It handles controlled parallelism, rate-limiting, and detailed status tracking. Use this when building robust content pipelines that require generating multiple videos efficiently from a list of prompts, supporting synchronous, asynchronous, and webhook callback methods.

Provides production-ready Megatron-Core workflows for training 2B–462B parameter LLMs with tensor/pipeline/expert/context parallelism, maximizing GPU efficiency on H100 clusters.

Configure CircleCI CI/CD pipelines with workflows, orbs, caching, parallelism, approvals, and context secrets. Use for building, testing, and deploying applications.

Expert guidance for implementing distributed training with DeepSpeed, covering ZeRO optimization stages, pipeline parallelism, mixed precision (FP16/BF16/FP8), and I/O optimizations like DeepNVMe. Helps with debugging, API usage, and best practices for large-scale model training on NVIDIA GPUs.

Megatron-Core is a production-ready framework for training large language models ranging from 2B to 462B parameters. It utilizes advanced parallelism strategies like tensor, pipeline, and expert parallelism to maximize GPU efficiency on NVIDIA H100 hardware. Ideal for scaling models beyond 1B parameters with high MFU performance.