Skill UI

This skill provides comprehensive guidance for deploying and managing GPU-accelerated AI inference services on CoreWeave Kubernetes (CKS). It covers best practices including containerization using NVIDIA CUDA base images, configuring specific GPU resource limits (A100/H100), setting up robust health checks, and executing controlled rolling updates. Ideal for managing multi-model inference and scaling demanding AI workloads in a cloud environment.

Megatron-Core is a production-ready framework for training large language models ranging from 2B to 462B parameters. It utilizes advanced parallelism strategies like tensor, pipeline, and expert parallelism to maximize GPU efficiency on NVIDIA H100 hardware. Ideal for scaling models beyond 1B parameters with high MFU performance.