Skill UI

Automate the entire deployment lifecycle for ML inference services on CoreWeave GPU cloud. This workflow integrates unit testing, container image building (to GHCR), and rolling deployment to CoreWeave Kubernetes clusters via GitHub Actions. Ideal for ensuring stable, high-performance deployment of GPU-dependent models. Key features include validating GPU manifest requests and managing deployments using standard Kubernetes APIs.

A comprehensive guide to diagnose and resolve common CoreWeave infrastructure errors. It covers issues related to GPU scheduling, Pod status (e.g., Pending), CUDA Out of Memory errors, NCCL timeouts, and Kubernetes resource allocation within AI/ML deployment pipelines.

A comprehensive guide and set of tools for establishing a local development workflow tailored for CoreWeave GPU deployments. This includes steps for building Docker containers, validating Kubernetes YAML manifests using dry-run, and managing the full deployment lifecycle for AI inference services before pushing to the cloud.

A comprehensive utility designed for managing CoreWeave cloud infrastructure migrations. It facilitates upgrading between GPU generations (e.g., A100 to H100), updating CUDA versions, and handling Kubernetes resource changes. The tool uses K8s APIs to audit deployments, detect deprecated instances, and execute controlled rollbacks.

This guide details the process of deploying production-grade inference services on CoreWeave using KServe. It covers setting up autoscaling, GPU scheduling, and implementing scale-to-zero functionality for efficient ML model serving endpoints. Ideal for MLOps engineers deploying large language models (LLMs) or other complex AI models in a production environment.

This guide details how to set up and execute large-scale, distributed GPU training jobs on the CoreWeave platform. It covers both single-node multi-GPU setups and multi-node training utilizing PyTorch DDP and Kubernetes resources (A100/H100). This workflow is ideal for fine-tuning large language models (LLMs) or running complex deep learning models that require high-performance, shared-storage compute clusters.

A comprehensive guide for optimizing cloud GPU expenditures on CoreWeave. Learn strategies like right-sizing instances, implementing scale-to-zero for development environments, and using quantization techniques (e.g., AWQ, GPTQ) to fit large models onto smaller, cost-effective GPUs, ensuring maximum efficiency and budget adherence for AI/ML workloads.

This skill guides the secure handling and lifecycle management of large-scale data artifacts, including training datasets, model weights, and checkpoint snapshots, within GPU cloud environments. It provides best practices for data pipelines, covering secure import via Kubernetes PVCs, compliant export, and stringent data validation, ensuring adherence to encryption standards (AES-256) and regulatory requirements (PII masking, RBAC).

This bundle is designed to collect comprehensive diagnostics for CoreWeave clusters, including GPU node status, Kubernetes Pod logs, event history, and API connectivity. It aggregates critical cluster-level resource allocation and failure data into a single, actionable archive. Use it when preparing a support ticket to expedite the diagnosis of complex infrastructure issues like stuck pods, OOM errors, or resource bottlenecks.

This skill provides comprehensive guidance for deploying and managing GPU-accelerated AI inference services on CoreWeave Kubernetes (CKS). It covers best practices including containerization using NVIDIA CUDA base images, configuring specific GPU resource limits (A100/H100), setting up robust health checks, and executing controlled rolling updates. Ideal for managing multi-model inference and scaling demanding AI workloads in a cloud environment.

This skill outlines how to implement and manage Role-Based Access Control (RBAC) and namespace isolation for multi-team GPU workloads running on CoreWeave's Kubernetes platform. It provides guidance on setting strict resource quotas, preventing noisy-neighbor issues, and defining granular roles (e.g., ML Engineer, Inference Operator). This is essential for maintaining resource isolation, ensuring compliance (SOC 2, HIPAA), and managing access across large-scale cloud deployments.

This guide demonstrates how to deploy GPU workloads on the CoreWeave platform using Kubernetes (kubectl). It covers deploying vLLM inference services for large language model (LLM) testing and running batch CUDA jobs for benchmarking. This is ideal for users running their first GPU workloads, testing inference pipelines, or verifying cluster access on bare-metal GPU nodes (A100, H100).