Skill UI

This guide details the process of deploying production-grade inference services on CoreWeave using KServe. It covers setting up autoscaling, GPU scheduling, and implementing scale-to-zero functionality for efficient ML model serving endpoints. Ideal for MLOps engineers deploying large language models (LLMs) or other complex AI models in a production environment.

A comprehensive guide for optimizing cloud GPU expenditures on CoreWeave. Learn strategies like right-sizing instances, implementing scale-to-zero for development environments, and using quantization techniques (e.g., AWQ, GPTQ) to fit large models onto smaller, cost-effective GPUs, ensuring maximum efficiency and budget adherence for AI/ML workloads.

This skill guides the secure handling and lifecycle management of large-scale data artifacts, including training datasets, model weights, and checkpoint snapshots, within GPU cloud environments. It provides best practices for data pipelines, covering secure import via Kubernetes PVCs, compliant export, and stringent data validation, ensuring adherence to encryption standards (AES-256) and regulatory requirements (PII masking, RBAC).

This guide provides step-by-step instructions to configure access to the CoreWeave Kubernetes Service (CKS). It covers downloading the kubeconfig file, setting API tokens, and verifying GPU node access using standard `kubectl` commands. This is essential for deploying AI/ML workloads on bare-metal GPU infrastructure.

This guide provides a deep dive into migrating machine learning workloads, including inference services and training pipelines, from major hyperscalers (AWS, GCP, Azure) to the CoreWeave GPU cloud. It covers cost comparisons, containerization, Kubernetes YAML adaptation, and a phased deployment strategy, helping users ensure a smooth, cost-effective, and optimized transition.

This reference architecture provides a comprehensive blueprint for deploying Machine Learning models on CoreWeave's GPU cloud infrastructure. It details the structure for multi-model serving (e.g., vLLM, TGI), scalable Kubernetes deployments, shared persistent storage (PVC), and autoscaling mechanisms using KServe/Knative. Use this when designing robust MLOps pipelines, planning high-performance multi-model inference services, or establishing standardized best practices for GPU cloud deployment.

This SDK provides production-ready Python patterns for managing GPU workloads on CoreWeave. It includes helpers for defining specific GPU affinity, setting resource limits (A100, H100), and generating complete Kubernetes Deployment YAML. Use this library for building robust inference clients, managing GPU deployments programmatically, or automating complex AI workflows.