Skill UI

A comprehensive guide and set of scripts to maximize cost savings in Kubernetes environments using CAST AI. Learn to implement aggressive spot instance strategies, perform workload right-sizing, utilize cluster hibernation for non-production environments, and analyze monthly savings reports to significantly reduce cloud compute expenditure.

A comprehensive, multi-phase checklist for deploying and validating CAST AI cost optimization and autoscaling features on a production Kubernetes cluster. It guides users through prerequisites, initial monitoring setup (Phase 1), full autoscaling enablement (Phase 2), security hardening (RBAC, secrets), and critical validation commands for safe go-live deployment.

This guide details how to set up and execute large-scale, distributed GPU training jobs on the CoreWeave platform. It covers both single-node multi-GPU setups and multi-node training utilizing PyTorch DDP and Kubernetes resources (A100/H100). This workflow is ideal for fine-tuning large language models (LLMs) or running complex deep learning models that require high-performance, shared-storage compute clusters.

This skill guides the secure handling and lifecycle management of large-scale data artifacts, including training datasets, model weights, and checkpoint snapshots, within GPU cloud environments. It provides best practices for data pipelines, covering secure import via Kubernetes PVCs, compliant export, and stringent data validation, ensuring adherence to encryption standards (AES-256) and regulatory requirements (PII masking, RBAC).

This bundle is designed to collect comprehensive diagnostics for CoreWeave clusters, including GPU node status, Kubernetes Pod logs, event history, and API connectivity. It aggregates critical cluster-level resource allocation and failure data into a single, actionable archive. Use it when preparing a support ticket to expedite the diagnosis of complex infrastructure issues like stuck pods, OOM errors, or resource bottlenecks.

This skill provides comprehensive guidance for deploying and managing GPU-accelerated AI inference services on CoreWeave Kubernetes (CKS). It covers best practices including containerization using NVIDIA CUDA base images, configuring specific GPU resource limits (A100/H100), setting up robust health checks, and executing controlled rolling updates. Ideal for managing multi-model inference and scaling demanding AI workloads in a cloud environment.

This skill outlines how to implement and manage Role-Based Access Control (RBAC) and namespace isolation for multi-team GPU workloads running on CoreWeave's Kubernetes platform. It provides guidance on setting strict resource quotas, preventing noisy-neighbor issues, and defining granular roles (e.g., ML Engineer, Inference Operator). This is essential for maintaining resource isolation, ensuring compliance (SOC 2, HIPAA), and managing access across large-scale cloud deployments.

This guide demonstrates how to deploy GPU workloads on the CoreWeave platform using Kubernetes (kubectl). It covers deploying vLLM inference services for large language model (LLM) testing and running batch CUDA jobs for benchmarking. This is ideal for users running their first GPU workloads, testing inference pipelines, or verifying cluster access on bare-metal GPU nodes (A100, H100).

This runbook provides structured steps for responding to critical production incidents on the CoreWeave platform. Use it when dealing with GPU workload failures, inference service outages, or general Kubernetes resource issues. It guides users through checking pod status, node health, and diagnosing common model loading errors to ensure rapid service recovery.

This guide provides step-by-step instructions to configure access to the CoreWeave Kubernetes Service (CKS). It covers downloading the kubeconfig file, setting API tokens, and verifying GPU node access using standard `kubectl` commands. This is essential for deploying AI/ML workloads on bare-metal GPU infrastructure.

This guide provides a deep dive into migrating machine learning workloads, including inference services and training pipelines, from major hyperscalers (AWS, GCP, Azure) to the CoreWeave GPU cloud. It covers cost comparisons, containerization, Kubernetes YAML adaptation, and a phased deployment strategy, helping users ensure a smooth, cost-effective, and optimized transition.

This guide details setting up and managing CoreWeave GPU cloud infrastructure across Development, Staging, and Production environments. It ensures strict resource separation using dedicated Kubernetes namespaces for GPU quotas and scaling policies. Use this when deploying complex ML/AI workloads requiring robust environment isolation and controlled promotion workflows.