Skill UI

This skill automates the process of renting, managing, and terminating cloud GPU instances on vast.ai. It analyzes your AI/ML task—determining VRAM, required GPU count, and estimated runtime—and then searches for the most cost-effective and reliable GPU offers, presenting optimized options for your training workflow.

Utilize Modal, a serverless GPU cloud, for running complex machine learning workloads, including training, fine-tuning, and inference. This tool provides a zero-config environment, eliminating the need for SSH setup or Docker management. It features automatic scale-to-zero billing and local-first execution, making high-powered GPU compute accessible for debugging and small-scale experiments.

Modal is a serverless cloud platform designed for executing Python-based AI/ML workloads. It provides on-demand access to powerful GPUs (e.g., H100, A100), scalable serverless functions, and custom containerization. Use cases include deploying ML models, running large-scale training/inference jobs, creating web APIs, and scheduling data pipelines, all defined entirely in code.

Automate the entire deployment lifecycle for ML inference services on CoreWeave GPU cloud. This workflow integrates unit testing, container image building (to GHCR), and rolling deployment to CoreWeave Kubernetes clusters via GitHub Actions. Ideal for ensuring stable, high-performance deployment of GPU-dependent models. Key features include validating GPU manifest requests and managing deployments using standard Kubernetes APIs.

A comprehensive guide and set of tools for establishing a local development workflow tailored for CoreWeave GPU deployments. This includes steps for building Docker containers, validating Kubernetes YAML manifests using dry-run, and managing the full deployment lifecycle for AI inference services before pushing to the cloud.

A comprehensive utility designed for managing CoreWeave cloud infrastructure migrations. It facilitates upgrading between GPU generations (e.g., A100 to H100), updating CUDA versions, and handling Kubernetes resource changes. The tool uses K8s APIs to audit deployments, detect deprecated instances, and execute controlled rollbacks.

This workflow guides users through configuring CAST AI's autoscaler policies to achieve optimal cost management and resource utilization within a Kubernetes cluster. It covers enabling spot instances, setting node downscaler/evictor rules, defining cluster limits, and creating specialized node templates (e.g., for GPU or spot workers) using Terraform. Use this when implementing Phase 2 automation or optimizing cloud spend.

A comprehensive guide for optimizing cloud GPU expenditures on CoreWeave. Learn strategies like right-sizing instances, implementing scale-to-zero for development environments, and using quantization techniques (e.g., AWQ, GPTQ) to fit large models onto smaller, cost-effective GPUs, ensuring maximum efficiency and budget adherence for AI/ML workloads.

This skill guides the secure handling and lifecycle management of large-scale data artifacts, including training datasets, model weights, and checkpoint snapshots, within GPU cloud environments. It provides best practices for data pipelines, covering secure import via Kubernetes PVCs, compliant export, and stringent data validation, ensuring adherence to encryption standards (AES-256) and regulatory requirements (PII masking, RBAC).

This skill provides comprehensive guidance for deploying and managing GPU-accelerated AI inference services on CoreWeave Kubernetes (CKS). It covers best practices including containerization using NVIDIA CUDA base images, configuring specific GPU resource limits (A100/H100), setting up robust health checks, and executing controlled rolling updates. Ideal for managing multi-model inference and scaling demanding AI workloads in a cloud environment.

This skill outlines how to implement and manage Role-Based Access Control (RBAC) and namespace isolation for multi-team GPU workloads running on CoreWeave's Kubernetes platform. It provides guidance on setting strict resource quotas, preventing noisy-neighbor issues, and defining granular roles (e.g., ML Engineer, Inference Operator). This is essential for maintaining resource isolation, ensuring compliance (SOC 2, HIPAA), and managing access across large-scale cloud deployments.

This guide provides a deep dive into migrating machine learning workloads, including inference services and training pipelines, from major hyperscalers (AWS, GCP, Azure) to the CoreWeave GPU cloud. It covers cost comparisons, containerization, Kubernetes YAML adaptation, and a phased deployment strategy, helping users ensure a smooth, cost-effective, and optimized transition.