Skill UI

SkyPilot orchestrates ML training, batch jobs, and serving across 20+ clouds with automatic cost-aware region selection, spot-instance recovery, managed clusters, and GPU-aware distributed training, letting you optimize spend and avoid vendor lock-in.

This guide details how to integrate Vast.ai's GPU provisioning capabilities into automated CI/CD pipelines, such as GitHub Actions. It enables developers to run GPU-accelerated tests, model benchmarks, and validations automatically. Key features include robust instance lifecycle management (provisioning, running, and cleanup) and advanced cost-control mechanisms (e.g., setting budget limits) to ensure reliable and efficient testing in a cloud environment.

A comprehensive guide for diagnosing and resolving common errors encountered when utilizing the Vast.ai platform. It provides quick references and fixes for HTTP status codes (e.g., 401, 429), instance lifecycle issues, CLI command failures, Docker image loading problems, SSH connectivity errors, and CUDA memory issues. Essential for maximizing GPU rental efficiency and debugging cloud instances.

This guide demonstrates how to implement robust Role-Based Access Control (RBAC) and financial governance for cloud GPU environments. It allows organizations to allocate resources, set team-specific budgets, whitelist approved GPUs, and track spending via detailed audit logs. Ideal for multi-team research and engineering environments requiring strict cost accountability and access separation.

This comprehensive runbook provides rapid, structured procedures for incident response on Vast.ai cloud GPU instances. It covers common failure scenarios like spot preemption, training job crashes, and GPU hardware issues. Users can follow the steps for triage, mitigation, recovery, and postmortem analysis to minimize downtime and ensure computational continuity.

A comprehensive guide to installing and configuring the Vast.ai Command Line Interface (CLI) and REST API access. This skill is used for setting up new cloud integrations, managing API keys, and initializing access to GPU compute instances from the Vast.ai marketplace. It provides steps for CLI authentication, environment variable setup, and implementing a Python client for resource management.

This guide establishes a fast, reproducible local development workflow for GPU workloads using Vast.ai. It covers key practices such as testing Docker images locally (in CPU mode), mocking external APIs like Vast.ai, and implementing robust unit and integration tests. This is essential for minimizing cloud GPU costs and accelerating the iteration cycle for complex AI/ML projects.

This deep dive guides users through migrating complex GPU workloads, such as deep learning training pipelines, from major hyperscalers (AWS, GCP, Azure) or other cloud platforms to Vast.ai. It covers critical steps including cost comparison analysis, adapting Docker images for new environments, securely handling cloud credentials via environment variables, and implementing robust validation and rollback procedures to ensure a smooth transition.

This guide details how to implement environment isolation (dev, staging, prod) for GPU cloud deployments on Vast.ai. It uses environment variables and configuration classes to enforce separate API keys, budget caps, instance limits, and GPU whitelists for each deployment tier, ensuring efficient resource management and cost control.

This comprehensive guide outlines security best practices for utilizing Vast.ai's cloud environment. It covers secure API key management, hardening SSH access to GPU instances, implementing proper data cleanup before instance destruction, and adhering to robust network security protocols. Use this when setting up, auditing, or deploying sensitive AI/ML workloads on shared cloud hardware.

Comprehensive guide for upgrading the Vast.ai CLI and Python SDK. This skill helps users manage API version migrations, detect breaking changes, and update associated Docker images (e.g., CUDA versions). It ensures continuous compatibility when working with cloud GPU computing resources.

LatchBio Integration provides a Python-first platform to compose, deploy, and monitor serverless bioinformatics pipelines with the Latch SDK, decorator-based tasks, cloud storage (LatchFile/Dir), GPU tuning, and Nextflow or Snakemake interoperability.