Skill UI

Provides production-ready Megatron-Core workflows for training 2B–462B parameter LLMs with tensor/pipeline/expert/context parallelism, maximizing GPU efficiency on H100 clusters.

This guide details how to integrate Vast.ai's GPU provisioning capabilities into automated CI/CD pipelines, such as GitHub Actions. It enables developers to run GPU-accelerated tests, model benchmarks, and validations automatically. Key features include robust instance lifecycle management (provisioning, running, and cleanup) and advanced cost-control mechanisms (e.g., setting budget limits) to ensure reliable and efficient testing in a cloud environment.

A comprehensive guide for diagnosing and resolving common errors encountered when utilizing the Vast.ai platform. It provides quick references and fixes for HTTP status codes (e.g., 401, 429), instance lifecycle issues, CLI command failures, Docker image loading problems, SSH connectivity errors, and CUDA memory issues. Essential for maximizing GPU rental efficiency and debugging cloud instances.

This comprehensive workflow guides users through the end-to-end process of utilizing cloud-based GPU computing resources on Vast.ai. It covers searching for ideal GPU offers based on specs and price, provisioning an instance, running complex training or inference jobs via SSH, collecting model artifacts, and crucially, destroying the instance to prevent unexpected billing. Ideal for deep learning training and research.

This advanced workflow orchestrates complex, multi-node GPU clusters on Vast.ai. It is designed for large-scale distributed machine learning training, automatically handling spot instance preemption and resuming jobs from checkpoints. Furthermore, it provides comprehensive cost analysis by tracking billing history, allowing users to optimize GPU spending and manage cluster teardown efficiently.

This comprehensive script suite provides methods to optimize GPU cloud computing expenses on Vast.ai. It guides users through selecting the most cost-efficient GPU for their workload, leveraging interruptible (spot) instances, and implementing critical lifecycle management safeguards. Features include detecting idle compute resources, auto-destroy timers, and calculating total cost burn rates, ensuring AI model training and inference jobs stay within budget.

A comprehensive guide to managing training data and model artifacts securely on cloud GPU instances (e.g., Vast.ai). It covers best practices for data transfer (SCP, compressed, cloud staging), implementing AES-256 encryption, managing checkpoints to S3, and performing secure cleanup before instance destruction, ensuring compliance and data integrity.

Collects comprehensive diagnostic evidence for troubleshooting Vast.ai GPU instances. This bundle gathers account status, lists all running instances, retrieves recent logs, performs remote GPU diagnostics (e.g., nvidia-smi, CUDA checks), and verifies API connectivity. It is essential for creating detailed support tickets when encountering persistent infrastructure issues.

A comprehensive guide for deploying Machine Learning training jobs and inference services on the Vast.ai GPU cloud. This skill covers the entire deployment lifecycle, including optimizing Docker images for performance, creating automated provisioning scripts using the Vast.ai CLI, implementing robust data transfer strategies (SCP, rsync), and performing post-deployment health checks.

This guide demonstrates how to implement robust Role-Based Access Control (RBAC) and financial governance for cloud GPU environments. It allows organizations to allocate resources, set team-specific budgets, whitelist approved GPUs, and track spending via detailed audit logs. Ideal for multi-team research and engineering environments requiring strict cost accountability and access separation.

A comprehensive guide demonstrating the full lifecycle of GPU resource utilization on Vast.ai. This includes searching for available hardware using CLI and REST APIs, provisioning a dedicated GPU instance (e.g., using PyTorch images), connecting via SSH, running deep learning workloads, and finally, securely destroying the instance to stop billing. Ideal for testing cloud integration or managing ML compute pipelines.

This comprehensive runbook provides rapid, structured procedures for incident response on Vast.ai cloud GPU instances. It covers common failure scenarios like spot preemption, training job crashes, and GPU hardware issues. Users can follow the steps for triage, mitigation, recovery, and postmortem analysis to minimize downtime and ensure computational continuity.