Skill UI

RWKV is an RNN+Transformer hybrid architecture with linear-time inference, infinite context, and GPT-style training. It delivers constant-memory, streaming generation on CUDA and CPU, ideal for long-context, memory-constrained deployments.

Guides senior data scientists through designing controlled experiments, engineering structured features, training ML models, and translating results into decisions using Python, R, SQL, and tools like Scikit-learn, XGBoost, and MLflow.

Automates sklearn pipeline builder tasks within ML training, activating on relevant triggers to guide data prep, model training, hyperparameter tuning, and experiment tracking with production-ready code and standards validation.

Guides post-training of GLM-class LLMs with Megatron-LM and SGLang, focusing on GRPO rollout generation, custom data buffers, and tight RL scaling workflows for research and production use.

SAELens provides a framework for training and analyzing Sparse Autoencoders (SAEs). SAEs decompose the dense, often polysemantic activations of large language models into sparse, monosemantic features. Use this when you need to discover the discrete, interpretable concepts a model has learned, study feature superposition, or analyze specific safety-relevant behaviors (like bias or deception) within deep neural networks.

Automates splitting datasets into training, validation, and test subsets by generating and running Python code so you can quickly prepare data for machine learning model training and evaluation.

torchforge is Meta's advanced PyTorch-native library designed for agentic Reinforcement Learning (RL). It fundamentally separates core RL algorithms from complex distributed infrastructure concerns. This allows researchers to rapidly prototype and experiment with novel RL methods (like GRPO) using clean, PyTorch-native abstractions, while automatically handling large-scale tasks like distributed training across thousands of GPUs using Monarch and TorchTitan.

Automates guidance on train/test split workflows inside ML training, surfacing best-practice patterns, code snippets, and validation tips for PyTorch, TensorFlow, and sklearn projects.

Automates the end-to-end training of machine learning models by analyzing datasets, selecting suitable algorithms, tuning parameters, performing cross-validated training, and emitting performance metrics plus a saved model artifact.

This comprehensive workflow guides users through the end-to-end process of utilizing cloud-based GPU computing resources on Vast.ai. It covers searching for ideal GPU offers based on specs and price, provisioning an instance, running complex training or inference jobs via SSH, collecting model artifacts, and crucially, destroying the instance to prevent unexpected billing. Ideal for deep learning training and research.

This advanced workflow orchestrates complex, multi-node GPU clusters on Vast.ai. It is designed for large-scale distributed machine learning training, automatically handling spot instance preemption and resuming jobs from checkpoints. Furthermore, it provides comprehensive cost analysis by tracking billing history, allowing users to optimize GPU spending and manage cluster teardown efficiently.

A comprehensive guide for deploying Machine Learning training jobs and inference services on the Vast.ai GPU cloud. This skill covers the entire deployment lifecycle, including optimizing Docker images for performance, creating automated provisioning scripts using the Vast.ai CLI, implementing robust data transfer strategies (SCP, rsync), and performing post-deployment health checks.