Skill UI

This comprehensive Python SDK serves as a client library for managing the full lifecycle of Machine Learning resources on Azure Machine Learning. It allows users to programmatically handle workspaces, register data and models, provision compute clusters, define complex training jobs, and build reproducible, end-to-end MLOps pipelines.

This comprehensive Python SDK serves as a client library for managing the full lifecycle of Machine Learning resources on Azure Machine Learning. It allows users to programmatically handle workspaces, register data and models, provision compute clusters, define complex training jobs, and build reproducible, end-to-end MLOps pipelines.

Provides automated guidance for configuring learning rate schedulers during ML training, covering best practices, setup patterns, and framework-ready code snippets for PyTorch, TensorFlow, and Scikit-learn while validating against common standards.

This skill guides the design and implementation of a complete, production-grade Machine Learning pipeline. It employs a multi-agent orchestration workflow, systematically covering all stages of the ML lifecycle: data ingestion and quality assurance, feature engineering, model training, optimization, and robust deployment (MLOps). It ensures built-in reproducibility, monitoring, and scalability.

This skill provides comprehensive guidance for building production-grade MLOps pipelines. It covers the entire machine learning lifecycle, from initial data ingestion and rigorous feature engineering to model training, advanced validation (A/B testing, performance drift), and robust deployment strategies (Canary, Blue-green). It enables the design and orchestration of scalable, reproducible, and observable ML systems using tools like Airflow and Kubeflow.

Combines fine-tuned models with Mergekit to blend math, coding, and chat expertise without retraining, covering SLERP, TIES, DARE, Task Arithmetic, and linear merges for rapid experimentation and deployment.

nanoGPT is a simplified, minimalist implementation designed specifically for educational purposes. It reproduces the core architecture of GPT-2 (124M) using clean, hackable code, allowing users to understand the entire transformer pipeline from scratch. The framework supports full workflows, including data preparation on various datasets (e.g., Shakespeare, OpenWebText), model training, and text generation, making it ideal for students and researchers learning NLP and deep learning principles.

Pyvene is a declarative framework designed for performing causal interventions on PyTorch neural networks. It allows researchers to conduct advanced experiments such as activation patching, causal tracing (ROME-style), and interchange intervention training (IIT). Use this library when you need to test causal hypotheses about model behavior, deeply interpret model components, or ensure reproducibility in advanced AI research.

RWKV is an RNN+Transformer hybrid architecture with linear-time inference, infinite context, and GPT-style training. It delivers constant-memory, streaming generation on CUDA and CPU, ideal for long-context, memory-constrained deployments.

Guides post-training of GLM-class LLMs with Megatron-LM and SGLang, focusing on GRPO rollout generation, custom data buffers, and tight RL scaling workflows for research and production use.

SAELens provides a framework for training and analyzing Sparse Autoencoders (SAEs). SAEs decompose the dense, often polysemantic activations of large language models into sparse, monosemantic features. Use this when you need to discover the discrete, interpretable concepts a model has learned, study feature superposition, or analyze specific safety-relevant behaviors (like bias or deception) within deep neural networks.

torchforge is Meta's advanced PyTorch-native library designed for agentic Reinforcement Learning (RL). It fundamentally separates core RL algorithms from complex distributed infrastructure concerns. This allows researchers to rapidly prototype and experiment with novel RL methods (like GRPO) using clean, PyTorch-native abstractions, while automatically handling large-scale tasks like distributed training across thousands of GPUs using Monarch and TorchTitan.