Skill UI

This is the .NET SDK for managing Arize AI Observability and Evaluation resources within Azure Resource Manager (ARM). It provides programmatic access to create, read, update, and delete AI organization resources. It is essential for MLOps professionals and developers who need to monitor, track, and evaluate the performance of AI models deployed on Azure.

Provides expert guidance on designing, implementing, and optimizing cutting-edge computer vision pipelines. Expertise spans real-time object detection (YOLO26), advanced promptable segmentation (SAM 3), and leveraging Vision Language Models (VLMs) for complex visual reasoning. Ideal for building high-performance systems in robotics, autonomous vehicles, and industrial inspection, including 3D reconstruction and edge deployment optimization.

This skill analyzes the predictable ways language models lose performance as context length increases. It details core patterns, including 'lost-in-middle,' context poisoning, and distraction. Use this knowledge to diagnose unpredictable agent failures, design highly reliable systems for long document processing, and implement advanced context engineering strategies.

A comprehensive toolkit for evaluating the performance of code generation models. It supports benchmarking against industry standards like HumanEval, MBPP, and MultiPL-E across multiple languages. Use this tool to quantitatively compare different LLM coding abilities and measure code synthesis quality using pass@k metrics.

This guide details the use of the GGUF format and quantization techniques for running large language models (LLMs) efficiently. GGUF enables optimal inference on consumer hardware, Apple Silicon, and systems requiring CPU-only operation. By compressing models using various K-quant methods (like Q4_K_M), developers can significantly reduce memory footprint and hardware requirements while maintaining high performance.

This guide provides comprehensive strategies for optimizing the execution speed, reliability, and cost efficiency of AI agents. Learn how to minimize latency, right-size models (e.g., Flash vs. Opus), consolidate multiple LLM steps into single prompts, and optimize workflow triggers. Ideal for use when agents are slow, consuming excessive credits, or producing inconsistent results.

This skill simulates an expert prompt engineer, specializing in optimizing prompts for Large Language Models (LLMs). It applies advanced techniques such as Constitutional AI, Chain-of-Thought reasoning, and model-specific tuning. Use this tool to transform basic instructions into production-ready, high-performance prompts, significantly boosting accuracy, reducing hallucinations, and optimizing token usage.

Master comprehensive strategies for evaluating Large Language Model (LLM) applications. This skill covers automated metrics (BLEU, ROUGE, BERTScore), structured human evaluation dimensions, and advanced LLM-as-Judge techniques. Use it to systematically measure model performance, compare prompts, detect regressions, and build confidence in production systems.

This guide provides advanced techniques for optimizing Mistral AI API usage, focusing on latency reduction and throughput maximization. Learn to implement robust caching strategies, utilize streaming responses (SSE), select the optimal model for specific use cases (e.g., Mistral Small for chat, Codestral for code), manage concurrent requests using rate limiting, and efficiently use the Batch API. Essential for building high-performance, production-grade AI applications.

This skill provides comprehensive guidance for building production-grade MLOps pipelines. It covers the entire machine learning lifecycle, from initial data ingestion and rigorous feature engineering to model training, advanced validation (A/B testing, performance drift), and robust deployment strategies (Canary, Blue-green). It enables the design and orchestration of scalable, reproducible, and observable ML systems using tools like Airflow and Kubeflow.

This guide details advanced methods for merging multiple specialized LLMs (e.g., combining math, coding, and chat capabilities) without the need for expensive retraining. Learn various techniques such as Linear Merging, SLERP, Task Arithmetic, TIES-Merging, and DARE. Use mergekit to create high-performing, specialized model variants quickly, significantly improving performance and reducing computational costs.

High-performance RLHF framework that combines Ray, vLLM, and ZeRO-3 to accelerate PPO/GRPO/RLOO/DPO training for 7B-70B+ models on distributed GPU clusters, providing a single-stack workflow for reward models and policy optimization.