Download

Skill UI

Browse and discover 7115+ curated skills

All Development Artificial Intelligence Design & Creative Product & Business Data Science Marketing Soft Skills Productivity Engineering Languages

Search Model Evaluation , found 11 results

Default Newest Most Downloaded

Claude Eval Harness

affaan-m/everything-claude-code

Formal evaluation framework for Claude Code sessions that applies evaluation-driven development to define capability and regression checks, run deterministic and model graders, and track pass@k/pass^k reliability metrics before shipping.

Code Model Evaluation and Benchmarking

evaluating-code-models

Orchestra-Research/AI-Research-SKILLs

A comprehensive toolkit for evaluating the performance of code generation models. It supports benchmarking against industry standards like HumanEval, MBPP, and MultiPL-E across multiple languages. Use this tool to quantitatively compare different LLM coding abilities and measure code synthesis quality using pass@k metrics.

LLM Evaluation Harness

evaluating-llms-harness

Orchestra-Research/AI-Research-SKILLs

Evaluates large language models across 60+ academic benchmarks (MMLU, HumanEval, GSM8K, TruthfulQA, HellaSwag) with standardized prompts and metrics, making it easy to benchmark HuggingFace or API models, compare releases, and track training progress.

Model Evaluation Metrics

model-evaluation-metrics

jeremylongshore/claude-code-plugins-plus-skills

Automates guidance for evaluating machine learning models, covering best practices, sample code, and validation patterns triggered by mentions of model evaluation metrics.

Vertex Agent Builder

vertex-agent-builder

jeremylongshore/claude-code-plugins-plus-skills

Scaffolds production-ready generative AI agents on Vertex AI with Gemini models, multi-modal tools, RAG, and Cloud Run/Endpoint deployment, including observability and evaluation for enterprise scenarios.

AgentFolio Agent Discovery

sickn33/antigravity-awesome-skills

Use AgentFolio to discover, compare, and research autonomous AI agents, frameworks, and tools before building or integrating your own. The directory helps you map capabilities, autonomy models, and deployment patterns while collecting concrete examples for positioning workflows or vendor evaluations.

Agentic Engineering Workflow

agentic-engineering

affaan-m/everything-claude-code

Guides agentic engineering efforts where AI agents execute implementation while humans focus on risk-aware evaluation, breaking work into verifiable units, routing models by complexity, and tracking costs and regression checks.

Hugging Face Local Eval

hugging-face-community-evals

sickn33/antigravity-awesome-skills

Run inspect-ai or lighteval evaluations on Hugging Face Hub models locally, guiding backend choice, smoke tests, and GPU fallbacks before handing off remote tasks.

Managing Annotation Configs and Feedback

arize-annotation

github/awesome-copilot

This skill manages the schema for human feedback (annotation configs) within the Arize platform. It allows users to define label types (categorical, continuous, freeform) and programmatically apply these annotations to project spans using the Python SDK. Essential for establishing standardized human review processes and improving model evaluation.

Manage AI Model Provider Integrations

arize-ai-provider-integration

github/awesome-copilot

This skill provides comprehensive CLI commands to manage AI integrations within Arize. It covers listing, creating, and retrieving configurations for various major LLM providers (including OpenAI, Anthropic, Gemini, AWS Bedrock, etc.), ensuring secure credential storage and proper setup for model evaluation and usage.

Arize Evaluator Workflow

arize-evaluator

github/awesome-copilot

Defines and runs LLM-as-judge evaluators on Arize via ax commands, handling evaluator creation, continuous monitoring, column mapping, trigger runs, and evaluation spans or experiments with configurable templates, models, and query filters.

1

Language