Skill UI

Hypogenic automates LLM-driven hypothesis generation and testing over tabular datasets, blending literature insights with empirical analysis to accelerate discovery in domains like deception detection or AI content evaluation.

A comprehensive toolkit designed to professionalize LLM prompt workflows. It moves prompts from ad-hoc drafts to measurable, production-ready assets through A/B testing against structured test cases, immutable version tracking, and governance guidelines. Essential for marketing teams needing verifiable quality and safety for AI-generated content.

This skill is designed for running comprehensive evaluations of Hugging Face Hub models on local hardware. It supports multiple evaluation frameworks, including `inspect-ai` and `lighteval`, and provides flexibility in backend selection (e.g., `vllm`, Transformers, or `accelerate`) to optimize for performance and compatibility. Use this for local GPU benchmarking, smoke testing, and backend selection, but note that it does not handle remote job orchestration or result publishing.

This skill provides comprehensive commands for creating, managing, versioning, and querying structured datasets within the Arize platform. It covers dataset CRUD operations, appending examples, and exporting data in various formats (JSON, CSV, Parquet) using the `ax` CLI. Ideal for preparing test data, generating evaluation examples, or retrieving golden datasets for LLM development and model testing.

Phoenix Evals enables developers to build and run evaluators for AI and LLM applications. It supports both code-based and LLM-based evaluation methods, including RAG systems. Users can create datasets, run experiments, validate evaluator accuracy, and implement production guardrails. Available in Python and TypeScript, it helps ensure model performance and reliability through systematic testing and human validation.

Automates comprehensive regression testing for all enabled cloud Large Language Model (LLM) providers. This includes verifying core connectivity, standard chat completion, structured JSON output, and Server-Sent Events (SSE) streaming capabilities. Essential for ensuring the reliability and stability of multi-cloud AI integrations in a CI/CD pipeline.

This guide demonstrates how to deploy GPU workloads on the CoreWeave platform using Kubernetes (kubectl). It covers deploying vLLM inference services for large language model (LLM) testing and running batch CUDA jobs for benchmarking. This is ideal for users running their first GPU workloads, testing inference pipelines, or verifying cluster access on bare-metal GPU nodes (A100, H100).

This harness provides comprehensive, reproducible evaluation pipelines for complex LLM chains and agents (LangChain/LangGraph 1.0). It integrates golden dataset management, LangSmith evaluation, RAGAS metrics, deepeval LLM-as-judge, and structured agent trajectory analysis. Use it when establishing quality benchmarks for new chains, diagnosing performance regressions after model switches, or implementing CI/CD gates to prevent quality drops.

Automate the Continuous Integration and Continuous Deployment (CI/CD) workflow for applications leveraging Together AI's OpenAI-compatible API. This skill sets up comprehensive GitHub Actions workflows to run unit tests (mocking completions and embeddings) on every Pull Request, and full integration tests (live API calls) upon merging to the main branch. It ensures robust validation of prompt formatting, model selection, and API connectivity for various LLMs.

A comprehensive expert playbook detailing advanced Large Language Model (LLM) prompt injection techniques. Covers direct methods (instruction override, role play), indirect attacks (RAG poisoning, web data manipulation), and sophisticated tool/function calling abuse for data exfiltration and security bypass. Essential for rigorous AI application security testing.

Turn any OpenAPI or Swagger spec into an MCP server using the mcp-use TypeScript SDK. Maps REST operations to LLM-callable tools with zod schemas, auth wiring, live testing, and one-command deploy.

This skill provides a repeatable assessment for RAG systems, testing for critical vulnerabilities in vector stores and embedding models. It specifically addresses embedding inversion, cross-tenant data leakage, and knowledge-base poisoning, aligning with OWASP LLM08:2025. Use when performing authorized security audits of retrieval layers and multi-tenant isolation.