Skill UI

A comprehensive guide to managing training data and model artifacts securely on cloud GPU instances (e.g., Vast.ai). It covers best practices for data transfer (SCP, compressed, cloud staging), implementing AES-256 encryption, managing checkpoints to S3, and performing secure cleanup before instance destruction, ensuring compliance and data integrity.

This guide provides a robust implementation for handling asynchronous webhooks from ElevenLabs. It covers the critical steps of receiving POST notifications (such as transcription completion, post-call audio, and failure events), performing secure HMAC-SHA256 signature verification, and routing the event data to specific processing handlers. Ideal for integrating ElevenLabs into conversational AI pipelines, ensuring data integrity and reliable background processing.

This tool audits the integrity of machine learning experiments by checking for common fraud patterns such as fake ground truth, score normalization fraud, and phantom results. It utilizes an external reviewer backend (like Codex or manual review) to perform an adversarial review across all project artifacts, ensuring reported results are trustworthy and methodologically sound.

A specialized quality gate skill designed to review complex, multi-source outputs generated by the CrossFrame framework. It rigorously checks reasoning fidelity, evidence boundaries, source anchors, and structural continuity. Use this when advanced verification of logical rigor and source integrity is required, ensuring outputs meet strict internal protocols and avoid common structural failures.

This skill outlines the implementation of advanced runtime defenses for production Large Language Model (LLM) applications. It covers using multiple industry-leading guardrail systems—including Llama Guard, NeMo Guardrails, and LLM Guard—to detect and block adversarial attacks such as prompt injection, jailbreaks, and toxic content. It provides a comprehensive defense-in-depth strategy for ensuring model safety and output integrity in real-world deployments.

This skill provides comprehensive tools to detect data poisoning and model backdooring attacks throughout the machine learning lifecycle. It checks data provenance, detects label-flip anomalies (using Cleanlab), and analyzes model activations and spectra (using ART) to identify malicious triggers or compromised weights, ensuring ML supply chain integrity.

The Anti-Deception Harness detects manipulative user prompts, such as manufactured urgency, pressure to validate, or undue reliance on authority. It calls an external tool to provide a structured scaffold detailing integrity procedures and counter-evidence, ensuring responses are honest and robust, preventing compromised or sycophantic answers. Ideal for high-stakes decision support.

Guides the user through the complete, multi-phase GAIA benchmark process. This workflow covers environment validation, cost estimation, running the benchmark, and generating a highly integrity-checked, HAL-compatible submission package required for leaderboards. It ensures both transport-integrity and earning-integrity.

This tool provides deep inspection and auditing capabilities for GEPA (genetic-evolution prompt-adaptation) genomes by utilizing the internal `@metaharness/darwin/gepa` library. It is crucial for advanced AI development pipelines, allowing users to validate the structural integrity of genomes, render the full system prompt derived from a genome, or classify specific failure modes found in an execution transcript. Ideal for CI/CD gating and debugging complex LLM applications.