Skill UI

A comprehensive guide for selecting and optimizing embedding models for advanced vector search and retrieval-augmented generation (RAG) applications. This guide covers model comparison, chunking strategies, dimension reduction techniques, and provides runnable Python templates for both OpenAI and local Sentence Transformer implementations.

A comprehensive guide to building production-grade evaluation systems for Large Language Models (LLMs). This skill covers advanced methodologies, including Direct Scoring and Pairwise Comparison, alongside critical techniques for mitigating systematic biases (e.g., Position Bias, Length Bias). Learn how to select appropriate metrics and structure prompts to ensure reliable, consistent, and objective quality assessment across various AI applications.

This guide provides a deep dive into migrating machine learning workloads, including inference services and training pipelines, from major hyperscalers (AWS, GCP, Azure) to the CoreWeave GPU cloud. It covers cost comparisons, containerization, Kubernetes YAML adaptation, and a phased deployment strategy, helping users ensure a smooth, cost-effective, and optimized transition.

Generates a comprehensive Chinese interview-prep cheat sheet for a specific ML/LLM topic, including formulas with derivations, from-scratch PyTorch code, comparison tables, and 25 high-frequency interview questions at L1/L2/L3 levels. Ideal for interview preparation and focused technical review.

This professional tool helps developers and researchers identify the optimal AI model for a specific task, such as coding, reasoning, or image recognition. It queries official HuggingFace leaderboards, filters models based on hardware constraints (e.g., available VRAM or RAM), and provides a detailed comparison table including benchmark scores, parameter size, and licensing information.

This skill executes the DeepSWE benchmark, a comprehensive coding-agent evaluation suite. It uses OpenRouter and mini-swe-agent to score various Large Language Models (LLMs) on 113 tasks, providing reproducible results for model comparison, development assessment, and research benchmarking. Use this when a standardized, deep evaluation of LLM coding capabilities is required.

This skill provides a detailed, side-by-side comparison of advanced LLM agent evaluation frameworks, such as ruflo and HAL. It helps researchers and developers identify capability gaps—including real code execution, full web browsing, and structured file parsing—and prioritize architectural improvements for robust agent benchmarking and performance tracking.

This skill manages repeated rollouts and recursive prompting by maintaining an append-only decision ledger. It tracks trials, marks, and coherence checks to prevent auto-approval of live trading or destructive actions. Ideal for high-dimensional search, stochastic optimization, and ensemble comparison requiring visible evidence trails.

A utility designed to generate high-dimensional vector embeddings (384-dim) from various sources including text, code, or documents. This process converts raw data into numerical representations optimized for semantic search, similarity comparison, and clustering, utilizing ONNX and HNSW indexing for efficient retrieval.

A detailed guide for authors structuring the 'Related Work' section of theoretical machine learning papers. It shifts focus from qualitative prose to quantitative comparison, instructing users to build explicit tables comparing prior bounds versus new bounds, and systematically covering diverse literature lanes like complexity theory, statistics, and open problems to rigorously establish novelty.

A comprehensive guide for positioning continual learning and lifelong agent research for the Conference on Lifelong Learning Agents (CoLLAs). This tool helps authors strategically re-frame their work, assess its fit, and optimize the narrative to meet the specific evidence bar of top CS venues focusing on nonstationary learning, adaptation, and memory. It covers scope calibration, required evidence types, and comparison with related ML conferences.

A comprehensive guide for academic researchers on how to structure and support claims in AI papers, particularly for top-tier conferences like ECAI. It details how to match the type of claim (e.g., completeness, efficiency, generalization) to the appropriate evidence—whether it requires a formal proof, a controlled empirical comparison, or a real-world deployment demonstration. The guide covers best practices for ML (seeds, ablations, baselines), multi-agent systems, and ensuring full provenance and academic honesty.