Skill UI

A comprehensive guide detailing best practices for ensuring the reproducibility of computational claims in Large Language Model (LLM) papers. It outlines a layered approach (Exact, Budgeted, Drifting) for verifying results, providing protocols for handling open-weight checkpoints, proprietary API models, and documenting compute costs and failure modes honestly.

A detailed guide for authors submitting theoretical machine learning papers (like COLT) regarding the appropriate inclusion and design of numerical simulations. It emphasizes that numerics should only visualize proved bounds, phase transitions, or separations, maintaining the focus on theoretical proofs rather than empirical data. Provides rules for plotting, reporting variability, and maintaining academic honesty.

A detailed guide for authors structuring the 'Related Work' section of theoretical machine learning papers. It shifts focus from qualitative prose to quantitative comparison, instructing users to build explicit tables comparing prior bounds versus new bounds, and systematically covering diverse literature lanes like complexity theory, statistics, and open problems to rigorously establish novelty.

A comprehensive strategic guide for authors targeting the Conference and Labs of the Evaluation Forum (CLEF). It helps frame IR/NLP research by defining the appropriate contribution type, evidence bar, and rigorous evaluation methods required for top-tier academic submission, ensuring the paper aligns with the venue's specific community expectations.

This comprehensive guide outlines best practices for packaging and releasing scientific artifacts—including code, training configurations, demonstration data, and policy checkpoints—for robotics research papers. It details how to prepare materials for anonymous reviewer assessment and for durable public release, ensuring the work is fully reproducible by the academic community.

A comprehensive guideline for researchers developing robot-learning papers. It details best practices for experimental design, emphasizing statistical rigor, handling stochasticity (training seeds, initial states), bridging the sim-to-real gap, and ensuring fairness across baseline policy families (BC/RL/VLA). This resource helps ensure claims are supported by credible evidence.

A comprehensive pre-upload audit checklist for submitting papers to the CoRL (Conference on Robot Learning). This guide details specific requirements for the submission package, including the mandatory 8-page limit (which must account for a dedicated Limitations section), adherence to double-anonymous rules, and detailed sweeps for preserving author and lab anonymity in text, figures, and videos. Essential for ensuring compliance with complex conference guidelines.

A comprehensive guide for designing, auditing, and executing rigorous experimental programs for top-tier computer vision papers (e.g., CVPR). It covers essential scientific components, including establishing fair benchmarks, structured ablation studies, documenting failure modes, quantifying computational efficiency, and demonstrating cross-dataset generalization, ensuring the research is reproducible and robust.

A comprehensive guide for hardening deep learning papers, particularly in Computer Vision (CVPR). It details best practices for achieving rigorous reproducibility by utilizing the Compute Reporting Form (CRF), maintaining a detailed recipe ledger, ensuring benchmark split hygiene, and meticulously documenting all training hyperparameters, seeds, and variance analyses for academic publication.

A comprehensive guide for structuring the empirical evidence section of top-tier NLP conference papers (e.g., EACL). It mandates rigorous controls, including fair baselines (tuned models, explicit LLM prompts), statistical significance testing (variance, CI), contamination checks, and detailed human evaluation protocols. Use this to elevate your research from mere assertion to scientifically audited proof.

This comprehensive checklist is designed for auditing NLP research papers, particularly for major conferences like EACL. It serves as a claims audit, ensuring that every reported result, claim, or finding—including hyperparameters, compute costs, verbatim prompts, data sources, and significance testing—is fully documented and reproducible. It emphasizes academic rigor and transparency in AI research.

A comprehensive pre-submission audit guide for authors submitting papers to EACL (Computational Linguistics). It covers critical areas such as adherence to format gates (8/4 content pages, required Limitations section), strict anonymity requirements, mandatory declarations (Responsible NLP, preprint status), and crucial advice regarding the single, non-fallback submission cycle. Use this before uploading to the ACL Rolling Review cycle.