Skill UI

A comprehensive guide for researchers submitting academic papers, detailing the standards required for scientific reproducibility. It covers fixing experimental environments (toolchains, datasets, hardware), differentiating result sources (simulation vs. physical measurement), statistical reporting best practices, and providing clear guidelines for code and data availability statements.

This guide provides a comprehensive framework for designing rigorous and defensible evaluation sections for machine learning and information retrieval papers, particularly for top-tier conferences like WSDM. It covers the four critical evidence quadrants—Effectiveness, Validity, Efficiency, and Robustness—and details necessary protocols, such as temporal splits, proper baseline selection (including heuristics), ablation studies, and hardware-aware performance reporting. Use this when auditing or writing the experimental section of a research paper.