Skill UI

This guide provides comprehensive methodological standards for conducting high-quality human-subjects studies in Human-Robot Interaction (HRI). It covers the entire research lifecycle, including choosing optimal designs (within/between-subjects), ensuring statistical power, reporting effect sizes, and adhering to ethical guidelines (e.g., Wizard-of-Oz disclosure). It ensures research meets the rigorous academic standards required for top-tier publications.

This guide provides comprehensive standards for designing, executing, and reporting systems experiments for top-tier academic venues (like ICDE). It emphasizes methodological rigor, including mandatory ablation studies, reporting variance and tail latency (p99), demonstrating scaling trends (curves over points), disclosing cost trade-offs, and ensuring full hardware and software reproducibility to withstand adversarial review.

This guide provides comprehensive best practices for designing and auditing empirical experiments for top-tier ML conferences. It covers necessary ablations, robustness checks (e.g., data shift, seeds), fair baselines, and detailed compute reporting to ensure that reported gains are scientifically genuine, reproducible, and address common reviewer skepticism.

A comprehensive guide for designing and reporting rigorous experimental results in robotics research. It details the 'evidence ladder' (from simulation to real-world deployment), statistical best practices (e.g., sample size, confidence intervals), ensuring baseline fairness, and quantifying sim-to-real transfer gaps. Essential reading for researchers submitting to top-tier robotics conferences.

A comprehensive guide for designing, executing, and reporting high-stakes research studies in Software Engineering (SE), tailored to meet the stringent standards of top academic conferences like ICSE. It covers best practices for evidence-claim matching, advanced statistical rigor (non-parametric tests, effect sizes), handling AI model ablations, and implementing threats-driven design to ensure findings are robust, valid, and maximally reproducible.

This guide provides rigorous standards for designing, validating, and reporting security research, particularly for high-stakes academic conferences like IEEE S&P. It covers critical areas including adaptive adversary modeling, measurement validity (sampling, ethics), statistical reporting, establishing strong baselines/ablations, and adhering to ethical constraints (IRB, authorization) to ensure evidence is robust and reproducible.

This guide provides comprehensive standards for designing, auditing, and documenting AI experiments for major conferences like IJCAI. It covers establishing strong baselines, conducting ablation studies, and reporting meticulous details on hyperparameters, computational infrastructure, and ethical risks, ensuring maximum reproducibility and academic credibility for AI research.

This comprehensive guide provides best practices for designing, running, and reporting computational experiments for academic journals. It teaches authors how to make performance claims scientifically defensible by addressing potential referee criticisms (e.g., tuning artifacts, seed luck). It covers advanced statistical techniques (performance profiles, nonparametric tests) and details the full structure required for a complete, verifiable GitHub data deposit.

A comprehensive guide to designing rigorous, reproducible, and fair experimental protocols for computational science research, particularly for top-tier academic journals. It covers critical elements such as selecting standard benchmark instances, establishing strong baselines, ensuring fair parameter tuning, reporting hardware constraints, and performing robust statistical validation, helping researchers avoid common pitfalls and maximize the scientific validity of their claims.

This framework provides a comprehensive methodology for designing, auditing, and reporting empirical measurements about large-scale systems like the Internet. It guides users to ensure measurements are scientifically rigorous, by matching claims to evidence, quantifying coverage bias, designing for temporal changes, and adhering to strict ethical guidelines and data provenance standards.

This comprehensive guide outlines best practices for designing, evaluating, and reporting experimental results in speech processing research (ASR, TTS, Speaker Verification, etc.). It details required metrics (WER, MOS, EER), establishing robust baselines, conducting significance testing (bootstrap, CI), and ensuring comprehensive condition coverage (speakers, noise, languages) to enhance the scientific rigor of academic submissions.

A comprehensive guide for designing, auditing, and reporting reliable robotic experiments, particularly for major conferences like IROS. It moves beyond simple success rates, detailing how to map every claim to verifiable evidence (trials, simulations, field data). Key areas covered include defining pre-set success criteria, reporting failure taxonomies, ensuring fair baselines, and quantifying the critical sim-to-real gap using advanced small-n statistical methods.