Skill UI

A comprehensive guide for designing and auditing rigorous empirical evaluations for sensing systems, particularly Human Activity Recognition (HAR). It emphasizes best practices such as leave-one-subject-out cross-validation, using real human subjects under diverse conditions, reporting event-level metrics (e.g., Macro-F1) over raw accuracy, establishing fair baselines, and mitigating data leakage (e.g., subject or session leakage). This ensures that reported results are robust, generalizable, and defensible against academic skepticism.

This guide assists researchers in selecting the most appropriate and rigorous methodology for Production and Operations Management (POM) manuscripts. It covers various research tracks, including analytical modeling, stochastic process theory, game theory, causal empirical identification (DiD, IV, RD), behavioral experiments, simulation, and operations data science (ML/forecasting). It ensures the research method is tightly linked to the core operational question and possesses significant practical value.

This guide outlines comprehensive best practices for ensuring the reproducibility of Machine Learning and Pattern Recognition research. It covers fixing random seeds, locking hardware/software dependencies (Python, CUDA, etc.), managing data splits, tracking pre-trained model versions, and structuring the required artifact package for external review. It is essential for building trust in published scientific results.

A comprehensive framework for designing, auditing, and reporting empirical results in recommender systems research. It covers best practices for handling temporal splits, mitigating evaluation bias (e.g., exposure/popularity), utilizing advanced off-policy estimators (IPS, SNIPS), and structuring the critical link between offline metrics and real-world A/B test results. Essential for academic submissions.

This guide provides a comprehensive strategy for elevating the credibility of finance manuscripts to the standard of top-tier journals. It details rigorous methods for empirical causal identification (DID, IV, RDD, natural experiments) and ensures theoretical rigor by assessing assumptions, generalizability, and proof exposition. It helps researchers stress-test their work's core logic.

A comprehensive guide for structuring research papers, particularly in computer graphics and visualization fields (like SIGGRAPH). It dictates how to match technical claims (e.g., 'higher quality,' 'faster') to verifiable evidence, including head-to-head comparisons against State-of-the-Art (SOTA), detailed metric reporting (PSNR, SSIM, Hausdorff), performance timing linked to specific hardware, and robust user studies. Essential for achieving academic rigor and pre-empting domain reviewer objections.

This comprehensive guide details the rigorous methodology for designing, executing, and reporting experimental results in Information Retrieval (IR). It covers best practices for selecting appropriate test collections, choosing defensible metrics, performing proper statistical significance testing (e.g., paired t-tests), ensuring baseline fairness, and proactively addressing modern pitfalls like LLM contamination. Essential for publishing high-quality, auditable research in IR/NLP.

A comprehensive guide for researchers developing systems or algorithms, detailing the necessary level of evidence required for performance claims (e.g., bounds, real-world performance, learning guarantees). It emphasizes scientific rigor, statistical reporting (confidence intervals), assumption testing, and data provenance to ensure findings are robust and reproducible in academic settings.

This comprehensive guide helps researchers defend their complex study designs—whether they involve lab experiments, large-scale surveys, or qualitative observations—against rigorous methodological critique. It emphasizes establishing a clear, credible link between theoretical mechanisms and empirical evidence, focusing specifically on the structure-individual link. It covers advanced inference techniques, identifying potential confounding variables, and articulating the design's limitations.

A comprehensive audit checklist for designing and evaluating security experiments, adhering to the highest academic standards (e.g., USENIX Security). It guides users through verifying adaptive attacker models, calculating precision at realistic base rates, ensuring statistical honesty for stochastic results, and maintaining ethical compliance when working with live systems.

A comprehensive guide for designing and auditing visualization experiments for high-stakes academic submissions (e.g., IEEE VIS). It details how to match evidence—such as controlled studies, power analyses, and benchmarks—to the specific type of claim (perceptual, algorithmic, system). Learn best practices for statistical rigor, CVD-safe encoding, and maintaining full provenance to ensure your findings are scientifically sound and trustworthy.

A comprehensive guide for authors submitting papers to web conferences. It details how to structure empirical claims, ensuring evidence matches the claim's scope (scale, freshness, generalizability). The guide covers avoiding methodological flaws like temporal or popularity leakage, selecting datasets with proper provenance, and performing rigorous ablations and statistical analysis for maximum academic rigor.