Use this after RecSys reviews are released and the rebuttal window opens. RecSys runs a brief author-response phase (2026: June 4-9) in which authors add a short narrative to clarify misconceptions. Reopen the current instructions before drafting — the length and mechanics are cycle-specific and the phase is short.
| Pushback | What it signals | RecSys-ready fix |
|---|---|---|
| "Were the baselines tuned as hard as your method?" | The reviewer read the 2019 reproducibility literature | Point to the equal-budget tuning grid in the appendix and the per-baseline selected settings; never wave it off as "standard config" |
| "This is a random split on sequential data" | Suspected temporal leakage | Confirm the temporal/leave-one-last protocol and where it is stated, or concede and scope the claim |
| "Offline nDCG gains may not deploy" | The offline-online gap objection | Anchor to the off-policy estimate, the simulator, or an A/B result; if you have none, scope the claim to offline |
| "Metrics look sampled, not full-ranking" | Sampled-metric distortion suspected | State whether ranking is over the full item set and the cutoff, or report the full-ranking number |
| "Missing the obvious matrix-factorization baseline" | A weak-comparison gap | Anchor to the appendix comparison, or concede a camera-ready addition |
Reviewer objection: the Recall@20 gain probably vanishes against a properly tuned baseline. Reply skeleton:
[Priority issue] <reviewer concern>
[Decision dimension] correctness / novelty / evaluation validity / reproducibility / fit
[Draft response] <RecSys-ready anonymous narrative>
[Evidence anchor] <table / figure / appendix / repository path>
[Forbidden content removed] <identity leaks, unseen new results, unsupported claims>