技能 编程开发 计算机图形学可复现性指南

计算机图形学可复现性指南

v20260724
siggraph-reproducibility
本指南为计算机图形学研究提供了一套完整的可复现性框架。它指导用户如何记录和锁定所有依赖项(如资产、随机种子、硬件配置),处理浮点数和随机过程中的非确定性,最终确保任何读者都能从代码和数据中重新生成论文中的所有图表和性能数据。
获取技能
399 次下载
概览

SIGGRAPH Reproducibility

In computer graphics, reproducibility means a reader can regenerate your figures and timings, not merely re-derive your equations. SIGGRAPH's culture rewards this heavily — the community runs its own replicability stamps (see siggraph-artifact-evaluation) — but the review itself is decided on the paper and its supplemental video, so reproducibility is something you build into the work from the start, not bolt on at camera-ready. Anchor policy to resources/official-source-map.md.

Reproducibility here is result-reproducibility

A graphics result is an image, a mesh, a frame sequence, or a timing on specific hardware. Each class has its own failure mode:

  • Rendered images depend on scene assets, sampler seeds, and the renderer's floating-point path — two "correct" runs can differ by pixels.
  • Geometry/mesh outputs depend on the exact input mesh and its scale/orientation conventions.
  • Simulations depend on time-step, solver tolerances, and RNG seeding.
  • Learning-based results depend on released weights and inference data, not just source code.
  • Timings — a first-class SIGGRAPH claim — depend on GPU/CPU, driver, and resolution.

If you cannot say exactly what a result depends on, you cannot make it reproducible.

Pin provenance at creation time

These cannot be reconstructed after the fact:

  • Scenes and assets: record the source and version of every scene, mesh, texture, and BRDF; ship them or give a stable download. A method evaluated on unshareable assets is unreproducible by construction — say so and provide a shareable proxy scene.
  • Seeds and configs: log the seed, sample count, resolution, and every hyperparameter behind each figure. Store the config with the output, not in your memory.
  • Hardware and software stack: GPU model, driver, CUDA/compiler versions, OS. Graphics timings are meaningless without them.
  • Model artifacts: for learning-based work, pin the training data snapshot, the released weights' hash, and the inference command.

Handle non-determinism honestly

Do not claim bit-exact reproduction you cannot deliver:

  • Declare the tolerance. State whether a result is bit-exact, or matched within a metric (PSNR/SSIM/LPIPS/Hausdorff) and threshold, and bundle the reference output to compare against.
  • Seed the stochastic path — Monte Carlo integration, stochastic simulation, dropout — and document the residual drift from GPU reductions or non-associative float math.
  • Separate deterministic and stochastic figures so a reader knows which they can reproduce exactly and which only in distribution.

The release a reader can run

[README]      what it is; one command to build; one command to reproduce a headline figure;
              expected runtime and hardware
[Build]       pinned (Docker/conda/CMake) with exact GPU/driver/compiler versions
[Assets]      scenes/meshes/textures/weights bundled or stably linked
[repro/]      a script per headline figure: config in, image/metric/frame out, ref bundled
[MAPPING]     paper figure/table -> script -> expected output + tolerance
[LICENSE]     OSI-approved, so results can be reused and stamped

Reproducibility vs. anonymity

SIGGRAPH Technical Papers review has historically been single-blind (reviewers see authors), so the anonymization tax that ML/SE venues pay at review time is usually lighter here — but confirm the current cycle's blinding policy (待核实 for exact 2026 wording). If a cycle does require anonymized review, strip owner strings, lab names, and identifying URLs from the code and supplemental before upload, and swap in a de-anonymized permanent archive at camera-ready.

Anti-patterns

  • Reporting a timing with no hardware, or a quality number with no metric and no reference image.
  • Shipping code without the scenes/meshes/weights it needs — it compiles but reproduces nothing.
  • Claiming reproduction while leaving the sampler unseeded.
  • Deferring the whole release to camera-ready, when provenance had to be pinned during the work.
  • Treating "available upon request" as a release — it is a scored weakness, not a neutral choice.

Output format

[Result classes] images / meshes / simulation / learned / timings present
[Provenance] scenes+assets pinned? seeds+configs logged? hardware stack recorded? yes/no
[Determinism] tolerance stated + reference outputs bundled? yes/no
[Release] build + repro scripts + figure->script mapping present? yes/no
[Blinding] cycle policy confirmed (single-blind vs anonymized)? action if anonymized
[Gaps] <ordered, with what must be pinned before it is lost>
信息
Category 编程开发
Name siggraph-reproducibility
版本 v20260724
大小 4.97KB
更新时间 2026-07-29
语言