01FREEZE
Model revision, eval suite, held-out split and seeds are fixed and hashed.
We measure what an intervention did to a model. The protocol is fixed before the run starts, and every contribution is ablated after it.
Model, revision, method, suite, split, seeds, delta and interval — under one hash, verifiable by anyone you hand it to.
Tell us the model you want to move and the benchmark you want to move it on.