Repeatability plays an important role to guarantee an easier evaluation of experiments and algorithms. Not only the testing environments but also the implementations or binaries of the algorithms and the corresponding testing data (that have to be shown) should be made available. SIGMOD started a repeatabilty program in 2008. VLDB is also considering this issue by including an experiment and evaluation track.
