OpenBench

OpenBench Testing Framework

Finished
Ergodi	Leela	update	diff	8.0+0.08	LLR: -2.95 (-2.94, 2.94) [0.00, 3.00] Games: 80590 W: 19190 L: 19187 D: 42213 Ptnml(0-2): 82, 7910, 24293, 7943, 67
Ergodi	Leela	update	diff	8.0+0.08	LLR: -2.94 (-2.94, 2.94) [0.00, 3.00] Games: 116012 W: 27533 L: 27461 D: 61018 Ptnml(0-2): 100, 11331, 35077, 11393, 105
Ergodi	Leela	update	diff	40.0+0.40	LLR: 0.29 (-2.94, 2.94) [0.00, 3.00] Games: 8646 W: 2031 L: 2001 D: 4614 Ptnml(0-2): 0, 759, 2775, 789, 0
Ergodi	Leela	update	diff	8.0+0.08	LLR: -2.96 (-2.94, 2.94) [0.00, 3.00] Games: 20128 W: 4689 L: 4804 D: 10635 Ptnml(0-2): 8, 2041, 6092, 1904, 19
Ergodi	Leela	update	diff	8.0+0.08	LLR: -2.96 (-2.94, 2.94) [0.00, 3.00] Games: 46358 W: 11027 L: 11092 D: 24239 Ptnml(0-2): 31, 4697, 13807, 4594, 50
Ergodi	Leela	update	diff	60.0+0.60	LLR: -1.73 (-2.94, 2.94) [0.00, 3.00] Games: 2498 W: 559 L: 648 D: 1291 Ptnml(0-2): 0, 321, 696, 232, 0
Ergodi	Leela	simple-pruning	diff	8.0+0.08	LLR: -2.95 (-2.94, 2.94) [0.00, 3.00] Games: 76456 W: 18200 L: 18205 D: 40051 Ptnml(0-2): 58, 7380, 23364, 7361, 65
Ergodi	Leela	cpuct-uncertainty-2	diff	8.0+0.08	LLR: -2.96 (-2.94, 2.94) [0.00, 3.00] Games: 125870 W: 29953 L: 29863 D: 66054 Ptnml(0-2): 92, 12293, 38079, 12375, 96
Ergodi	Leela	simple-pruning	diff	8.0+0.08	LLR: -2.55 (-2.94, 2.94) [0.00, 3.00] Games: 48856 W: 11532 L: 11570 D: 25754 Ptnml(0-2): 37, 4791, 14809, 4755, 36
Ergodi	Leela	simple-pruning	diff	8.0+0.08	LLR: -2.96 (-2.94, 2.94) [0.00, 3.00] Games: 46138 W: 10959 L: 11023 D: 24156 Ptnml(0-2): 38, 4493, 14072, 4427, 39
Ergodi	Leela	update	diff	40.0+0.40	Elo: 33.32 +- 4.36 (95%) [N=5000] Games: 5000 W: 1369 L: 891 D: 2740 Ptnml(0-2): 0, 307, 1410, 781, 2
Ergodi	Leela	simple-pruning	diff	40.0+0.40	LLR: 2.95 (-2.94, 2.94) [0.00, 3.00] Games: 7102 W: 1745 L: 1586 D: 3771 Ptnml(0-2): 0, 567, 2259, 724, 1
Ergodi	Leela	makeup	diff	8.0+0.08	LLR: -2.13 (-2.94, 2.94) [0.00, 3.00] Games: 1916 W: 417 L: 530 D: 969 Ptnml(0-2): 1, 267, 535, 154, 1
Ergodi	Leela	update	diff	8.0+0.08	LLR: -0.39 (-2.94, 2.94) [0.00, 3.00] Games: 31488 W: 8037 L: 7995 D: 15456 Ptnml(0-2): 61, 3087, 9412, 3117, 67
Ergodi	Leela	update	diff	8.0+0.08	LLR: 2.96 (-2.94, 2.94) [0.00, 3.00] Games: 12544 W: 3100 L: 2923 D: 6521 Ptnml(0-2): 8, 1127, 3828, 1298, 11
Ergodi	Leela	update	diff	8.0+0.08	Elo: 18.28 +- 4.54 (95%) [N=5000] Games: 5004 W: 1364 L: 1101 D: 2539 Ptnml(0-2): 3, 421, 1394, 678, 6
Ergodi	Leela	simple-pruning	diff	8.0+0.08	LLR: 2.97 (-2.94, 2.94) [0.00, 3.00] Games: 7632 W: 1891 L: 1718 D: 4023 Ptnml(0-2): 9, 680, 2265, 853, 9
Ergodi	Leela	frustration	diff	8.0+0.08	LLR: -1.80 (-2.94, 2.94) [0.00, 3.00] Games: 4114 W: 943 L: 1034 D: 2137 Ptnml(0-2): 5, 497, 1143, 408, 4
Ergodi	Leela	simple-pruning	diff	8.0+0.08	LLR: -1.00 (-2.94, 2.94) [0.00, 3.00] Games: 30998 W: 7352 L: 7344 D: 16302 Ptnml(0-2): 23, 3023, 9408, 3013, 32
Ergodi	Leela	simple-pruning	diff	8.0+0.08	LLR: 0.34 (-2.94, 2.94) [0.00, 3.00] Games: 110046 W: 25863 L: 25632 D: 58551 Ptnml(0-2): 82, 10632, 33382, 10827, 100
Ergodi	Leela	simple-pruning	diff	40.0+0.40	LLR: -2.96 (-2.94, 2.94) [-0.50, 3.00] Games: 32452 W: 7404 L: 7479 D: 17569 Ptnml(0-2): 2, 2926, 10445, 2851, 2
Ergodi	Leela	certainty-weighting	diff	8.0+0.08	LLR: -2.98 (-2.94, 2.94) [0.00, 3.00] Games: 4074 W: 913 L: 1064 D: 2097 Ptnml(0-2): 4, 497, 1183, 352, 1
Ergodi	Leela	simple-pruning	diff	8.0+0.08	LLR: 2.96 (-2.94, 2.94) [-0.50, 3.00] Games: 63246 W: 15056 L: 14822 D: 33368 Ptnml(0-2): 41, 6103, 19095, 6349, 35
Ergodi	Leela	ch-fix-r50	diff	8.0+0.08	LLR: -2.95 (-2.94, 2.94) [0.00, 3.00] Games: 1362 W: 254 L: 431 D: 677 Ptnml(0-2): 6, 239, 363, 72, 1
Ergodi	Leela	certainty-weighting	diff	8.0+0.08	LLR: -1.81 (-2.94, 2.94) [0.00, 3.00] Games: 3510 W: 813 L: 904 D: 1793 Ptnml(0-2): 3, 416, 1009, 323, 4

1 2 3 4 5 6 7 8