FuryBench

FuryBench Testing Framework

Home to Integral, PlentyChess, Obsidian, Caissa, Quanticade, Serendipity, Spaghet, Schoenemann, Clarity, and Illumina

Finished
Fury	Vine	datagen_conditions	diff	N=100000	Elo: -1.36 +- 12.33 (95%) [N=3000] Games: 1024 W: 298 L: 302 D: 424 Ptnml(0-2): 21, 93, 284, 97, 17
Fury	Integral	[Vine] datagen_conditions	diff	N=20000 *	Elo: 314.83 +- 14.80 (95%) [N=3000] Games: 1660 W: 1221 L: 27 D: 412 Ptnml(0-2): 0, 1, 37, 389, 403
Fury	Integral	[Vine] datagen_conditions	diff	N=20000 *	Elo: 336.49 +- 11.74 (95%) [N=3000] Games: 3072 W: 2337 L: 39 D: 696 Ptnml(0-2): 0, 3, 57, 651, 825
Fury	Vine	datagen_conditions	diff	N=100000	Elo: 65.07 +- 7.79 (95%) [N=3000] Games: 3376 W: 1269 L: 644 D: 1463 Ptnml(0-2): 34, 221, 688, 576, 169
Fury	Vine	datagen_conditions	diff	N=100000	Elo: 135.71 +- 8.62 (95%) [N=10000] Games: 3614 W: 1850 L: 506 D: 1258 Ptnml(0-2): 13, 149, 527, 717, 401
Fury	Vine	datagen_conditions	diff	N=100000	LLR: -0.21 (-2.25, 2.89) [0.00, 5.00] Games: 1024 W: 220 L: 220 D: 584 Ptnml(0-2): 0, 0, 512, 0, 0 Elo: -0.00 +- 0.00 (95%)
Fury	Vine	datagen_conditions	diff	N=100000	LLR: 0.00 (-2.25, 2.89) [0.00, 5.00] Games: 0 W: 0 L: 0 D: 0 Ptnml(0-2): 0, 0, 0, 0, 0 Elo: 0.00 +- 0.00 (95%)
Fury	Vine	policy_4096hl	diff	10.0+0.10	LLR: -2.64 (-2.25, 2.89) [0.00, 5.00] Games: 708 W: 119 L: 230 D: 359 Ptnml(0-2): 23, 124, 150, 55, 2 Elo: -54.92 +- 15.58 (95%)
Fury	Integral	no_tree_reuse	diff	40.0+0.40	LLR: -2.26 (-2.25, 2.89) [0.00, 5.00] Games: 1226 W: 260 L: 335 D: 631 Ptnml(0-2): 1, 190, 306, 115, 1 Elo: -21.28 +- 9.76 (95%)
Fury	Integral	no_tree_reuse	diff	10.0+0.10	LLR: -2.25 (-2.25, 2.89) [0.00, 2.50] Games: 6206 W: 1504 L: 1656 D: 3046 Ptnml(0-2): 30, 814, 1556, 684, 19 Elo: -8.51 +- 4.51 (95%)
Fury	Integral	vine_vondele	diff	10.0+0.10	LLR: -2.25 (-2.25, 2.89) [0.00, 2.50] Games: 11462 W: 2801 L: 2941 D: 5720 Ptnml(0-2): 38, 1438, 2917, 1302, 36 Elo: -4.24 +- 3.27 (95%)
Fury	Integral	vine_vondele	diff	10.0+0.10	LLR: -2.25 (-2.25, 2.89) [0.00, 2.50] Games: 7438 W: 1768 L: 1917 D: 3753 Ptnml(0-2): 17, 1008, 1821, 853, 20 Elo: -6.96 +- 4.10 (95%)
Fury	Integral	simple_net_scale_adjusted	diff	40.0+0.40	LLR: 1.24 (-2.25, 2.89) [0.00, 2.50] Games: 22770 W: 5229 L: 5107 D: 12434 Ptnml(0-2): 15, 2512, 6201, 2650, 7 Elo: 1.86 +- 2.17 (95%)
Fury	Integral	[Vine] datagen_conditions	diff	N=20000 *	Elo: 469.01 +- 9.56 (95%) [N=10000] Games: 10122 W: 8899 L: 52 D: 1171 Ptnml(0-2): 0, 1, 56, 1160, 3844
Fury	Integral	vine_small_adjudicated	diff	40.0+0.40	Elo: -28.97 +- 3.54 (95%) [N=10000] Games: 10000 W: 1922 L: 2754 D: 5324 Ptnml(0-2): 8, 1739, 2382, 819, 52
Fury	Integral	simple_net_scale_adjusted	diff	40.0+0.40	LLR: -0.99 (-2.25, 2.89) [0.00, 2.50] Games: 692 W: 120 L: 194 D: 378 Ptnml(0-2): 0, 125, 173, 45, 3 Elo: -37.30 +- 12.93 (95%)
Fury	Integral	vine_small_adjudicated	diff	10.0+0.10	Elo: -8.37 +- 3.74 (95%) [N=10000] Games: 10042 W: 2293 L: 2535 D: 5214 Ptnml(0-2): 11, 1494, 2357, 1044, 115
Fury	Integral	vine_small_adjudicated	diff	10.0+0.10	LLR: 2.90 (-2.25, 2.89) [0.00, 5.00] Games: 2458 W: 686 L: 568 D: 1204 Ptnml(0-2): 7, 263, 576, 371, 12 Elo: 16.69 +- 7.36 (95%)
Fury	Integral	vine_small_adjudicated	diff	10.0+0.10	LLR: -2.30 (-2.25, 2.89) [0.00, 2.50] Games: 6258 W: 1459 L: 1624 D: 3175 Ptnml(0-2): 9, 935, 1463, 656, 66 Elo: -9.16 +- 4.73 (95%)
Fury	Integral	vine_small_no_relabel	diff	10.0+0.10	LLR: -2.30 (-2.25, 2.89) [0.00, 2.50] Games: 10972 W: 2696 L: 2841 D: 5435 Ptnml(0-2): 41, 1399, 2736, 1284, 26 Elo: -4.59 +- 3.37 (95%)
Fury	Integral	vine_small_no_relabel	diff	10.0+0.10	LLR: -0.22 (-2.25, 2.89) [0.00, 2.50] Games: 176 W: 33 L: 51 D: 92 Ptnml(0-2): 1, 34, 36, 16, 1 Elo: -35.66 +- 29.55 (95%)
Fury	Integral	vine_small_adjusted	diff	10.0+0.10	LLR: -1.84 (-2.25, 2.89) [0.00, 2.50] Games: 1420 W: 289 L: 425 D: 706 Ptnml(0-2): 7, 238, 355, 104, 6 Elo: -33.38 +- 9.33 (95%)
Fury	Integral	vine_small_0.4wdl600scale	diff	10.0+0.10	LLR: -2.26 (-2.25, 2.89) [0.00, 2.50] Games: 9620 W: 2292 L: 2437 D: 4891 Ptnml(0-2): 32, 1242, 2399, 1113, 24 Elo: -5.24 +- 3.59 (95%)
Fury	Integral	vine_small_0.4wdl	diff	10.0+0.10	LLR: -0.44 (-2.25, 2.89) [0.00, 2.50] Games: 1576 W: 362 L: 390 D: 824 Ptnml(0-2): 3, 203, 403, 177, 2 Elo: -6.17 +- 8.65 (95%)
Fury	Integral	vine_small_400scale	diff	10.0+0.10	LLR: -2.25 (-2.25, 2.89) [0.00, 2.50] Games: 15266 W: 3713 L: 3846 D: 7707 Ptnml(0-2): 43, 1913, 3861, 1766, 50 Elo: -3.03 +- 2.84 (95%)

1 2 3 4 26 27 28