Statistics for category Efficiency

Attribute Filter
SolverTime all instances
  no fail by all solver
  time >= 10.0 by at least one solver and no fail for all solvers
  gap <= 0.1% and no fail for all solvers
  gap <= 1% and no fail for all solvers
  gap <= 10% and no fail for all solvers
  within 0.1% of known optimal value and no fail for all solvers
  within 1% of known optimal value and no fail for all solvers
  within 10% of known optimal value and no fail for all solvers
  no fail
  time >= 10.0 by at least one solver and no fail for all solvers
  gap <= 0.1% and not failed
  gap <= 1% and not failed
  gap <= 10% and not failed
  within 0.1% of known optimal value and not failed
  within 1% of known optimal value and not failed
  within 10% of known optimal value and not failed
NumberOfIterations no fail by all solver
  time >= 10.0 by at least one solver and no fail for all solvers
  within 0.1% of known optimal value and not failed
  within 0.1% of known optimal value and not failed

For a short description on the computed values, refer to the documentation.

SolverTime
Filter: all instances

Attribute values were projected onto interval [0.1, 900.0].
Missing values and values for failed instances substituted by 900.0 .

Data OA.0 ROA-ℒ₁.0 ROA-ℒ₁/ℓ₂².0 ROA-ℒ₂.0 ROA-ℓ₁.0 ROA-ℓ₂².0 ROA-ℓ∞.0 ROA-∇²ℒ.0 virt. best virt. worst
count 438.00 438.00 438.00 438.00 438.00 438.00 438.00 438.00 438.00 438.00
arith. mean 153.58 199.51 181.47 255.63 169.30 161.75 170.18 256.10 132.94 321.61
arith. std. 311.03 329.77 332.16 364.12 325.61 317.49 327.25 365.52 292.51 384.18
geom. mean 14.87 28.24 21.82 35.36 18.56 17.57 17.74 35.92 11.14 62.38
geom. std. 9.20 9.68 8.96 11.47 8.94 8.99 9.32 11.35 9.08 10.51
sh.geom. mean 28.20 48.03 37.27 61.98 32.72 31.55 32.30 62.24 22.66 95.72
sh.geom. std. 4.52 4.85 4.71 5.54 4.61 4.53 4.67 5.51 4.31 5.59
min 0.19 0.23 0.23 0.27 0.24 0.22 0.20 0.29 0.19 0.48
10.0% 1.24 1.42 1.47 1.44 1.32 1.23 1.15 1.42 0.98 1.98
25.0% 2.52 4.59 4.43 3.35 3.60 3.53 3.44 4.53 2.12 7.95
50.0% 9.82 24.77 16.02 30.02 13.57 13.81 12.52 28.87 7.43 79.37
75.0% 45.21 222.04 81.86 436.57 45.81 51.48 52.79 452.66 23.10 900.00
90.0% 900.00 900.00 900.00 900.00 900.00 900.00 900.00 900.00 899.55 900.00
max 900.00 900.00 900.00 900.00 900.00 900.00 900.00 900.00 900.00 900.00
geometric mean shift: 10.0

Performance with respect to virt. best:
Tolerance: relative 0.1 absolute 0.1
Data OA.0 ROA-ℒ₁.0 ROA-ℒ₁/ℓ₂².0 ROA-ℒ₂.0 ROA-ℓ₁.0 ROA-ℓ₂².0 ROA-ℓ∞.0 ROA-∇²ℒ.0 virt. worst
count 438.00 438.00 438.00 438.00 438.00 438.00 438.00 438.00 438.00
arith. mean 2.10 10.58 2.67 10.27 5.30 2.10 4.16 10.68 21.95
arith. std. 4.05 58.84 4.58 24.64 56.58 4.66 48.30 25.17 66.73
min 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00
10.0% 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00
25.0% 1.00 1.24 1.26 1.14 1.09 1.00 1.08 1.21 1.79
50.0% 1.00 1.93 1.68 2.05 1.42 1.32 1.38 1.93 4.01
75.0% 1.27 3.41 2.61 5.47 1.98 2.06 1.87 5.51 10.71
90.0% 2.14 6.65 4.38 27.57 3.24 3.23 3.11 26.86 63.89
max 30.47 1105.83 57.20 217.19 1137.80 77.51 1012.02 256.98 1137.80
better 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
close 285.00 83.00 82.00 112.00 120.00 151.00 128.00 101.00 51.00
worse 153.00 355.00 356.00 326.00 318.00 287.00 310.00 337.00 387.00


SolverTime
Filter: no fail by all solver

Attribute values were projected onto interval [0.1, 900.0].
Missing values and values for failed instances substituted by 900.0 .

Data OA.0 ROA-ℒ₁.0 ROA-ℒ₁/ℓ₂².0 ROA-ℒ₂.0 ROA-ℓ₁.0 ROA-ℓ₂².0 ROA-ℓ∞.0 ROA-∇²ℒ.0 virt. best virt. worst
count 406.00 406.00 406.00 406.00 406.00 406.00 406.00 406.00 406.00 406.00
arith. mean 112.11 161.68 137.51 223.08 123.73 122.38 128.97 220.78 98.98 276.02
arith. std. 265.51 296.38 290.80 344.85 279.09 277.68 287.11 343.21 253.79 361.58
geom. mean 11.55 22.70 16.97 28.90 14.21 13.70 13.75 29.36 8.68 50.54
geom. std. 7.75 8.90 7.78 11.01 7.59 7.77 8.04 10.81 7.64 10.13
sh.geom. mean 21.54 39.08 28.88 51.92 24.81 24.43 24.89 52.00 17.28 79.22
sh.geom. std. 3.84 4.42 4.09 5.28 3.92 3.92 4.04 5.20 3.69 5.34
min 0.19 0.23 0.23 0.27 0.24 0.22 0.20 0.29 0.19 0.48
10.0% 1.17 1.36 1.40 1.39 1.25 1.18 1.12 1.34 0.95 1.87
25.0% 2.19 3.86 3.61 2.86 3.28 2.90 2.97 3.71 2.02 6.36
50.0% 8.55 19.73 13.77 23.82 11.71 12.20 11.40 22.40 6.80 63.63
75.0% 30.14 102.61 39.74 290.33 27.12 28.61 28.68 285.77 16.07 464.88
90.0% 588.72 900.00 899.91 900.00 867.38 869.90 899.92 900.00 309.56 900.00
max 900.00 900.00 900.00 900.00 900.00 900.00 900.00 900.00 900.00 900.00
geometric mean shift: 10.0

Performance with respect to virt. best:
Tolerance: relative 0.1 absolute 0.1
Data OA.0 ROA-ℒ₁.0 ROA-ℒ₁/ℓ₂².0 ROA-ℒ₂.0 ROA-ℓ₁.0 ROA-ℓ₂².0 ROA-ℓ∞.0 ROA-∇²ℒ.0 virt. worst
count 406.00 406.00 406.00 406.00 406.00 406.00 406.00 406.00 406.00
arith. mean 2.11 8.56 2.38 10.38 1.93 1.83 1.86 11.30 19.57
arith. std. 4.16 27.63 2.23 23.31 1.73 1.31 1.72 26.02 38.10
min 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00
10.0% 1.00 1.02 1.00 1.00 1.00 1.00 1.00 1.00 1.35
25.0% 1.00 1.28 1.30 1.20 1.15 1.03 1.10 1.28 1.89
50.0% 1.00 1.99 1.71 2.18 1.45 1.35 1.40 1.99 4.20
75.0% 1.28 3.43 2.62 5.90 1.98 2.11 1.88 5.73 10.94
90.0% 2.07 7.10 4.22 28.28 3.14 3.23 2.98 30.90 66.13
max 30.47 174.33 24.42 207.88 24.44 12.67 24.44 256.98 256.98
better 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
close 260.00 63.00 63.00 92.00 101.00 131.00 109.00 83.00 33.00
worse 146.00 343.00 343.00 314.00 305.00 275.00 297.00 323.00 373.00


SolverTime
Filter: time >= 10.0 by at least one solver and no fail for all solvers

Attribute values were projected onto interval [0.1, 900.0].
Missing values and values for failed instances substituted by 900.0 .

Data OA.0 ROA-ℒ₁.0 ROA-ℒ₁/ℓ₂².0 ROA-ℒ₂.0 ROA-ℓ₁.0 ROA-ℓ₂².0 ROA-ℓ∞.0 ROA-∇²ℒ.0 virt. best virt. worst
count 284.00 284.00 284.00 284.00 284.00 284.00 284.00 284.00 284.00 284.00
arith. mean 159.47 230.04 195.53 317.80 175.91 174.07 183.54 314.56 140.85 393.06
arith. std. 305.60 331.81 331.32 374.47 319.96 318.47 328.67 373.10 293.81 375.96
geom. mean 27.95 65.84 43.22 92.03 35.12 34.50 35.20 96.60 20.13 176.89
geom. std. 5.98 5.33 5.46 6.54 5.50 5.54 5.76 5.84 6.28 4.42
sh.geom. mean 38.16 78.64 53.61 113.45 44.72 44.19 45.45 114.08 29.60 191.90
sh.geom. std. 4.10 4.09 4.14 4.65 4.09 4.08 4.22 4.52 4.07 3.79
min 1.50 2.18 2.36 1.97 1.87 2.30 1.82 2.83 1.50 10.08
10.0% 5.16 8.74 8.75 9.39 6.79 6.38 6.88 10.39 2.94 19.04
25.0% 7.54 16.91 12.23 20.56 10.74 11.22 10.54 19.31 6.18 55.99
50.0% 15.25 43.09 23.69 80.99 18.71 18.07 17.74 82.71 11.01 230.57
75.0% 56.88 296.66 113.14 895.36 70.58 97.26 111.37 869.70 37.36 900.00
90.0% 900.00 900.00 900.00 900.00 900.00 900.00 900.00 900.00 899.52 900.00
max 900.00 900.00 900.00 900.00 900.00 900.00 900.00 900.00 900.00 900.00
geometric mean shift: 10.0

Performance with respect to virt. best:
Tolerance: relative 0.1 absolute 0.1
Data OA.0 ROA-ℒ₁.0 ROA-ℒ₁/ℓ₂².0 ROA-ℒ₂.0 ROA-ℓ₁.0 ROA-ℓ₂².0 ROA-ℓ∞.0 ROA-∇²ℒ.0 virt. worst
count 284.00 284.00 284.00 284.00 284.00 284.00 284.00 284.00 284.00
arith. mean 2.49 11.51 2.62 14.08 2.10 2.03 2.10 15.44 26.85
arith. std. 4.93 32.61 2.25 27.04 1.98 1.48 1.98 30.19 43.57
min 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00
10.0% 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00
25.0% 1.00 1.61 1.35 1.31 1.17 1.01 1.19 1.52 3.01
50.0% 1.00 2.41 2.05 3.39 1.55 1.50 1.62 3.36 6.67
75.0% 1.19 4.68 2.99 10.68 2.19 2.42 2.15 11.66 27.55
90.0% 2.98 10.37 4.65 45.14 3.66 3.80 3.36 49.39 94.28
max 30.47 174.33 24.42 207.88 24.44 12.67 24.44 256.98 256.98
better 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
close 209.00 43.00 42.00 61.00 63.00 89.00 57.00 45.00 33.00
worse 75.00 241.00 242.00 223.00 221.00 195.00 227.00 239.00 251.00


SolverTime
Filter: gap <= 0.1% and no fail for all solvers

Attribute values were projected onto interval [0.1, 900.0].
Missing values and values for failed instances substituted by 900.0 .

Data OA.0 ROA-ℒ₁.0 ROA-ℒ₁/ℓ₂².0 ROA-ℒ₂.0 ROA-ℓ₁.0 ROA-ℓ₂².0 ROA-ℓ∞.0 ROA-∇²ℒ.0 virt. best virt. worst
count 306.00 306.00 306.00 306.00 306.00 306.00 306.00 306.00 306.00 306.00
arith. mean 16.24 52.81 25.85 66.23 19.29 18.94 20.01 63.72 10.86 102.60
arith. std. 39.78 99.02 63.70 158.29 43.25 45.94 48.90 154.61 25.83 178.40
geom. mean 5.67 11.50 7.88 11.26 6.73 6.33 6.40 11.44 4.07 21.65
geom. std. 4.14 6.32 4.33 6.65 4.07 4.12 4.27 6.50 3.70 7.24
sh.geom. mean 9.28 20.20 12.33 20.28 10.49 10.01 10.34 20.22 6.58 35.36
sh.geom. std. 1.90 2.92 2.14 3.12 1.96 1.95 2.00 3.03 1.71 3.64
min 0.19 0.23 0.23 0.27 0.24 0.22 0.20 0.29 0.19 0.48
10.0% 0.97 1.24 1.20 1.20 0.99 1.00 1.00 1.06 0.80 1.56
25.0% 1.75 2.36 2.38 2.14 2.29 2.22 1.89 2.54 1.53 3.53
50.0% 6.07 10.35 9.24 10.90 8.08 7.07 7.38 10.78 3.73 21.57
75.0% 14.15 41.57 20.73 42.30 17.15 15.90 17.24 37.85 10.34 100.61
90.0% 40.25 218.38 39.72 180.90 28.22 27.99 29.52 154.66 18.82 327.79
max 565.01 566.41 461.97 900.00 321.83 365.22 516.70 900.00 275.06 900.00
geometric mean shift: 10.0

Performance with respect to virt. best:
Tolerance: relative 0.1 absolute 0.1
Data OA.0 ROA-ℒ₁.0 ROA-ℒ₁/ℓ₂².0 ROA-ℒ₂.0 ROA-ℓ₁.0 ROA-ℓ₂².0 ROA-ℓ∞.0 ROA-∇²ℒ.0 virt. worst
count 306.00 306.00 306.00 306.00 306.00 306.00 306.00 306.00 306.00
arith. mean 2.32 10.42 2.27 5.55 1.89 1.76 1.76 5.88 15.03
arith. std. 4.56 31.56 1.84 10.55 1.25 1.09 1.06 11.62 32.57
min 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.20
10.0% 1.00 1.13 1.13 1.03 1.00 1.00 1.01 1.06 1.61
25.0% 1.00 1.39 1.33 1.28 1.19 1.08 1.13 1.33 2.00
50.0% 1.03 2.02 1.68 2.11 1.47 1.34 1.42 1.95 4.04
75.0% 1.38 3.74 2.49 4.40 1.95 1.95 1.84 4.45 8.49
90.0% 2.15 8.10 3.87 10.26 3.18 3.09 2.98 11.82 34.69
max 30.47 174.33 23.16 82.91 8.37 7.99 7.65 90.90 174.33
better 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
close 173.00 30.00 30.00 56.00 62.00 88.00 73.00 47.00 0.00
worse 133.00 276.00 276.00 250.00 244.00 218.00 233.00 259.00 306.00


SolverTime
Filter: gap <= 1% and no fail for all solvers

Attribute values were projected onto interval [0.1, 900.0].
Missing values and values for failed instances substituted by 900.0 .

Data OA.0 ROA-ℒ₁.0 ROA-ℒ₁/ℓ₂².0 ROA-ℒ₂.0 ROA-ℓ₁.0 ROA-ℓ₂².0 ROA-ℓ∞.0 ROA-∇²ℒ.0 virt. best virt. worst
count 329.00 329.00 329.00 329.00 329.00 329.00 329.00 329.00 329.00 329.00
arith. mean 17.06 53.99 26.34 98.16 19.55 19.55 20.03 93.00 11.01 139.53
arith. std. 44.15 106.62 61.79 215.94 41.92 44.81 47.32 205.61 25.14 237.60
geom. mean 5.94 12.24 8.53 14.15 7.20 6.84 6.81 14.30 4.33 26.55
geom. std. 4.07 6.14 4.30 7.74 4.03 4.13 4.19 7.53 3.66 8.02
sh.geom. mean 9.52 20.91 13.13 25.83 11.04 10.68 10.77 25.63 6.86 43.23
sh.geom. std. 1.91 2.89 2.14 3.65 1.95 1.96 1.98 3.54 1.70 4.09
min 0.19 0.23 0.23 0.27 0.24 0.22 0.20 0.29 0.19 0.48
10.0% 1.00 1.25 1.26 1.23 1.05 1.01 1.02 1.12 0.82 1.69
25.0% 1.80 2.67 2.54 2.24 2.48 2.35 2.04 2.80 1.65 4.14
50.0% 6.40 12.13 10.43 13.27 8.69 8.17 8.26 12.15 4.41 27.11
75.0% 14.68 42.81 21.82 60.07 18.06 16.11 17.52 59.85 10.67 158.55
90.0% 38.98 192.89 44.31 296.01 30.34 32.10 31.79 287.39 18.97 390.91
max 565.01 900.00 461.97 900.00 321.83 365.22 516.70 900.00 275.06 900.00
geometric mean shift: 10.0

Performance with respect to virt. best:
Tolerance: relative 0.1 absolute 0.1
Data OA.0 ROA-ℒ₁.0 ROA-ℒ₁/ℓ₂².0 ROA-ℒ₂.0 ROA-ℓ₁.0 ROA-ℓ₂².0 ROA-ℓ∞.0 ROA-∇²ℒ.0 virt. worst
count 329.00 329.00 329.00 329.00 329.00 329.00 329.00 329.00 329.00
arith. mean 2.24 9.92 2.29 8.54 1.89 1.79 1.76 8.82 17.98
arith. std. 4.42 30.50 1.79 17.73 1.22 1.11 1.03 18.59 34.58
min 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.20
10.0% 1.00 1.13 1.13 1.04 1.01 1.00 1.01 1.07 1.61
25.0% 1.00 1.46 1.35 1.34 1.20 1.08 1.13 1.38 2.09
50.0% 1.00 2.08 1.75 2.25 1.48 1.37 1.41 2.07 4.46
75.0% 1.36 3.77 2.57 5.51 1.98 2.06 1.86 5.54 10.40
90.0% 2.10 7.53 3.86 23.41 3.12 3.13 2.87 23.17 57.95
max 30.47 174.33 23.16 120.01 8.37 7.99 7.65 120.60 174.33
better 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
close 194.00 30.00 30.00 56.00 64.00 92.00 76.00 47.00 0.00
worse 135.00 299.00 299.00 273.00 265.00 237.00 253.00 282.00 329.00


SolverTime
Filter: gap <= 10% and no fail for all solvers

Attribute values were projected onto interval [0.1, 900.0].
Missing values and values for failed instances substituted by 900.0 .

Data OA.0 ROA-ℒ₁.0 ROA-ℒ₁/ℓ₂².0 ROA-ℒ₂.0 ROA-ℓ₁.0 ROA-ℓ₂².0 ROA-ℓ∞.0 ROA-∇²ℒ.0 virt. best virt. worst
count 354.00 354.00 354.00 354.00 354.00 354.00 354.00 354.00 354.00 354.00
arith. mean 32.61 76.62 47.69 139.95 38.61 39.87 41.50 132.90 24.67 189.98
arith. std. 111.81 171.29 140.87 270.24 127.09 131.05 138.01 259.80 98.04 297.24
geom. mean 6.92 14.33 10.22 18.21 8.51 8.23 8.16 18.34 5.12 33.55
geom. std. 4.72 6.69 5.03 9.02 4.72 4.93 5.00 8.72 4.38 8.97
sh.geom. mean 11.53 24.42 16.23 33.45 13.53 13.46 13.48 33.04 8.68 54.25
sh.geom. std. 2.30 3.22 2.57 4.28 2.37 2.42 2.46 4.13 2.10 4.64
min 0.19 0.23 0.23 0.27 0.24 0.22 0.20 0.29 0.19 0.48
10.0% 1.07 1.26 1.32 1.28 1.12 1.03 1.05 1.22 0.85 1.75
25.0% 1.98 2.84 2.88 2.37 2.75 2.51 2.36 3.12 1.79 4.88
50.0% 7.06 13.44 10.76 16.75 9.61 8.92 9.49 15.36 5.46 38.06
75.0% 16.48 47.54 24.27 87.87 20.64 18.88 19.58 88.33 11.70 241.81
90.0% 46.03 246.84 68.17 703.40 43.18 50.88 46.59 513.18 23.06 900.00
max 900.00 900.00 900.00 900.00 900.00 900.00 900.00 900.00 899.61 900.00
geometric mean shift: 10.0

Performance with respect to virt. best:
Tolerance: relative 0.1 absolute 0.1
Data OA.0 ROA-ℒ₁.0 ROA-ℒ₁/ℓ₂².0 ROA-ℒ₂.0 ROA-ℓ₁.0 ROA-ℓ₂².0 ROA-ℓ∞.0 ROA-∇²ℒ.0 virt. worst
count 354.00 354.00 354.00 354.00 354.00 354.00 354.00 354.00 354.00
arith. mean 2.17 9.45 2.32 10.74 1.88 1.83 1.79 10.63 20.05
arith. std. 4.27 29.46 1.78 23.54 1.19 1.12 1.09 22.08 37.14
min 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00
10.0% 1.00 1.13 1.13 1.04 1.00 1.00 1.01 1.06 1.61
25.0% 1.00 1.46 1.36 1.36 1.21 1.09 1.14 1.39 2.11
50.0% 1.00 2.08 1.80 2.40 1.49 1.40 1.43 2.11 4.65
75.0% 1.34 3.66 2.62 6.19 1.98 2.16 1.91 6.23 12.38
90.0% 2.08 7.15 3.98 30.70 3.09 3.22 2.91 29.97 66.38
max 30.47 174.33 23.16 207.88 8.37 7.99 7.99 148.95 207.88
better 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
close 217.00 33.00 33.00 59.00 69.00 96.00 79.00 51.00 3.00
worse 137.00 321.00 321.00 295.00 285.00 258.00 275.00 303.00 351.00


SolverTime
Filter: within 0.1% of known optimal value and no fail for all solvers

Attribute values were projected onto interval [0.1, 900.0].
Missing values and values for failed instances substituted by 900.0 .

Data OA.0 ROA-ℒ₁.0 ROA-ℒ₁/ℓ₂².0 ROA-ℒ₂.0 ROA-ℓ₁.0 ROA-ℓ₂².0 ROA-ℓ∞.0 ROA-∇²ℒ.0 virt. best virt. worst
count 273.00 273.00 273.00 273.00 273.00 273.00 273.00 273.00 273.00 273.00
arith. mean 21.71 54.33 38.68 68.80 31.62 28.30 32.47 67.18 15.49 101.23
arith. std. 64.91 121.21 110.32 169.29 99.03 88.38 102.89 164.44 42.14 197.90
geom. mean 5.63 10.88 8.39 11.67 7.21 6.77 6.87 11.19 4.47 19.49
geom. std. 4.52 6.42 5.06 6.68 4.80 4.82 5.06 6.85 4.24 7.20
sh.geom. mean 9.65 19.48 13.97 20.86 12.02 11.48 11.95 20.42 7.71 32.32
sh.geom. std. 2.09 2.92 2.48 3.12 2.30 2.23 2.34 3.12 1.91 3.61
min 0.19 0.23 0.23 0.27 0.24 0.22 0.20 0.29 0.19 0.48
10.0% 0.93 1.15 1.13 1.14 0.95 0.93 0.98 1.01 0.77 1.51
25.0% 1.62 2.10 2.19 2.22 2.16 2.01 1.81 2.08 1.50 3.28
50.0% 5.80 9.81 9.15 12.19 7.67 6.87 7.23 10.75 4.30 18.53
75.0% 14.16 41.31 21.58 43.54 18.42 16.68 18.65 39.72 11.03 83.99
90.0% 38.15 145.43 51.91 149.26 38.30 37.85 40.78 176.44 22.54 284.99
max 612.44 900.00 900.00 900.00 826.26 900.00 899.84 900.00 373.47 900.00
geometric mean shift: 10.0

Performance with respect to virt. best:
Tolerance: relative 0.1 absolute 0.1
Data OA.0 ROA-ℒ₁.0 ROA-ℒ₁/ℓ₂².0 ROA-ℒ₂.0 ROA-ℓ₁.0 ROA-ℓ₂².0 ROA-ℓ∞.0 ROA-∇²ℒ.0 virt. worst
count 273.00 273.00 273.00 273.00 273.00 273.00 273.00 273.00 273.00
arith. mean 1.53 4.60 2.20 4.45 1.80 1.70 1.70 5.80 9.26
arith. std. 2.04 12.97 1.91 8.00 1.15 1.02 1.07 18.76 22.34
min 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.20
10.0% 1.00 1.11 1.12 1.08 1.01 1.00 1.01 1.04 1.57
25.0% 1.00 1.34 1.33 1.36 1.19 1.05 1.12 1.31 1.97
50.0% 1.03 1.96 1.67 2.12 1.47 1.30 1.40 1.85 3.62
75.0% 1.36 3.64 2.43 4.02 1.90 1.94 1.83 3.49 6.80
90.0% 1.84 6.14 3.47 8.93 2.82 2.94 2.61 9.88 14.18
max 22.83 132.16 23.16 82.91 12.12 7.99 12.16 256.98 256.98
better 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
close 155.00 30.00 30.00 43.00 54.00 85.00 66.00 47.00 0.00
worse 118.00 243.00 243.00 230.00 219.00 188.00 207.00 226.00 273.00


SolverTime
Filter: within 1% of known optimal value and no fail for all solvers

Attribute values were projected onto interval [0.1, 900.0].
Missing values and values for failed instances substituted by 900.0 .

Data OA.0 ROA-ℒ₁.0 ROA-ℒ₁/ℓ₂².0 ROA-ℒ₂.0 ROA-ℓ₁.0 ROA-ℓ₂².0 ROA-ℓ∞.0 ROA-∇²ℒ.0 virt. best virt. worst
count 298.00 298.00 298.00 298.00 298.00 298.00 298.00 298.00 298.00 298.00
arith. mean 23.99 71.65 38.52 87.86 30.83 28.61 31.61 86.08 15.15 140.95
arith. std. 66.35 146.34 106.53 205.55 94.90 85.63 98.75 202.02 40.58 245.57
geom. mean 6.50 13.53 9.12 12.63 7.81 7.39 7.39 12.97 4.58 25.57
geom. std. 4.66 7.05 4.93 7.39 4.63 4.73 4.87 7.29 4.15 8.15
sh.geom. mean 11.01 24.09 14.74 23.17 12.57 12.17 12.38 23.40 7.76 42.14
sh.geom. std. 2.14 3.24 2.45 3.47 2.25 2.22 2.29 3.41 1.89 4.12
min 0.19 0.23 0.23 0.27 0.24 0.22 0.20 0.29 0.19 0.48
10.0% 0.98 1.23 1.19 1.21 0.99 0.98 1.01 1.07 0.79 1.55
25.0% 1.76 2.53 2.51 2.21 2.47 2.33 1.95 2.68 1.61 3.98
50.0% 6.77 12.25 10.54 12.00 9.17 8.75 8.89 11.39 4.28 25.35
75.0% 19.81 49.46 22.45 46.16 18.71 17.76 19.32 49.99 11.50 147.19
90.0% 46.34 252.32 61.83 274.45 40.11 42.27 40.40 252.25 22.41 418.48
max 612.44 900.00 900.00 900.00 826.26 900.00 899.84 900.00 373.47 900.00
geometric mean shift: 10.0

Performance with respect to virt. best:
Tolerance: relative 0.1 absolute 0.1
Data OA.0 ROA-ℒ₁.0 ROA-ℒ₁/ℓ₂².0 ROA-ℒ₂.0 ROA-ℓ₁.0 ROA-ℓ₂².0 ROA-ℓ∞.0 ROA-∇²ℒ.0 virt. worst
count 298.00 298.00 298.00 298.00 298.00 298.00 298.00 298.00 298.00
arith. mean 2.38 10.80 2.38 5.96 1.97 1.88 1.83 7.44 17.19
arith. std. 4.63 31.93 2.06 13.19 1.39 1.34 1.23 21.08 37.08
min 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.20
10.0% 1.00 1.12 1.12 1.03 1.01 1.00 1.01 1.05 1.61
25.0% 1.00 1.40 1.34 1.28 1.21 1.07 1.14 1.33 2.08
50.0% 1.04 2.07 1.75 2.08 1.53 1.36 1.44 1.95 4.07
75.0% 1.40 4.35 2.60 4.33 2.06 2.17 1.94 4.30 9.19
90.0% 2.46 9.48 4.36 10.71 3.31 3.53 3.10 13.18 49.42
max 30.47 174.33 23.16 120.01 12.12 12.67 12.16 256.98 256.98
better 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
close 166.00 30.00 30.00 56.00 56.00 87.00 68.00 47.00 0.00
worse 132.00 268.00 268.00 242.00 242.00 211.00 230.00 251.00 298.00


SolverTime
Filter: within 10% of known optimal value and no fail for all solvers

Attribute values were projected onto interval [0.1, 900.0].
Missing values and values for failed instances substituted by 900.0 .

Data OA.0 ROA-ℒ₁.0 ROA-ℒ₁/ℓ₂².0 ROA-ℒ₂.0 ROA-ℓ₁.0 ROA-ℓ₂².0 ROA-ℓ∞.0 ROA-∇²ℒ.0 virt. best virt. worst
count 320.00 320.00 320.00 320.00 320.00 320.00 320.00 320.00 320.00 320.00
arith. mean 45.79 95.50 65.37 125.44 55.34 53.97 58.57 125.28 35.63 184.12
arith. std. 142.88 197.67 177.31 259.60 165.25 161.64 173.87 259.34 130.22 295.14
geom. mean 7.80 16.03 11.14 15.96 9.47 9.05 9.10 16.44 5.57 31.70
geom. std. 5.55 7.64 5.85 8.60 5.52 5.71 5.90 8.50 5.15 8.97
sh.geom. mean 13.80 28.35 18.58 29.55 15.87 15.59 15.92 29.94 10.18 51.80
sh.geom. std. 2.63 3.58 2.96 4.06 2.75 2.75 2.84 4.02 2.41 4.59
min 0.19 0.23 0.23 0.27 0.24 0.22 0.20 0.29 0.19 0.48
10.0% 1.00 1.25 1.27 1.23 1.05 1.01 1.03 1.13 0.81 1.60
25.0% 1.88 2.80 2.72 2.29 2.71 2.46 2.17 2.96 1.76 4.82
50.0% 7.16 14.20 10.82 14.83 10.31 9.38 9.81 14.46 5.31 35.23
75.0% 22.59 63.89 24.98 68.58 22.60 20.42 21.79 69.45 14.21 228.82
90.0% 59.19 300.05 125.74 477.01 74.30 99.98 117.68 457.02 42.62 900.00
max 900.00 900.00 900.00 900.00 900.00 900.00 900.00 900.00 900.00 900.00
geometric mean shift: 10.0

Performance with respect to virt. best:
Tolerance: relative 0.1 absolute 0.1
Data OA.0 ROA-ℒ₁.0 ROA-ℒ₁/ℓ₂².0 ROA-ℒ₂.0 ROA-ℓ₁.0 ROA-ℓ₂².0 ROA-ℓ∞.0 ROA-∇²ℒ.0 virt. worst
count 320.00 320.00 320.00 320.00 320.00 320.00 320.00 320.00 320.00
arith. mean 2.31 10.23 2.39 7.29 1.96 1.89 1.87 8.54 18.25
arith. std. 4.48 30.89 2.04 19.20 1.37 1.34 1.29 23.16 38.74
min 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00
10.0% 1.00 1.11 1.11 1.00 1.00 1.00 1.01 1.04 1.57
25.0% 1.00 1.39 1.33 1.26 1.20 1.06 1.14 1.32 2.02
50.0% 1.00 2.05 1.77 2.08 1.52 1.36 1.47 1.95 4.07
75.0% 1.39 4.11 2.63 4.43 2.08 2.19 1.96 4.46 9.47
90.0% 2.45 8.41 4.38 13.03 3.30 3.63 3.23 15.38 50.68
max 30.47 174.33 23.16 207.88 12.12 12.67 12.16 256.98 256.98
better 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
close 185.00 36.00 36.00 63.00 63.00 95.00 74.00 55.00 6.00
worse 135.00 284.00 284.00 257.00 257.00 225.00 246.00 265.00 314.00


SolverTime
Filter: no fail

Attribute values were projected onto interval [0.1, 900.0].
Missing values and values for failed instances substituted by 900.0 .


SolverTime
Filter: time >= 10.0 by at least one solver and no fail for all solvers

Attribute values were projected onto interval [0.1, 900.0].
Missing values and values for failed instances substituted by 900.0 .


SolverTime
Filter: gap <= 0.1% and not failed

Attribute values were projected onto interval [0.1, 900.0].
Missing values and values for failed instances substituted by 900.0 .


SolverTime
Filter: gap <= 1% and not failed

Attribute values were projected onto interval [0.1, 900.0].
Missing values and values for failed instances substituted by 900.0 .


SolverTime
Filter: gap <= 10% and not failed

Attribute values were projected onto interval [0.1, 900.0].
Missing values and values for failed instances substituted by 900.0 .


SolverTime
Filter: within 0.1% of known optimal value and not failed

Attribute values were projected onto interval [0.1, 900.0].
Missing values and values for failed instances substituted by 900.0 .


SolverTime
Filter: within 1% of known optimal value and not failed

Attribute values were projected onto interval [0.1, 900.0].
Missing values and values for failed instances substituted by 900.0 .


SolverTime
Filter: within 10% of known optimal value and not failed

Attribute values were projected onto interval [0.1, 900.0].
Missing values and values for failed instances substituted by 900.0 .


NumberOfIterations
Filter: no fail by all solver

Attribute values were projected onto interval [1, inf].

Data OA.0 ROA-ℒ₁.0 ROA-ℒ₁/ℓ₂².0 ROA-ℒ₂.0 ROA-ℓ₁.0 ROA-ℓ₂².0 ROA-ℓ∞.0 ROA-∇²ℒ.0 virt. best virt. worst
count 406.00 406.00 406.00 406.00 406.00 406.00 406.00 406.00 406.00 406.00
arith. mean 34.14 38.13 16.77 13.71 17.83 16.62 22.19 14.29 10.53 48.46
arith. std. 116.04 90.54 43.05 39.42 46.74 41.80 67.36 40.95 31.14 128.22
geom. mean 6.68 8.82 6.16 5.13 6.33 6.13 6.23 5.55 4.27 9.75
geom. std. 4.50 4.85 3.34 3.12 3.43 3.34 3.68 3.14 2.90 5.13
min 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00
10.0% 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00
25.0% 3.00 3.00 3.00 3.00 3.00 3.00 3.00 3.00 2.00 4.00
50.0% 4.00 6.00 6.00 4.00 5.00 5.00 5.00 5.00 4.00 7.00
75.0% 10.75 17.75 12.00 8.00 12.00 11.75 11.75 11.00 6.00 18.75
90.0% 75.00 136.00 23.00 21.00 28.00 24.00 29.00 20.00 17.00 181.50
max 1279.00 933.00 346.00 355.00 430.00 380.00 743.00 390.00 346.00 1279.00

Performance with respect to virt. best:
Tolerance: relative 0.1
Data OA.0 ROA-ℒ₁.0 ROA-ℒ₁/ℓ₂².0 ROA-ℒ₂.0 ROA-ℓ₁.0 ROA-ℓ₂².0 ROA-ℓ∞.0 ROA-∇²ℒ.0 virt. worst
count 406.00 406.00 406.00 406.00 406.00 406.00 406.00 406.00 406.00
arith. mean 3.50 6.75 1.74 1.29 1.83 1.73 1.91 1.51 7.20
arith. std. 8.40 21.54 1.58 0.71 1.72 1.50 2.37 1.25 21.62
min 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00
10.0% 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00
25.0% 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00
50.0% 1.00 1.50 1.19 1.00 1.20 1.20 1.18 1.00 1.67
75.0% 1.47 2.67 1.75 1.33 1.75 1.67 1.60 1.40 3.00
90.0% 4.69 5.64 2.88 1.84 3.19 2.75 3.00 2.00 7.68
max 52.00 127.00 14.00 9.74 11.91 9.00 23.33 10.79 127.00
better 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
close 227.00 141.00 191.00 259.00 176.00 190.00 190.00 227.00 112.00
worse 179.00 265.00 215.00 147.00 230.00 216.00 216.00 179.00 294.00


NumberOfIterations
Filter: time >= 10.0 by at least one solver and no fail for all solvers

Attribute values were projected onto interval [1, inf].

Data OA.0 ROA-ℒ₁.0 ROA-ℒ₁/ℓ₂².0 ROA-ℒ₂.0 ROA-ℓ₁.0 ROA-ℓ₂².0 ROA-ℓ∞.0 ROA-∇²ℒ.0 virt. best virt. worst
count 284.00 284.00 284.00 284.00 284.00 284.00 284.00 284.00 284.00 284.00
arith. mean 47.45 52.90 22.51 18.26 24.06 22.36 30.38 19.02 13.88 67.50
arith. std. 136.65 104.86 50.38 46.38 54.71 48.86 79.16 48.17 36.71 149.36
geom. mean 10.65 15.31 9.30 7.30 9.71 9.31 9.63 8.11 5.80 17.20
geom. std. 4.47 4.43 3.01 2.96 3.09 3.02 3.46 2.87 2.85 4.68
min 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00
10.0% 3.00 3.00 3.00 2.30 3.00 3.00 3.00 3.00 2.00 4.00
25.0% 4.00 5.00 5.00 4.00 5.00 5.00 4.00 4.00 3.00 6.00
50.0% 6.00 9.00 7.00 5.00 7.00 7.00 6.50 6.00 4.00 9.00
75.0% 28.25 41.00 15.00 14.25 16.25 16.00 17.00 14.00 9.00 44.50
90.0% 97.70 185.40 31.70 28.70 39.10 34.00 70.00 25.70 22.00 218.70
max 1279.00 933.00 346.00 355.00 430.00 380.00 743.00 390.00 346.00 1279.00

Performance with respect to virt. best:
Tolerance: relative 0.1
Data OA.0 ROA-ℒ₁.0 ROA-ℒ₁/ℓ₂².0 ROA-ℒ₂.0 ROA-ℓ₁.0 ROA-ℓ₂².0 ROA-ℓ∞.0 ROA-∇²ℒ.0 virt. worst
count 284.00 284.00 284.00 284.00 284.00 284.00 284.00 284.00 284.00
arith. mean 4.53 9.12 1.96 1.37 2.12 1.98 2.25 1.67 9.68
arith. std. 9.87 25.39 1.67 0.80 1.97 1.71 2.76 1.44 25.45
min 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00
10.0% 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.02
25.0% 1.00 1.22 1.00 1.00 1.00 1.00 1.00 1.00 1.36
50.0% 1.19 1.83 1.33 1.00 1.36 1.33 1.33 1.18 2.06
75.0% 2.00 3.65 2.00 1.50 2.00 2.00 2.00 1.57 3.90
90.0% 7.68 8.94 3.52 2.00 4.05 4.22 5.11 2.50 10.21
max 52.00 127.00 10.00 9.74 11.91 9.00 23.33 10.79 127.00
better 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
close 128.00 53.00 96.00 159.00 82.00 96.00 90.00 128.00 30.00
worse 156.00 231.00 188.00 125.00 202.00 188.00 194.00 156.00 254.00


NumberOfIterations
Filter: within 0.1% of known optimal value and not failed

Attribute values were projected onto interval [1, inf].

Data OA.0 ROA-ℒ₁.0 ROA-ℒ₁/ℓ₂².0 ROA-ℒ₂.0 ROA-ℓ₁.0 ROA-ℓ₂².0 ROA-ℓ∞.0 ROA-∇²ℒ.0 virt. best virt. worst
count 320.00 306.00 330.00 312.00 330.00 328.00 328.00 316.00 342.00 273.00
arith. mean 26.47 24.41 16.49 13.01 16.55 16.99 19.98 14.44 12.57 25.79
arith. std. 95.40 57.23 39.43 35.26 40.52 40.67 60.99 36.73 33.53 77.79
geom. mean 6.17 7.24 6.37 5.11 6.46 6.42 6.35 6.03 4.86 7.10
geom. std. 4.02 4.09 3.39 3.15 3.38 3.43 3.57 3.23 3.15 4.09
min 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00
10.0% 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00
25.0% 3.00 3.00 3.00 2.00 3.00 3.00 3.00 3.00 2.00 3.00
50.0% 5.00 6.00 6.00 5.00 6.00 5.50 5.00 5.50 4.00 6.00
75.0% 10.00 13.00 13.00 9.00 13.75 13.00 13.00 13.00 8.75 13.00
90.0% 54.20 68.00 25.10 21.90 29.00 26.30 30.30 25.00 22.00 62.20
max 1020.00 580.00 346.00 355.00 430.00 380.00 743.00 390.00 346.00 1020.00

Performance with respect to virt. best:
Tolerance: relative 0.1
Data OA.0 ROA-ℒ₁.0 ROA-ℒ₁/ℓ₂².0 ROA-ℒ₂.0 ROA-ℓ₁.0 ROA-ℓ₂².0 ROA-ℓ∞.0 ROA-∇²ℒ.0 virt. worst
count 320.00 306.00 330.00 312.00 330.00 328.00 328.00 316.00 273.00
arith. mean 2.26 3.12 1.62 1.20 1.74 1.63 1.64 1.53 3.48
arith. std. 5.68 10.24 1.54 0.46 1.66 1.45 1.46 1.26 10.83
min 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00
10.0% 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00
25.0% 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00
50.0% 1.00 1.25 1.07 1.00 1.17 1.11 1.09 1.00 1.33
75.0% 1.26 2.00 1.50 1.20 1.62 1.50 1.50 1.38 2.40
90.0% 2.34 3.68 2.33 1.75 2.76 2.50 2.38 2.25 4.00
max 45.50 116.00 14.00 4.00 10.00 9.00 11.00 7.50 116.00
better 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
close 205.00 129.00 169.00 222.00 154.00 164.00 166.00 176.00 101.00
worse 115.00 177.00 161.00 90.00 176.00 164.00 162.00 140.00 172.00


NumberOfIterations
Filter: within 0.1% of known optimal value and not failed

Attribute values were projected onto interval [1, inf].