Carpe Diem Report.pdf


Aperçu du fichier PDF carpe-diem-report.pdf - page 7/8

Page 1 2 3 4 5 6 7 8


Aperçu texte


∆fopt 1e1
f1
11
A2 Carp 2.1(1)
A2 Zoub 2.2(2)
BFGS
1.2(0)
BIPOP-C 3.2(2)

1e0
1e-1
1e-2
1e-3
1e-5
1e-7
#succ
12
12
12
12
12
12
15/15
11(6)
50(7)
107(26)
167(26)
283(24)
391(32)
15/15
7.9(3) 15(4)
22(5)
30(5)
45(4)
60(9)
15/15
1.1(0)⋆4 1.1(0)⋆4 1.1(0)⋆4 1.1(0)⋆4 1.1(0)⋆4 1.1(0)⋆415/15
9.0(3) 15(3)
21(2)
27(4)
40(3)
53(5)
15/15

∆fopt 1e1
1e0
1e-1
1e-2
1e-3
1e-5
1e-7
#succ
f13
132
195
250
319
1310
1752
2255 15/15
A2 Carp 15(2)
151(134) 5628(7006)4408(7749) ∞

∞ 1e5
0/15
A2 Zoub 70(122) 613(159) 1748(3336)5354(5269)2842(1461) ∞
∞ 5e5
0/15
⋆4
⋆4
⋆4
⋆4
BFGS
1(0.3)
1(0.1)
1(0.0)
1(0.0)
4.8(11) 136(93)
∞ 5e4
0/15
⋆4
⋆4
5.4(3)
5.9(2)
5.4(0.9)
1.6(0.3) 1.5(0.3)1.7(0.2)
15/15
BIPOP-C 3.9(3)

∆fopt 1e1
1e0
1e-1
1e-2
1e-3
1e-5
1e-7
#succ
f2
83
87
88
89
90
92
94
15/15
A2 Carp 25(3)
32(3)
42(6)
53(4)
65(3)
86(4)
103(4)
15/15
A2 Zoub 15(5)
19(7)
21(4)
22(8)
23(5)
26(7)
28(9)
15/15
3.8(3)⋆4 5.6(2)⋆4 6.2(2)⋆4 6.5(1)⋆4 6.6(1)⋆4 6.9(2)⋆4 7.1(1)⋆4 15/15
BFGS
BIPOP-C13(4)
16(3)
18(1)
19(2)
20(2)
21(3)
22(2)
15/15

∆fopt 1e1
1e0
f14
10
41
A2 Carp 1.1(1)
2.4(1)
A2 Zoub 0.95(0.5)2.1(1)
2.2(1)
1.7(1)
BFGS
BIPOP-C 1.1(0.9) 2.8(1)

∆fopt 1e1
1e0
1e-1
f3
716
1622
1637
A2 Carp 25(1)
404(385) ∞
A2 Zoub 203(632) 4781(6390)∞
BFGS
107(71) ∞

BIPOP-C 1.4(0.9) 16(11) 139(65)

∆fopt 1e1
f15
511
A2 Carp 36(99)
A2 Zoub 191(282)
BFGS
87(137)
BIPOP-C 1.6(0.7)

∆fopt 1e1
f4
809
A2 Carp 34(0.8)
A2 Zoub 170(206)
BFGS
169(147)
BIPOP-C 2.7(1)

1e0
1633





1e-1
1688





1e-2
1642



139(521)

1e-3
1646



139(563)

1e-5
1650



139(110)

1e-2
1758





1e-3
1817





1e-5
1886





1e-7
#succ
1654
15/15
∞ 1e5
0/15
∞ 5e5
0/15
∞ 2e4
0/15
140(305) 14/15

1e-1
1e-2
1e-3
1e-5
1e-7
#succ
58
90
139
251
476
15/15
12(5)
18(2)
23(5)
69(7)
297(386)
3/15
3.2(0.9) 3.7(0.5) 5.0(1)
586(1361) ∞ 6e5
0/15
1.8(1)⋆2 1.5(0.7)⋆41.3(0.4)⋆4 1(0.2)⋆4 350(196)
0/15
⋆4
3.7(0.7) 4.0(1)
4.6(1)
5.4(1)
4.5(0.3) 15/15

1e0
9310

860(782)

1.5(1)⋆4

1e-1
19369



1.2(0.7)

1e-2
19743



1.2(0.6)

1e-3
20073



1.2(0.5)

1e-5
20769



1.2(0.5)

1e-7
#succ
21359 14/15
∞ 1e5
0/15
∞ 5e5
0/15
∞ 2e4
0/15
1.2(0.5) 15/15

#succ
∆fopt 1e1
1e0
1e-1
1e-2
1e-3
1e-5
1e-7
#succ
15/15
f16
120
612
2662
10163
10449
11644
12095 15/15
0/15
A2 Carp
3.8(5) 148(287) 105(188)
40(30)
39(31)
35(47)
34(27)
3/15
0/15
A2 Zoub
1.6(2) 237(357) 658(587) 374(743) 364(587) ∞
∞ 5e5
0/15
0/15
BFGS
153(102) 960(1066) ∞



∞ 4e4
0/15
0/15

⋆2
⋆2
⋆2
⋆2
BIPOP-C 3.0(4)
3.6(3)
2.6(1)
1.1(0.7) 1.3(2)
1.4(0.6) 1.4(2) 15/15
∆fopt 1e1
1e0
1e-1
1e-2
1e-3
1e-5
1e-7
#succ
∆fopt 1e1
1e0
1e-1
1e-2
1e-3
1e-5
1e-7
#succ
f5
10
10
10
10
10
10
10
15/15
f17
5.2
215
899
2861
3669
6351
7934
15/15
10(4)
10(4)
10(5)
10(6)
10(5)
10(4)
15/15
A2 Carp 7.7(4)
1.6(2)
1.7(0.9) 2.6(0.3) 4.1(0.2)
6.0(7) 33(20)
52(107)
3/15
A2 Zoub 7.3(5)
9.5(3)
9.5(4)
9.5(4)
9.5(5)
9.5(4)
9.5(5)
15/15 A2 Carp
1.9(2)
58(214) 73(33)
90(148) 347(591) ∞
∞ 5e5
0/15
A2 Zoub
BFGS
1.9(0.5)⋆33.0(0.9)⋆33.1(0.3)⋆33.1(0.8)⋆33.1(0.5)⋆33.1(0.5)⋆33.1(1)⋆3 15/15
BFGS
120(203) 645(679) ∞



∞ 2e4
0/15
BIPOP-C 4.5(1)
6.5(2)
6.6(2)
6.6(2)
6.6(2)
6.6(2)
6.6(3)
15/15
⋆2
⋆3
⋆3
1(0.2)
1(2)
1(1)
1(0.6)
1(0.6)
1.2(0.4) 15/15
BIPOP-C 3.4(3)
∆fopt 1e1
1e0
1e-1
1e-2
1e-3
1e-5
1e-7
#succ
∆fopt 1e1
1e0
1e-1
1e-2
1e-3
1e-5
1e-7
#succ
f6
114
214
281
404
580
1038
1332
15/15
f18
103
378
3968
8451
9280
10905
12469 15/15
7.4(2)
7.9(0.8) 7.3(0.8) 6.0(0.3) 6.3(0.3) 15/15
A2 Carp 2.0(0.6) 5.7(1)
4.0(1)
4.2(0.1) 14(15)
44(40)

∞ 1e5
0/15
A2 Zoub 1.7(0.8) 1.6(0.3) 1.8(0.6) 1.8(0.4) 1.6(0.3) 1.2(0.3) 1.3(0.2) 15/15 A2 Carp 1.1(1)
77(193) 78(123) 298(208)


∞ 5e5
0/15
BFGS
3.0(2)
3.3(1)
3.4(2)
3.0(1.0) 2.5(1)
2.0(0.8) 7.8(7)
15/15 A2 Zoub 79(0.5)
57(96)





∞ 2e4
0/15
BIPOP-C 2.3(1.0) 2.1(0.6) 2.2(0.7) 1.9(0.4) 1.7(0.2) 1.3(0.2) 1.3(0.1) 15/15 BFGS
⋆2
⋆4
⋆4
BIPOP-C 1(0.8)
3.4(3)
1(1)
1(0.4)
1(0.3)
1.2(0.6) 1.3(0.7) 15/15
1e0
1e-1
1e-2
1e-3
1e-5
1e-7
#succ
∆fopt 1e1
1e0
1e-1
1e-2
1e-3
1e-5
1e-7
#succ
∆fopt 1e1
f7
24
324
1171
1451
1572
1572
1597
15/15
f19
1
1
242
1.0e5
1.2e5
1.2e5
1.2e5 15/15
2.0(2)
7.6(0.3) 19(35)
25(32)
25(32)
25(47) 10/15
A2 Carp 2.9(3)
1(0)
1(0)
5960(8774) ∞


∞ 1e5
0/15
A2 Zoub 3.6(9) 577(1002)658(1149)542(874) 1112(1394)1112(1652)1471(1975) 3/15 A2 Carp
1(0)
1(0)




∞ 5e5
0/15
BFGS






∞ 600
0/15 A2 Zoub
1655(1240) 2.2e4(4e4) 1780(2389) ∞


∞ 3e4
0/15
BIPOP-C 5.0(4)
1.5(1)
1(1)
1(0.2)
1(0.7)
1(0.9)
1(0.9) 15/15 BFGS
BIPOP-C 20(18)
2801(1434) 161(161) 1(0.9) 1(0.9) 1(0.7) 1(0.7) 15/15
∆fopt 1e1
1e0
1e-1
1e-2
1e-3
1e-5
1e-7
#succ
∆f
1e1
1e0
1e-1
1e-2
1e-3
1e-5
1e-7
#succ
opt
f8
73
273
336
372
391
410
422
15/15
f20
16
851
38111
51362
54470
54861
55313 14/15
A2 Carp 7.8(2)
35(2)
36(2)
37(68)
37(3)
42(123) 48(6)
14/15
45(30)
37(37)
27(33)
26(60)
26(26)
25(27)
1/15
54(86)
50(12)
52(122) 55(69)
64(37)
76(48)
15/15 A2 Carp 2.4(2)
A2 Zoub 4.0(2)
⋆2
⋆2
⋆3
⋆3
⋆3
⋆3
1.7(1)
835(790)





5e5
0/15
A2
Zoub
BFGS
2.1(1)
1.8(3)
1.6(2)
1.5(1)
1.5(0.4) 1.5(0.4) 1.5(0.2) 15/15
1.8(0.9)
2.5(2) 10(10)
7.6(10)
7.2(3)
7.1(5)
7.1(8)
1/15
BIPOP-C 3.2(2)
3.7(3)
4.5(0.6) 4.7(1)
4.8(2)
5.1(4)
5.4(3)
15/15 BFGS
8.2(9)
2.8(3)
2.2(1)
2.1(0.9) 2.2(1)
2.2(1)
15/15
BIPOP-C 3.3(2)
1e0
1e-1
1e-2
1e-3
1e-5
1e-7
#succ
∆fopt 1e1
∆fopt 1e1
1e0
1e-1
1e-2
1e-3
1e-5
1e-7
#succ
f9
35
127
214
263
300
335
369
15/15
f21
41
1157
1674
1692
1705
1729
1757
14/15
A2 Carp 18(9)
18(8)
22(2)
25(6)
26(6)
31(7)
34(6)
15/15
1/15
A2 Zoub 4.5(2) 243(646) 150(75) 133(115) 128(284) 140(93) 156(416) 15/15 A2 Carp 2.0(2) 562(821) 836(926) 828(931) 822(836) 811(795) 798(512)
A2 Zoub 93(0.7) 217(192) 430(445) 425(544) 422(495) 416(663) 410(534)
8/15
⋆2
⋆3
⋆3
⋆3
⋆4
⋆4
BFGS
3.6(3)
3.0(0.7) 2.0(1)
1.8(0.7) 1.6(0.5) 1.5(0.8) 1.4(0.6)15/15
BFGS
3.8(4)
1.4(2)
1.9(3)
1.9(3)
1.9(2)
1.9(3)
2.0(2) 15/15
BIPOP-C 5.8(1)
8.7(4)
7.2(2)
6.7(5)
6.4(4)
6.3(4)
6.2(5) 15/15
14(6)
24(74)
25(119) 25(21)
25(36)
25(20)
15/15
BIPOP-C 2.3(2)
∆fopt 1e1
1e0
1e-1
1e-2
1e-3
1e-5
1e-7
#succ
1e0
1e-1
1e-2
1e-3
1e-5
1e-7
#succ
∆fopt 1e1
f10
349
500
574
607
626
829
880
15/15
f22
71
386
938
980
1008
1040
1068
14/15
A2 Carp 42(18)
42(18)
43(14)
49(16)
56(15)
56(14)
68(20) 15/15
A2 Carp 218(705) 389(259) 214(240) 206(230) 200(174) 195(120) 192(234) 5/15
A2 Zoub 241(907) 679(850) 1446(1199)
6141(6233)
5960(1e4) 4513(7623)
9469(7777) 0/15
A2 Zoub 170(228) 425(545) 304(431) 292(95) 284(371) 275(376) 269(734) 11/15
BFGS
1(0.3)⋆4 1(0.3)⋆4 1(0.2)⋆4 1(0.2)⋆4 1(0.4)⋆4 1.1(0.2)⋆2
23(39)
5/15 BFGS
3.1(3)
2.9(2)
2.1(2)
2.1(2)
2.0(2)
2.0(2)
2.6(4) 14/15
⋆2
15/15
BIPOP-C 3.5(0.6) 2.9(0.5) 2.7(0.4) 2.7(0.3) 2.8(0.3) 2.3(0.2) 2.4(0.2)
BIPOP-C 6.9(15) 20(57)
45(105) 43(69)
42(47)
41(84)
40(93) 15/15
1e0
1e-1
1e-2
1e-3
1e-5
1e-7
#succ
∆fopt 1e1
1e0
1e-1
1e-2
1e-3
1e-5
1e-7
#succ
∆fopt 1e1
f11
143
202
763
977
1177
1467
1673
15/15
f23
3.0
518
14249
27890
31654
33030
34256 15/15
A2 Carp 138(61)
143(63)
54(31)
62(25)
60(69)
89(55)
112(142)
6/15 A2 Carp 2.3(2)
91(117)
19(15)
12(12)
15(18)
22(15)
21(45)
2/15
A2 Zoub 3236(3517) 1.8e4(2e4)∞



∞ 5e5
0/15 A2 Zoub 1.7(2)
95(60)
165(121) ∞


∞ 5e5
0/15
11(4)
31(35)




∞ 2e4
0/15
BFGS
1(0.2)⋆4 1(0.1)⋆4 1.1(0.8)⋆1.9(2)
8.2(4) 199(272) ∞ 4e4
0/15 BFGS

⋆4
⋆4
BIPOP-C
1.7(1)
13(9)
3.7(5)
2.1(2)
1.8(1)
1.8(1)
1.8(2)
15/15
BIPOP-C
8.4(3)
7.2(2)
2.2(0.3) 1.8(0.2) 1.6(0.2) 1.4(0.1) 1.3(0.1) 15/15
∆fopt 1e1
1e0
1e-1
1e-2
1e-3
1e-5
f12
108
268
371
413
461
1303
A2 Carp 73(37)
39(25)
35(15)
39(9)
42(11)
18(3)
154(513) 139(311) 166(409) 73(98)
A2 Zoub 165(593) 210(5)
BFGS
1.1(1)⋆4 1(0.5)⋆4 1(0.5)⋆3 1(0.4)⋆4 1(0.7)⋆4 2.0(3)
BIPOP-C 11(12)
7.4(8)
7.4(6)
7.5(4)
7.7(4)
3.3(2)

1e-7
1903
∞ 1e5
∞ 5e5
∞ 2e4
∞ 2e6

1e-7
1494
19(2)
64(85)
49(92)
3.3(2)

#succ
15/15
15/15
14/15
5/15
15/15

∆fopt 1e1
f24
1622
A2 Carp 63(79)
A2 Zoub 50(108)
BFGS
69(76)
BIPOP-C 2.1(2)

1e0
2.2e5



1.6(1)

1e-1
6.4e6



1(1)

1e-2
9.6e6



1(0.8)

1e-3
9.6e6



1(1)

1e-5
1.3e7



1(2)

1e-7
1.3e7
∞ 1e5
∞ 5e5
∞ 2e4
1(2)

#succ
3/15
0/15
0/15
0/15
3/15

Table 1: Average running time (aRT in number of function evaluations) divided by the respective best aRT
measured during BBOB-2009 in dimension 5. The aRT and in braces, as dispersion measure, the half difference
between 10 and 90%-tile of bootstrapped run lengths appear for each algorithm and target, the corresponding
best aRT in the first row. The different target ∆f -values are shown in the top row. #succ is the number
of trials that reached the (final) target fopt + 10−8 . The median number of conducted function evaluations is
additionally given in italics, if the target in the last column was never reached. Entries, succeeded by a star,
are statistically significantly better (according to the rank-sum test) when compared to all other algorithms
of the table, with p = 0.05 or p = 10−k when the number k following the star is larger than 1, with Bonferroni
correction of 110. A ↓ indicates the same tested against the best algorithm of BBOB-2009. Best results are
printed in bold.