Model
gpt-5-high
Performance of gpt-5-high across tasks.
Task ranking
| # | Task | ||||
|---|---|---|---|---|---|
| 1 | curl |
100%
|
4 (1.0x) | 2m7s (1.7x) | $0.059 (1.3x) |
| 2 | coreutils |
100%
|
6 (1.5x) | 2m33s (2.0x) | $0.064 (1.4x) |
| 3 | cowsay |
100%
|
7 (1.8x) | 1m16s (1.0x) | $0.045 (1.0x) |
| 4 | jq |
100%
|
7 (1.8x) | 1m41s (1.3x) | $0.051 (1.1x) |
| 5 | jq-static |
100%
|
10 (2.5x) | 2m29s (1.9x) | $0.086 (1.9x) |
| 6 | curl-ssl |
100%
|
10 (2.5x) | 2m38s (2.1x) | $0.079 (1.7x) |
| 7 | coreutils-static |
100%
|
10 (2.5x) | 3m41s (2.9x) | $0.117 (2.6x) |
| 8 | jq-windows |
100%
|
14 (3.5x) | 3m7s (2.4x) | $0.091 (2.0x) |
| 9 | jq-static-musl |
100%
|
17 (4.2x) | 2m57s (2.3x) | $0.078 (1.7x) |
| 10 | jq-windows2 |
100%
|
29 (7.2x) | 5m47s (4.5x) | $0.172 (3.8x) |
| 11 | coreutils-old-version |
100%
|
35 (8.8x) | 6m50s (5.4x) | $0.228 (5.0x) |
| 12 | coreutils-static-alpine |
67%
|
11 (2.8x) | 3m17s (2.6x) | $0.091 (2.0x) |
| 13 | curl-ssl-arm64-static2 |
67%
|
31 (7.8x) | 6m57s (5.4x) | $0.251 (5.5x) |
| 14 | coreutils-old-version-alpine |
67%
|
63 (15.8x) | 11m52s (9.3x) | $0.580 (12.8x) |
| 15 | curl-ssl-arm64-static |
0%
|
Attempts
| Task | Attempt ID | Cost | Duration | Status / Error |
|---|---|---|---|---|
| coreutils |
59x5dbjrvlewq
|
$0.064 | 2m33s | Success |
| coreutils |
6bygfzztwt9gk
|
$0.061 | 2m32s | Success |
| coreutils |
x4ia5x2kascfe
|
$0.082 | 3m32s | Success |
| coreutils-old-version |
lpwkqycgej1dy
|
$0.177 | 6m50s | Success |
| coreutils-old-version |
voe8esm42oiot
|
$0.228 | 5m39s | Success |
| coreutils-old-version |
ybnt1nyjz0lra
|
$0.291 | 8m32s | Success |
| coreutils-old-version-alpine |
8xsbws4w35j07
|
$0.580 | 11m52s | Success |
| coreutils-old-version-alpine |
hn5805nt2m0qz
|
$0.438 | 25m11s | Failure task failed: df missing at /home/peter/result/df or not executable |
| coreutils-old-version-alpine |
xmgu0wx9ubylz
|
$0.693 | 13m7s | Success |
| coreutils-static |
5lo26vu9b6whp
|
$0.093 | 3m22s | Success |
| coreutils-static |
q3hyeaa3pax04
|
$0.121 | 3m58s | Success |
| coreutils-static |
uqkifa3980qpy
|
$0.117 | 3m41s | Success |
| coreutils-static-alpine |
4dplv2asuz96k
|
$0.174 | 4m29s | Success |
| coreutils-static-alpine |
6kcstptn9q8fu
|
$0.091 | 3m17s | Success |
| coreutils-static-alpine |
nwmke9yqrdnee
|
$0.437 | 9m34s | Failure exceeded max tool calls (50) |
| cowsay |
6o0f037m4ier7
|
$0.045 | 1m27s | Success |
| cowsay |
8jb0vkfswvb49
|
$0.055 | 1m13s | Success |
| cowsay |
t5td2t4tw673c
|
$0.037 | 1m16s | Success |
| curl |
1kpgqsl29yngn
|
$0.059 | 2m7s | Success |
| curl |
5j52ohabvhzs4
|
$0.055 | 1m57s | Success |
| curl |
kg4nv8jv9trqa
|
$0.061 | 2m11s | Success |
| curl-ssl |
nckhvg37rrvka
|
$0.077 | 2m38s | Success |
| curl-ssl |
sr2cnxp5q2goj
|
$0.079 | 2m14s | Success |
| curl-ssl |
wb3o0g66o3ocp
|
$0.098 | 2m50s | Success |
| curl-ssl-arm64-static |
cfl9qebabpkgp
|
$0.258 | 8m6s | Failure task failed: curl HTTPS request to google.com did not return content-type: text/html but instead: } [2 bytes data] * SSL... |
| curl-ssl-arm64-static |
p0xrg1i5dtff9
|
$0.291 | 7m15s | Failure task failed: curl HTTPS request to google.com did not return content-type: text/html but instead: } [2 bytes data] * SSL... |
| curl-ssl-arm64-static |
yxbb8asz6qicb
|
$0.295 | 7m39s | Failure task failed: curl HTTPS request to google.com did not return content-type: text/html but instead: } [2 bytes data] * SSL... |
| curl-ssl-arm64-static2 |
3k0rnfimwqtzm
|
$0.251 | 6m57s | Success |
| curl-ssl-arm64-static2 |
5z34td35fkopt
|
$0.728 | 17m6s | Failure task failed: curl HTTPS request to google.com did not return content-type: text/html but instead: } [2 bytes data] * SSL... |
| curl-ssl-arm64-static2 |
dyuosdlxz9gzh
|
$0.498 | 11m34s | Success |
| jq |
sge8f0udia7a7
|
$0.048 | 1m32s | Success |
| jq |
ugaa1u07fm2yh
|
$0.066 | 1m50s | Success |
| jq |
yzssxil81hmtk
|
$0.051 | 1m41s | Success |
| jq-static |
ovqnoaiacdu9d
|
$0.045 | 1m34s | Success |
| jq-static |
tt4f1o4g0lx1e
|
$0.086 | 2m29s | Success |
| jq-static |
utxwl1j4a2xhf
|
$0.086 | 2m30s | Success |
| jq-static-musl |
16a031xzu2q4l
|
$0.078 | 2m57s | Success |
| jq-static-musl |
97y2o6a6u4gdo
|
$0.164 | 4m18s | Success |
| jq-static-musl |
nll1333z3b7nr
|
$0.071 | 2m13s | Success |
| jq-windows |
d8dlng4urmp14
|
$0.083 | 3m7s | Success |
| jq-windows |
egdr3smjmsgek
|
$0.091 | 3m17s | Success |
| jq-windows |
sktvqvlo13bbc
|
$0.094 | 2m44s | Success |
| jq-windows2 |
1eibpeqrnuuzi
|
$0.587 | 14m52s | Success |
| jq-windows2 |
ezim8wto7e4wd
|
$0.172 | 5m47s | Success |
| jq-windows2 |
oy6bk2cxohfto
|
$0.118 | 3m56s | Success |