Model
gpt-5-minimal
Performance of gpt-5-minimal across tasks.
Task ranking
| # | Task | ||||
|---|---|---|---|---|---|
| 1 | curl |
100%
|
1 (1.0x) | 40s (2.6x) | $0.010 (1.0x) |
| 2 | curl-ssl |
100%
|
3 (3.0x) | 1m18s (5.1x) | $0.018 (1.9x) |
| 3 | jq |
100%
|
5 (5.0x) | 31s (2.1x) | $0.013 (1.3x) |
| 4 | jq-windows |
100%
|
13 (13.0x) | 1m20s (5.2x) | $0.052 (5.5x) |
| 5 | coreutils-old-version |
100%
|
13 (13.0x) | 2m31s (9.8x) | $0.085 (9.0x) |
| 6 | jq-static |
67%
|
2 (2.0x) | 37s (2.4x) | $0.014 (1.5x) |
| 7 | coreutils |
67%
|
4 (4.0x) | 1m9s (4.5x) | $0.014 (1.5x) |
| 8 | cowsay |
67%
|
5 (5.0x) | 15s (1.0x) | $0.011 (1.1x) |
| 9 | jq-static-musl |
67%
|
12 (12.0x) | 1m26s (5.6x) | $0.040 (4.2x) |
| 10 | coreutils-static |
33%
|
1 (1.0x) | 1m21s (5.3x) | $0.010 (1.0x) |
| 11 | coreutils-static-alpine |
33%
|
12 (12.0x) | 1m20s (5.3x) | $0.025 (2.6x) |
| 12 | jq-windows2 |
33%
|
28 (28.0x) | 4m47s (18.7x) | $0.108 (11.3x) |
| 13 | coreutils-old-version-alpine |
0%
|
|||
| 14 | curl-ssl-arm64-static |
0%
|
|||
| 15 | curl-ssl-arm64-static2 |
0%
|
Attempts
| Task | Attempt ID | Cost | Duration | Status / Error |
|---|---|---|---|---|
| coreutils |
2340iu0u91fy4
|
$0.041 | 1m38s | Failure task failed: cat missing at /home/peter/result/cat or not executable |
| coreutils |
2ugptzs6vmzu6
|
$0.042 | 2m25s | Success |
| coreutils |
zfx0vqwf0t10l
|
$0.014 | 1m9s | Success |
| coreutils-old-version |
o2o7i6nrwj916
|
$0.050 | 2m12s | Success |
| coreutils-old-version |
sfasrxttuoiod
|
$0.085 | 2m31s | Success |
| coreutils-old-version |
sqjv5c8wq9w2c
|
$0.085 | 2m35s | Success |
| coreutils-old-version-alpine |
3djpvqzmime4t
|
$0.192 | 3m31s | Failure task failed: sha1sum binary does not exist |
| coreutils-old-version-alpine |
gy2h758v208x3
|
$0.066 | 1m34s | Failure task failed: sha1sum binary does not exist |
| coreutils-old-version-alpine |
x1o5f313ymcer
|
$0.211 | 3m6s | Failure task failed: df missing at /home/peter/result/df or not executable |
| coreutils-static |
0wf9zz975tfwg
|
$0.010 | 1m21s | Success |
| coreutils-static |
9fdga5w8t304a
|
$0.025 | 1m42s | Failure task failed: install missing at /home/peter/result/install or not executable |
| coreutils-static |
dyjf0zqepyisi
|
$0.022 | 2m33s | Failure task failed: install missing at /home/peter/result/install or not executable |
| coreutils-static-alpine |
0pwxxt2o80rcy
|
$0.030 | 1m19s | Failure task failed: kill missing at /home/peter/result/kill or not executable |
| coreutils-static-alpine |
28d0p3p2ov9xj
|
$0.025 | 1m50s | Failure task failed: install missing at /home/peter/result/install or not executable |
| coreutils-static-alpine |
q1kpb9n4d085m
|
$0.025 | 1m20s | Success |
| cowsay |
351q0x3pvxbvr
|
$0.011 | 15s | Success |
| cowsay |
fyn7ooaajq14f
|
$0.011 | 15s | Success |
| cowsay |
uicq8onf3sm5u
|
$0.023 | 35s | Failure task failed: Cowsay help does not contain expected string |
| curl |
b5bj7y1ehlylx
|
$0.009 | 30s | Success |
| curl |
s0qj05bfccji4
|
$0.010 | 40s | Success |
| curl |
wmzrhk9cefavg
|
$0.018 | 47s | Success |
| curl-ssl |
ksevvrvl1esbq
|
$0.035 | 1m18s | Success |
| curl-ssl |
wm3uscqd9ieeu
|
$0.014 | 1m6s | Success |
| curl-ssl |
ynt8pcvycy2br
|
$0.018 | 1m24s | Success |
| curl-ssl-arm64-static |
51t7e5ewp8mis
|
$0.146 | 4m53s | Failure task failed: curl-arm64 is not statically linked |
| curl-ssl-arm64-static |
e9jl27cdbh4il
|
$0.110 | 3m53s | Failure task failed: curl-arm64 is not statically linked |
| curl-ssl-arm64-static |
w43wmw0e9c1z2
|
$0.078 | 3m0s | Failure task failed: curl-arm64 binary does not exist |
| curl-ssl-arm64-static2 |
bk3ie9u6k63e7
|
$0.129 | 5m4s | Failure task failed: curl-arm64 is not statically linked |
| curl-ssl-arm64-static2 |
jgwom85utb9ta
|
$0.087 | 2m54s | Failure task failed: curl-arm64 is not statically linked |
| curl-ssl-arm64-static2 |
pcf1nmec989qv
|
$0.100 | 3m18s | Failure task failed: curl-arm64 is not aarch64 architecture |
| jq |
gtzqzmmw2k1i9
|
$0.016 | 34s | Success |
| jq |
j0pc54flzix2u
|
$0.010 | 31s | Success |
| jq |
q6v2sqchrus3x
|
$0.013 | 24s | Success |
| jq-static |
ekpxagh4mkrpx
|
$0.029 | 1m7s | Success |
| jq-static |
n3fptj1l197z4
|
$0.096 | 2m24s | Failure task failed: jq is not statically linked |
| jq-static |
r6mzoz6jd0dcb
|
$0.014 | 37s | Success |
| jq-static-musl |
6ail416l8118v
|
$0.058 | 1m46s | Success |
| jq-static-musl |
9sqq9xz4m17eh
|
$0.085 | 2m40s | Failure task failed: jq is not statically linked |
| jq-static-musl |
qicsv094u1y58
|
$0.040 | 1m26s | Success |
| jq-windows |
0xgj1oh2bi9aj
|
$0.031 | 1m7s | Success |
| jq-windows |
iyek3wml8lvmo
|
$0.053 | 1m53s | Success |
| jq-windows |
lvw52wwt1vo0j
|
$0.052 | 1m20s | Success |
| jq-windows2 |
00d9c596c8819
|
$0.071 | 2m22s | Failure task failed: jq help does not contain expected string |
| jq-windows2 |
7sodtoqizckoq
|
$0.073 | 2m9s | Failure task failed: jq.exe is not an amd64 Windows executable |
| jq-windows2 |
hkp1ulbssxdzo
|
$0.108 | 4m47s | Success |