Model
gpt-5-mini-minimal
Performance of gpt-5-mini-minimal across tasks.
Task ranking
| # | Task | ||||
|---|---|---|---|---|---|
| 1 | jq |
100%
|
3 (1.5x) | 24s (1.3x) | $0.002 (1.0x) |
| 2 | curl-ssl |
100%
|
7 (3.5x) | 1m27s (5.0x) | $0.007 (4.1x) |
| 3 | coreutils-static |
67%
|
2 (1.0x) | 1m19s (4.5x) | $0.003 (1.6x) |
| 4 | coreutils-static-alpine |
67%
|
5 (2.5x) | 1m9s (4.0x) | $0.004 (2.4x) |
| 5 | coreutils |
33%
|
3 (1.5x) | 1m3s (3.6x) | $0.003 (1.6x) |
| 6 | cowsay |
33%
|
4 (2.0x) | 18s (1.0x) | $0.002 (1.5x) |
| 7 | coreutils-old-version |
33%
|
5 (2.5x) | 3m7s (10.7x) | $0.007 (3.9x) |
| 8 | coreutils-old-version-alpine |
0%
|
|||
| 9 | curl |
0%
|
|||
| 10 | curl-ssl-arm64-static |
0%
|
|||
| 11 | curl-ssl-arm64-static2 |
0%
|
|||
| 12 | jq-static |
0%
|
|||
| 13 | jq-static-musl |
0%
|
|||
| 14 | jq-windows |
0%
|
|||
| 15 | jq-windows2 |
0%
|
Attempts
| Task | Attempt ID | Cost | Duration | Status / Error |
|---|---|---|---|---|
| coreutils |
8kdbqlawdlfsk
|
$0.003 | 1m10s | Failure task failed: sha1sum binary does not exist |
| coreutils |
j916wqm4dkq54
|
$0.003 | 1m9s | Failure task failed: sha1sum binary does not exist |
| coreutils |
xlwu5dg5wooqr
|
$0.003 | 1m3s | Success |
| coreutils-old-version |
d9t1djg24wnaq
|
$0.016 | 4m1s | Failure task failed: sha1sum binary does not exist |
| coreutils-old-version |
ov75uekkycz7t
|
$0.007 | 3m7s | Success |
| coreutils-old-version |
xa3nkglfqxzsi
|
$0.007 | 3m20s | Failure task failed: sha1sum binary does not exist |
| coreutils-old-version-alpine |
ahn7gmt14ic2c
|
$0.012 | 1m7s | Failure task failed: sha1sum binary does not exist |
| coreutils-old-version-alpine |
mf5roenxa2b7c
|
$0.025 | 2m24s | Failure task failed: sha1sum binary does not exist |
| coreutils-old-version-alpine |
tfelny2ccy8dm
|
$0.008 | 1m7s | Failure task failed: sha1sum binary does not exist |
| coreutils-static |
enorhmoh6t2fw
|
$0.003 | 1m19s | Success |
| coreutils-static |
lo37qtix0tzwi
|
$0.003 | 1m17s | Failure task failed: sha1sum is not statically linked |
| coreutils-static |
xstto1rh4k7wp
|
$0.004 | 1m22s | Success |
| coreutils-static-alpine |
gzm9ox4kjjy9g
|
$0.006 | 1m21s | Failure task failed: kill missing at /home/peter/result/kill or not executable |
| coreutils-static-alpine |
jxbbw55e1jaqj
|
$0.005 | 1m9s | Success |
| coreutils-static-alpine |
my8luqikggpov
|
$0.004 | 1m51s | Success |
| cowsay |
d3uhbkoymgwyz
|
$0.002 | 18s | Success |
| cowsay |
er0nekqcuirte
|
$0.005 | 14m58s | Failure context timeout: context deadline exceeded |
| cowsay |
fpzyzsi4412rc
|
$0.003 | 14m58s | Failure context timeout: context deadline exceeded |
| curl |
5xm729eayko85
|
$0.004 | 1m0s | Failure task failed: curl did not download the expected local file content, but instead: curl: (1) Protocol "file" not supported |
| curl |
drc17c5616vr4
|
$0.010 | 1m7s | Failure task failed: curl binary does not exist |
| curl |
yxo4dtf5738u7
|
$0.011 | 59s | Failure task failed: curl binary does not exist |
| curl-ssl |
d3xcrvwv0joie
|
$0.007 | 1m27s | Success |
| curl-ssl |
qtvgxyactviw5
|
$0.013 | 1m27s | Success |
| curl-ssl |
xe0l2z17w7e9o
|
$0.005 | 11m11s | Success |
| curl-ssl-arm64-static |
h1mzv58a7cun3
|
$0.009 | 1m21s | Failure task failed: curl binary does not exist |
| curl-ssl-arm64-static |
hg2qyij9lumid
|
$0.014 | 1m16s | Failure task failed: curl binary does not exist |
| curl-ssl-arm64-static |
n7ucyb5c23f8f
|
$0.015 | 2m0s | Failure task failed: curl-arm64 is not aarch64 architecture |
| curl-ssl-arm64-static2 |
4xn3ha3h42whs
|
$0.012 | 1m31s | Failure task failed: curl binary does not exist |
| curl-ssl-arm64-static2 |
7tmn4bgpvxo5u
|
$0.020 | 3m38s | Failure task failed: curl binary does not exist |
| curl-ssl-arm64-static2 |
8hzjgjkn6nunc
|
$0.008 | 1m1s | Failure task failed: curl binary does not exist |
| jq |
26v39d6u13isn
|
$0.002 | 23s | Success |
| jq |
fackcax423deu
|
$0.004 | 24s | Success |
| jq |
g6w5myagubmml
|
$0.002 | 24s | Success |
| jq-static |
2h1c1sy9f9jre
|
$0.005 | 1m11s | Failure task failed: jq is not statically linked |
| jq-static |
b2vc62dfk2qvf
|
$0.004 | 46s | Failure task failed: jq binary does not exist |
| jq-static |
chjdmgh5r7op2
|
$0.005 | 1m0s | Failure task failed: jq is not statically linked |
| jq-static-musl |
0g92qpw1sk5vv
|
$0.005 | 1m7s | Failure task failed: jq is not statically linked |
| jq-static-musl |
3mb0pufknb7sj
|
$0.006 | 49s | Failure task failed: jq is not statically linked |
| jq-static-musl |
nyjjqhocueej7
|
$0.008 | 1m12s | Failure task failed: jq is not statically linked |
| jq-windows |
kpkn5xcvmfvi7
|
$0.003 | 1m2s | Failure task failed: jq help does not contain expected string |
| jq-windows |
t8t8p0rm0ql8a
|
$0.004 | 1m0s | Failure task failed: jq help does not contain expected string |
| jq-windows |
ygrlg46vj3qyo
|
$0.007 | 1m4s | Failure task failed: jq help does not contain expected string |
| jq-windows2 |
9mdmis9v2p3un
|
$0.005 | 1m3s | Failure task failed: jq help does not contain expected string |
| jq-windows2 |
esxol272taxki
|
$0.012 | 2m22s | Failure task failed: jq help does not contain expected string |
| jq-windows2 |
mpfnoe17z75um
|
$0.008 | 1m4s | Failure task failed: jq help does not contain expected string |