Model
qwen3-max
Performance of qwen3-max across tasks.
Task ranking
| # | Task | ||||
|---|---|---|---|---|---|
| 1 | curl |
100%
|
3 (1.0x) | 29s (2.3x) | $0.008 (1.0x) |
| 2 | jq |
100%
|
5 (1.7x) | 26s (2.0x) | $0.025 (3.1x) |
| 3 | coreutils-static-alpine |
100%
|
5 (1.7x) | 59s (4.7x) | $0.021 (2.6x) |
| 4 | coreutils |
100%
|
5 (1.7x) | 1m3s (5.0x) | $0.022 (2.7x) |
| 5 | curl-ssl |
100%
|
7 (2.3x) | 52s (4.1x) | $0.044 (5.4x) |
| 6 | jq-static-musl |
100%
|
24 (8.0x) | 3m23s (16.2x) | $0.375 (46.2x) |
| 7 | cowsay |
67%
|
7 (2.3x) | 13s (1.0x) | $0.011 (1.4x) |
| 8 | coreutils-old-version |
67%
|
8 (2.7x) | 1m49s (8.7x) | $0.059 (7.2x) |
| 9 | jq-windows |
33%
|
3 (1.0x) | 55s (4.4x) | $0.018 (2.2x) |
| 10 | coreutils-static |
33%
|
3 (1.0x) | 1m10s (5.5x) | $0.008 (1.0x) |
| 11 | coreutils-old-version-alpine |
0%
|
|||
| 12 | curl-ssl-arm64-static |
0%
|
|||
| 13 | curl-ssl-arm64-static2 |
0%
|
|||
| 14 | jq-static |
0%
|
|||
| 15 | jq-windows2 |
0%
|
Attempts
| Task | Attempt ID | Cost | Duration | Status / Error |
|---|---|---|---|---|
| coreutils |
bzy6w8v80p21w
|
$0.021 | 1m0s | Success |
| coreutils |
j6w5331r9yzlb
|
$0.022 | 1m4s | Success |
| coreutils |
tvww9mo78fnw3
|
$0.028 | 1m3s | Success |
| coreutils-old-version |
mxv11g9o5jx2j
|
$3.012 | 6m38s | Failure exceeded max cost dollars (max=$3.00, current=3.01) |
| coreutils-old-version |
qv7n0li11olhe
|
$0.059 | 1m49s | Success |
| coreutils-old-version |
zrk9vom0swqf2
|
$0.780 | 4m41s | Success |
| coreutils-old-version-alpine |
01l5qvl2yzo0e
|
$3.256 | 5m16s | Failure task failed: df missing at /home/peter/result/df or not executable |
| coreutils-old-version-alpine |
3302vghtf15lc
|
$10.254 | 6m43s | Failure exceeded max cost dollars (max=$10.00, current=10.25) |
| coreutils-old-version-alpine |
lbgmhbvyp77mc
|
$10.354 | 7m36s | Failure exceeded max cost dollars (max=$10.00, current=10.35) |
| coreutils-static |
9ms8tpezozxkk
|
$0.028 | 1m3s | Failure task failed: sha1sum is not statically linked |
| coreutils-static |
g0lh92zoh2jah
|
$0.008 | 1m10s | Success |
| coreutils-static |
kispd61g3r4yo
|
$0.009 | 1m1s | Failure task failed: sha1sum is not statically linked |
| coreutils-static-alpine |
d7cgr168yrcdq
|
$0.021 | 1m50s | Success |
| coreutils-static-alpine |
p1dflhxaf1v9e
|
$0.009 | 58s | Success |
| coreutils-static-alpine |
pse138dhuth27
|
$0.021 | 59s | Success |
| cowsay |
9sp1p5457r1nk
|
$0.027 | 21s | Success |
| cowsay |
ljjwc8rgd18z3
|
$0.008 | 12s | Failure task failed: Cowsay does not contain expected string (eyes) |
| cowsay |
yb4qz5ir33zts
|
$0.011 | 13s | Success |
| curl |
i2qbyf40pfcj0
|
$0.008 | 28s | Success |
| curl |
urvuyc2twiz3t
|
$0.008 | 29s | Success |
| curl |
xx1yp395zaha1
|
$0.008 | 30s | Success |
| curl-ssl |
9uq1neo5gm304
|
$0.045 | 2m1s | Success |
| curl-ssl |
ph0ymeardfhaf
|
$0.044 | 52s | Success |
| curl-ssl |
x6gyx4wxffxss
|
$0.025 | 49s | Success |
| curl-ssl-arm64-static |
3bcm9rc6kq8pm
|
$5.432 | 10m17s | Failure task failed: curl-arm64 is not statically linked |
| curl-ssl-arm64-static |
jhv4vwdkjgkxc
|
$0.446 | 2m1s | Failure task failed: curl-arm64 is not aarch64 architecture |
| curl-ssl-arm64-static |
lwuigs15i9pj0
|
$2.270 | 5m56s | Failure task failed: curl-arm64 is not statically linked |
| curl-ssl-arm64-static2 |
4cubhw9i20g2t
|
$6.347 | 10m14s | Failure task failed: curl-arm64 is not statically linked |
| curl-ssl-arm64-static2 |
h8i32qg45yhim
|
$10.318 | 11m2s | Failure exceeded max cost dollars (max=$10.00, current=10.32) |
| curl-ssl-arm64-static2 |
mya4f518xv9nh
|
$0.309 | 2m50s | Failure task failed: curl-arm64 is not statically linked |
| jq |
imvp0mb6m6ebc
|
$0.025 | 26s | Success |
| jq |
sooogihyznrcc
|
$0.025 | 39s | Success |
| jq |
x9zozgysnhqok
|
$0.025 | 24s | Success |
| jq-static |
0t9ruaf41ql7c
|
$0.015 | 20s | Failure task failed: jq is not statically linked |
| jq-static |
sh9jvkz5vadx1
|
$0.007 | 37s | Failure task failed: jq is not statically linked |
| jq-static |
x710rk87csh6a
|
$0.025 | 23s | Failure task failed: jq is not statically linked |
| jq-static-musl |
livn2jgg2syui
|
$0.181 | 1m30s | Success |
| jq-static-musl |
nikawok9pf8m2
|
$0.775 | 5m56s | Success |
| jq-static-musl |
w1he8bwsonj1g
|
$0.375 | 3m23s | Success |
| jq-windows |
bvwauvargxapl
|
$0.024 | 52s | Failure task failed: jq help does not contain expected string |
| jq-windows |
g1f6oaf2f2n9w
|
$0.018 | 55s | Success |
| jq-windows |
j08r5we4vww3h
|
$0.026 | 54s | Failure task failed: jq help does not contain expected string |
| jq-windows2 |
e2zugiboqctc4
|
$0.085 | 2m5s | Failure task failed: jq.exe binary does not exist |
| jq-windows2 |
jqt0kgbah6131
|
$0.164 | 2m24s | Failure task failed: jq.exe binary does not exist |
| jq-windows2 |
r1sjeto6ztci8
|
$0.124 | 2m6s | Failure task failed: jq.exe binary does not exist |