Model
claude-opus-4.1-thinking-16k
Performance of claude-opus-4.1-thinking-16k across tasks.
Task ranking
| # | Task | ||||
|---|---|---|---|---|---|
| 1 | jq |
100%
|
9 (1.1x) | 1m40s (1.1x) | $0.437 (1.2x) |
| 2 | curl |
100%
|
9 (1.1x) | 1m51s (1.3x) | $0.443 (1.2x) |
| 3 | cowsay |
100%
|
10 (1.2x) | 1m28s (1.0x) | $0.367 (1.0x) |
| 4 | coreutils |
100%
|
12 (1.5x) | 2m50s (1.9x) | $0.566 (1.5x) |
| 5 | coreutils-static-alpine |
100%
|
14 (1.8x) | 2m24s (1.6x) | $0.562 (1.5x) |
| 6 | curl-ssl |
100%
|
14 (1.8x) | 3m17s (2.2x) | $0.805 (2.2x) |
| 7 | coreutils-static |
100%
|
14 (1.8x) | 3m18s (2.3x) | $0.619 (1.7x) |
| 8 | jq-static |
100%
|
19 (2.4x) | 2m49s (1.9x) | $0.972 (2.7x) |
| 9 | jq-windows2 |
100%
|
19 (2.4x) | 3m59s (2.7x) | $1.038 (2.8x) |
| 10 | coreutils-old-version |
100%
|
28 (3.5x) | 5m24s (3.7x) | $1.494 (4.1x) |
| 11 | coreutils-old-version-alpine |
67%
|
54 (6.8x) | 7m54s (5.4x) | $5.958 (16.2x) |
| 12 | jq-windows |
33%
|
8 (1.0x) | 1m46s (1.2x) | $0.429 (1.2x) |
| 13 | jq-static-musl |
33%
|
19 (2.4x) | 2m48s (1.9x) | $1.022 (2.8x) |
| 14 | curl-ssl-arm64-static |
33%
|
36 (4.5x) | 7m44s (5.3x) | $3.051 (8.3x) |
| 15 | curl-ssl-arm64-static2 |
33%
|
45 (5.6x) | 9m36s (6.6x) | $3.960 (10.8x) |
Attempts
| Task | Attempt ID | Cost | Duration | Status / Error |
|---|---|---|---|---|
| coreutils |
e28iidf9k7lni
|
$0.566 | 2m55s | Success |
| coreutils |
fq8lve965t7ka
|
$0.494 | 2m23s | Success |
| coreutils |
t5kmlo7zth3u9
|
$0.603 | 2m50s | Success |
| coreutils-old-version |
4zgknwl6ebr1d
|
$2.583 | 19m4s | Success |
| coreutils-old-version |
l4sqq9kgy7m3k
|
$0.900 | 3m51s | Success |
| coreutils-old-version |
y4igco0imbqau
|
$1.494 | 5m24s | Success |
| coreutils-old-version-alpine |
2edc703j4ndd0
|
$9.235 | 15m48s | Failure task failed: install missing at /home/peter/result/install or not executable |
| coreutils-old-version-alpine |
n1fb7u1kd1wel
|
$9.828 | 14m37s | Success |
| coreutils-old-version-alpine |
ymjhxjhwxqf4k
|
$5.958 | 7m54s | Success |
| coreutils-static |
2a91dvdgom3h7
|
$0.560 | 3m6s | Success |
| coreutils-static |
90x3ffomvf2ec
|
$0.654 | 3m18s | Success |
| coreutils-static |
zvki8ok6bwoff
|
$0.619 | 3m25s | Success |
| coreutils-static-alpine |
387hqtqn6lzy9
|
$0.419 | 2m23s | Success |
| coreutils-static-alpine |
bx2ctc0ns2ynx
|
$0.566 | 2m32s | Success |
| coreutils-static-alpine |
im394kaoa21dw
|
$0.562 | 2m24s | Success |
| cowsay |
ab63zko4dieft
|
$0.316 | 1m26s | Success |
| cowsay |
l8ez2tqzf038e
|
$0.367 | 1m48s | Success |
| cowsay |
ngs999xy01yo0
|
$0.371 | 1m28s | Success |
| curl |
dfv4pts3rxcp8
|
$0.443 | 1m51s | Success |
| curl |
fzj1tcx9x3qe2
|
$0.413 | 1m34s | Success |
| curl |
vplzlg523e6yt
|
$0.564 | 2m12s | Success |
| curl-ssl |
ai2z1k398755h
|
$0.926 | 3m42s | Success |
| curl-ssl |
gtjy8wrg2udbb
|
$0.795 | 2m50s | Success |
| curl-ssl |
wmmmeaie2a9vw
|
$0.805 | 3m17s | Success |
| curl-ssl-arm64-static |
ksaa3cbngdmc5
|
$1.878 | 5m52s | Failure task failed: curl HTTPS request to google.com did not return content-type: text/html but instead: } [2 bytes data] * SSL... |
| curl-ssl-arm64-static |
rvax3whpzh0ve
|
$3.086 | 7m56s | Failure task failed: curl HTTPS request to google.com did not return content-type: text/html but instead: } [2 bytes data] * SSL... |
| curl-ssl-arm64-static |
vqo04j3srxc9w
|
$3.051 | 7m44s | Success |
| curl-ssl-arm64-static2 |
7gjki9ropz5ul
|
$2.687 | 6m40s | Failure task failed: curl HTTPS request to google.com did not return content-type: text/html but instead: } [2 bytes data] * SSL... |
| curl-ssl-arm64-static2 |
iwf5kl0tsu2w0
|
$3.108 | 8m16s | Failure task failed: curl HTTPS request to google.com did not return content-type: text/html but instead: } [2 bytes data] * SSL... |
| curl-ssl-arm64-static2 |
wtd8etmwr2tum
|
$3.960 | 9m36s | Success |
| jq |
2eseq5y7nrnff
|
$0.437 | 1m40s | Success |
| jq |
mf2jn3tdak3lk
|
$0.402 | 1m24s | Success |
| jq |
vebyzhzybqhi7
|
$0.591 | 2m0s | Success |
| jq-static |
b2hegj48h65u2
|
$0.510 | 1m53s | Success |
| jq-static |
ivhxywmaf071h
|
$0.972 | 2m49s | Success |
| jq-static |
wcphjr3cut540
|
$0.979 | 2m51s | Success |
| jq-static-musl |
3hjt6z0gs0v7u
|
$0.979 | 2m53s | Failure task failed: jq is not statically linked |
| jq-static-musl |
h1iod2d5n7pn9
|
$1.022 | 2m48s | Success |
| jq-static-musl |
u3iuoo14sr2yi
|
$1.149 | 3m1s | Failure task failed: jq is not statically linked |
| jq-windows |
9szb1799obgp9
|
$0.386 | 1m40s | Failure task failed: jq help does not contain expected string |
| jq-windows |
kgao0a35zjyl8
|
$0.429 | 1m46s | Success |
| jq-windows |
m6tlj075qy136
|
$1.204 | 3m42s | Failure task failed: jq help does not contain expected string |
| jq-windows2 |
3m7r0nrztxoug
|
$1.430 | 4m45s | Success |
| jq-windows2 |
jflah8m45e70a
|
$1.038 | 3m59s | Success |
| jq-windows2 |
spz5e20yfjtxx
|
$0.858 | 2m46s | Success |