Model
Performance of claude-opus-4.1-thinking-16k across tasks.
| Task | Attempt ID | Cost | Duration | Status / Error |
|---|---|---|---|---|
| coreutils-old-version-alpine | 2edc703j4ndd0 | $9.235 | 15m47s | Failure task failed: install missing at /home/peter/result/install or not executable |
| coreutils-old-version-alpine | n1fb7u1kd1wel | $9.828 | 14m37s | Success |
| coreutils-old-version-alpine | ymjhxjhwxqf4k | $5.958 | 7m53s | Success |
| coreutils-old-version | 4zgknwl6ebr1d | $2.583 | 19m3s | Success |
| coreutils-old-version | l4sqq9kgy7m3k | $0.900 | 3m50s | Success |
| coreutils-old-version | y4igco0imbqau | $1.494 | 5m23s | Success |
| coreutils-static-alpine | 387hqtqn6lzy9 | $0.419 | 2m22s | Success |
| coreutils-static-alpine | bx2ctc0ns2ynx | $0.566 | 2m32s | Success |
| coreutils-static-alpine | im394kaoa21dw | $0.562 | 2m24s | Success |
| coreutils-static | 2a91dvdgom3h7 | $0.560 | 3m5s | Success |
| coreutils-static | 90x3ffomvf2ec | $0.654 | 3m18s | Success |
| coreutils-static | zvki8ok6bwoff | $0.619 | 3m25s | Success |
| coreutils | e28iidf9k7lni | $0.566 | 2m55s | Success |
| coreutils | fq8lve965t7ka | $0.494 | 2m22s | Success |
| coreutils | t5kmlo7zth3u9 | $0.603 | 2m50s | Success |
| cowsay | ab63zko4dieft | $0.316 | 1m25s | Success |
| cowsay | l8ez2tqzf038e | $0.367 | 1m47s | Success |
| cowsay | ngs999xy01yo0 | $0.371 | 1m27s | Success |
| curl-ssl-arm64-static | ksaa3cbngdmc5 | $1.878 | 5m51s | Failure task failed: curl HTTPS request to google.com did not return content-type: text/html but instead: } [2 bytes data] * SSL... |
| curl-ssl-arm64-static | rvax3whpzh0ve | $3.086 | 7m54s | Failure task failed: curl HTTPS request to google.com did not return content-type: text/html but instead: } [2 bytes data] * SSL... |
| curl-ssl-arm64-static | vqo04j3srxc9w | $3.051 | 7m40s | Success |
| curl-ssl-arm64-static2 | 7gjki9ropz5ul | $2.687 | 6m39s | Failure task failed: curl HTTPS request to google.com did not return content-type: text/html but instead: } [2 bytes data] * SSL... |
| curl-ssl-arm64-static2 | iwf5kl0tsu2w0 | $3.108 | 8m15s | Failure task failed: curl HTTPS request to google.com did not return content-type: text/html but instead: } [2 bytes data] * SSL... |
| curl-ssl-arm64-static2 | wtd8etmwr2tum | $3.960 | 9m32s | Success |
| curl-ssl | ai2z1k398755h | $0.926 | 3m40s | Success |
| curl-ssl | gtjy8wrg2udbb | $0.795 | 2m48s | Success |
| curl-ssl | wmmmeaie2a9vw | $0.805 | 3m15s | Success |
| curl | dfv4pts3rxcp8 | $0.443 | 1m50s | Success |
| curl | fzj1tcx9x3qe2 | $0.413 | 1m34s | Success |
| curl | vplzlg523e6yt | $0.564 | 2m11s | Success |
| jq-static-musl | 3hjt6z0gs0v7u | $0.979 | 2m52s | Failure task failed: jq is not statically linked |
| jq-static-musl | h1iod2d5n7pn9 | $1.022 | 2m47s | Success |
| jq-static-musl | u3iuoo14sr2yi | $1.149 | 3m0s | Failure task failed: jq is not statically linked |
| jq-static | b2hegj48h65u2 | $0.510 | 1m53s | Success |
| jq-static | ivhxywmaf071h | $0.972 | 2m48s | Success |
| jq-static | wcphjr3cut540 | $0.979 | 2m51s | Success |
| jq-windows | 9szb1799obgp9 | $0.386 | 1m32s | Failure task failed: jq help does not contain expected string |
| jq-windows | kgao0a35zjyl8 | $0.429 | 1m39s | Success |
| jq-windows | m6tlj075qy136 | $1.204 | 3m34s | Failure task failed: jq help does not contain expected string |
| jq-windows2 | 3m7r0nrztxoug | $1.430 | 4m44s | Success |
| jq-windows2 | jflah8m45e70a | $1.038 | 3m58s | Success |
| jq-windows2 | spz5e20yfjtxx | $0.858 | 2m45s | Success |
| jq | 2eseq5y7nrnff | $0.437 | 1m39s | Success |
| jq | mf2jn3tdak3lk | $0.402 | 1m23s | Success |
| jq | vebyzhzybqhi7 | $0.591 | 1m59s | Success |