Model
Performance of claude-sonnet-4.5-thinking-16k across tasks.
| Task | Attempt ID | Cost | Duration | Status / Error |
|---|---|---|---|---|
| coreutils-old-version-alpine | dpjz1qjardflm | $1.539 | 7m40s | Failure task failed: df missing at /home/peter/result/df or not executable |
| coreutils-old-version-alpine | rvt80a7fv2kc9 | $1.548 | 9m25s | Failure task failed: df missing at /home/peter/result/df or not executable |
| coreutils-old-version-alpine | xe5158hs7os7t | $1.735 | 9m40s | Failure task failed: df missing at /home/peter/result/df or not executable |
| coreutils-old-version | 7o8tyki994695 | $0.406 | 3m52s | Success |
| coreutils-old-version | mghtc374epad0 | $0.379 | 4m17s | Success |
| coreutils-old-version | pngf8zm8zli3w | $0.321 | 3m53s | Success |
| coreutils-static-alpine | 7uxztvb87rn1i | $0.151 | 2m28s | Success |
| coreutils-static-alpine | kxem1jnyg0fh5 | $0.225 | 3m29s | Success |
| coreutils-static-alpine | m004cc1c5rut0 | $0.168 | 2m37s | Success |
| coreutils-static | 139n1l9ykqmay | $0.170 | 2m47s | Success |
| coreutils-static | 2cysws08wyagn | $0.199 | 2m35s | Success |
| coreutils-static | a0fptc4dmrrb0 | $0.199 | 2m48s | Success |
| coreutils | s4uqbdubq5p0n | $0.168 | 2m24s | Success |
| coreutils | sy4n89mgtd7q0 | $0.196 | 3m17s | Success |
| coreutils | zk25bwmdcel73 | $0.130 | 2m0s | Success |
| cowsay | 0zuujyp1i8dw0 | $0.090 | 1m1s | Success |
| cowsay | ktl9xko2jsjsq | $0.069 | 50s | Success |
| cowsay | y68c1g3pyuade | $0.070 | 49s | Success |
| curl-ssl-arm64-static | 9wwpjdtj60ash | $1.410 | 9m0s | Failure task failed: curl HTTPS request to google.com did not return content-type: text/html but instead: } [2 bytes data] * SSL... |
| curl-ssl-arm64-static | a53bk5ve49pov | $1.184 | 7m54s | Failure task failed: curl HTTPS request to google.com did not return content-type: text/html but instead: } [2 bytes data] * SSL... |
| curl-ssl-arm64-static | qpmxht13qu7im | $1.014 | 8m18s | Failure task failed: curl HTTPS request to google.com did not return content-type: text/html but instead: } [2 bytes data] * SSL... |
| curl-ssl-arm64-static2 | 4d5at2gsc419p | $1.513 | 8m35s | Success |
| curl-ssl-arm64-static2 | hjiyd7cnuvr2j | $1.025 | 8m3s | Success |
| curl-ssl-arm64-static2 | nzsj7nnygmfws | $1.197 | 6m54s | Success |
| curl-ssl | 3oury8yrk2713 | $0.355 | 2m40s | Success |
| curl-ssl | mmzamof8y16ox | $0.256 | 2m33s | Success |
| curl-ssl | wn13fmmw4o0jj | $0.246 | 2m40s | Success |
| curl | c4vu7pxfviz4x | $0.115 | 1m24s | Success |
| curl | escystgb99u4j | $0.160 | 1m56s | Success |
| curl | zfjv1m8ipehsr | $0.122 | 1m29s | Success |
| jq-static-musl | 1crio5dqx6gno | $0.457 | 3m10s | Success |
| jq-static-musl | gq80zpkncna4o | $0.476 | 2m56s | Failure task failed: jq binary does not show musl markers |
| jq-static-musl | klltd6vsh357h | $0.302 | 2m8s | Success |
| jq-static | 8jf7r74y1179m | $0.113 | 1m29s | Success |
| jq-static | eivp5k3gqx9dg | $0.167 | 1m27s | Success |
| jq-static | pxyiuomo9xirp | $0.111 | 1m13s | Success |
| jq-windows | 2pkd860lbu62w | $0.187 | 2m16s | Success |
| jq-windows | f3wxq4z29zmz1 | $0.298 | 2m44s | Success |
| jq-windows | l6iv436dh7v3p | $0.234 | 2m25s | Success |
| jq-windows2 | 1tfdq73q1fk8y | $0.475 | 4m57s | Success |
| jq-windows2 | ezo18o6s4i94s | $0.211 | 2m32s | Success |
| jq-windows2 | mq7rv2bmlytwh | $0.522 | 4m39s | Success |
| jq | 7vhu3u6i9qkyi | $0.090 | 59s | Success |
| jq | 97zr8snjnu5zo | $0.139 | 1m10s | Success |
| jq | twbyw2d8mhz0u | $0.104 | 1m9s | Success |