Model
Performance of claude-sonnet-4 across tasks.
| Task | Attempt ID | Cost | Duration | Status / Error |
|---|---|---|---|---|
| coreutils-old-version-alpine | 3rqntd230prug | $1.811 | 6m58s | Failure task failed: sha1sum binary does not exist |
| coreutils-old-version-alpine | b7rxvrz6qhje6 | $1.600 | 7m8s | Failure task failed: df missing at /home/peter/result/df or not executable |
| coreutils-old-version-alpine | klh44gpq8q2vz | $1.478 | 7m1s | Failure task failed: No success reported by script: all-utils-exists.sh |
| coreutils-old-version | 5s01toy181ots | $0.646 | 6m17s | Success |
| coreutils-old-version | 89rw1fujnij0p | $0.793 | 4m32s | Success |
| coreutils-old-version | h7d1bi6l22b7x | $0.386 | 3m26s | Success |
| coreutils-static-alpine | 5ix2jj92xzvso | $0.169 | 1m59s | Success |
| coreutils-static-alpine | dwl0zf27xcptq | $0.219 | 1m53s | Success |
| coreutils-static-alpine | yac8cik20ldt9 | $0.212 | 1m59s | Success |
| coreutils-static | 4um0qrearp9f9 | $0.185 | 2m21s | Success |
| coreutils-static | kj9iicz6uy1ml | $0.182 | 2m10s | Success |
| coreutils-static | sd0y7c4jvrg8o | $0.192 | 2m22s | Success |
| coreutils | 5yetcksbd1rpe | $0.135 | 1m57s | Success |
| coreutils | 731fv5dv8u8xl | $0.153 | 1m55s | Success |
| coreutils | v1kvc3t6y2j41 | $0.163 | 2m3s | Success |
| cowsay | 0xcv93jcagtsg | $0.056 | 45s | Success |
| cowsay | 15mx9azpgb1sf | $0.055 | 43s | Success |
| cowsay | 2kn9xhss5mlu1 | $0.055 | 44s | Success |
| curl-ssl-arm64-static | fgwmemds56tep | $1.001 | 7m15s | Failure task failed: curl HTTPS request to google.com did not return content-type: text/html but instead: } [2 bytes data] * SSL... |
| curl-ssl-arm64-static | je4urq5d5wh8f | $1.255 | 8m6s | Failure task failed: curl-arm64 is not statically linked |
| curl-ssl-arm64-static | twyx5xasedcn3 | $1.451 | 7m58s | Failure task failed: curl-arm64 is not statically linked |
| curl-ssl-arm64-static2 | 8tpew2zaxj1td | $0.906 | 5m49s | Failure task failed: curl HTTPS request to google.com did not return content-type: text/html but instead: } [2 bytes data] * SSL... |
| curl-ssl-arm64-static2 | n0dprnk0w8ybx | $1.444 | 7m44s | Failure task failed: curl did not download the expected local file content, but instead: curl: (1) Protocol "file" not supported |
| curl-ssl-arm64-static2 | x0ik7krceycks | $1.051 | 7m32s | Failure task failed: curl-arm64 is not statically linked |
| curl-ssl | 8px1mqre8990l | $0.268 | 1m57s | Success |
| curl-ssl | aso0mu6qyxp2x | $0.220 | 1m50s | Success |
| curl-ssl | j7m80r0ih9657 | $0.194 | 1m57s | Success |
| curl | 31m180yp96sg4 | $0.207 | 1m37s | Success |
| curl | jzcym615o3bb1 | $0.120 | 1m21s | Success |
| curl | mlaw9i67o9ko8 | $0.211 | 1m26s | Success |
| jq-static-musl | bjx5dy673nj23 | $0.178 | 1m34s | Success |
| jq-static-musl | gnam2lgg704v4 | $0.222 | 1m50s | Success |
| jq-static-musl | x4zo17a6772cu | $0.220 | 1m45s | Success |
| jq-static | 81wy4dkcjjdns | $0.112 | 1m1s | Success |
| jq-static | s7s90r6az8kkl | $0.111 | 1m12s | Success |
| jq-static | v9byxhkupk9nj | $0.108 | 1m2s | Success |
| jq-windows | ie93is5e4q63u | $0.151 | 1m30s | Success |
| jq-windows | tyxzw6d28m2ey | $0.310 | 2m7s | Success |
| jq-windows | yj23ymqtolx5b | $0.281 | 2m14s | Failure task failed: jq help does not contain expected string |
| jq-windows2 | 5idxmdfe0h6b8 | $0.346 | 2m59s | Success |
| jq-windows2 | phpjr0r1gsg3z | $0.384 | 3m53s | Success |
| jq-windows2 | v8rgddc9yt0om | $0.352 | 2m43s | Success |
| jq | 11nkif8m31k3w | $0.141 | 1m2s | Success |
| jq | 1smv7lunemq9c | $0.133 | 57s | Success |
| jq | p16ou4n3u7rbv | $0.167 | 1m28s | Success |