Model
Performance of claude-sonnet-4-thinking-16k across tasks.
| Task | Attempt ID | Cost | Duration | Status / Error |
|---|---|---|---|---|
| coreutils-old-version-alpine | 2np714vmpuui1 | $3.417 | 14m17s | Success |
| coreutils-old-version-alpine | bs08n362cba73 | $1.547 | 8m7s | Success |
| coreutils-old-version-alpine | oo8mzagzoleya | $1.869 | 8m36s | Success |
| coreutils-old-version | htqn1ylnw2hnt | $0.592 | 7m45s | Success |
| coreutils-old-version | nlktx2ewr2ezf | $0.394 | 4m38s | Success |
| coreutils-old-version | w5gv8vqknq8ix | $0.408 | 4m36s | Success |
| coreutils-static-alpine | 22jwht0d2ipal | $0.146 | 2m17s | Success |
| coreutils-static-alpine | hc1lomwrt4zzu | $0.164 | 2m26s | Success |
| coreutils-static-alpine | my5fotorj8aq1 | $0.175 | 2m31s | Success |
| coreutils-static | 0r24wkdxg86jb | $0.161 | 2m39s | Success |
| coreutils-static | mrzt7ua84k80m | $0.166 | 2m20s | Success |
| coreutils-static | plfws0uish2vi | $0.152 | 2m38s | Success |
| coreutils | 68zatcuqtx2wy | $0.142 | 2m7s | Success |
| coreutils | slpk3bbep7scl | $0.149 | 2m28s | Success |
| coreutils | ykldbm7wfb1e0 | $0.152 | 2m11s | Success |
| cowsay | 0dk6j3q3ilrma | $0.080 | 1m4s | Success |
| cowsay | bcfk66n0rhz6z | $0.092 | 1m17s | Success |
| cowsay | pcm09yk5px3am | $0.083 | 1m4s | Success |
| curl-ssl-arm64-static | 3ur3m0b72b57f | $1.216 | 8m26s | Failure task failed: curl HTTPS request to google.com did not return content-type: text/html but instead: } [2 bytes data] * SSL... |
| curl-ssl-arm64-static | aofjd3ed1ws53 | $0.937 | 8m49s | Failure task failed: curl HTTPS request to google.com did not return content-type: text/html but instead: } [2 bytes data] * SSL... |
| curl-ssl-arm64-static | sf7dhu3u6v9lo | $1.074 | 8m6s | Failure task failed: curl HTTPS request to google.com did not return content-type: text/html but instead: } [2 bytes data] * SSL... |
| curl-ssl-arm64-static2 | 55r7ssuptc9su | $1.602 | 9m41s | Success |
| curl-ssl-arm64-static2 | sas5yp3b4pc5w | $1.400 | 10m41s | Failure task failed: curl HTTPS request to google.com did not return content-type: text/html but instead: } [2 bytes data] * SSL... |
| curl-ssl-arm64-static2 | txt1gpq0kcbpd | $1.173 | 7m30s | Success |
| curl-ssl | bwhyja41s6v7o | $0.210 | 2m32s | Success |
| curl-ssl | ptevq3c2szlc0 | $0.240 | 2m51s | Success |
| curl-ssl | tdsp4oubtu0rm | $0.204 | 2m23s | Success |
| curl | 3u30iilci3bu2 | $0.129 | 1m36s | Success |
| curl | b8j5yhsiyefwy | $0.126 | 1m40s | Success |
| curl | mhjy1qvhvzpzd | $0.157 | 1m25s | Success |
| jq-static-musl | 1lqob8o8fgs5g | $0.299 | 2m45s | Success |
| jq-static-musl | 2i1mu18nmdu6k | $0.219 | 2m23s | Success |
| jq-static-musl | sofnn6hrtycfj | $0.450 | 3m14s | Success |
| jq-static | 0embt2r2suriq | $0.115 | 1m24s | Success |
| jq-static | 9gop4ctkw4oim | $0.135 | 1m22s | Success |
| jq-static | ez49t1dz7a3bf | $0.117 | 1m27s | Success |
| jq-windows | 02yg8eybegzct | $0.210 | 2m23s | Success |
| jq-windows | c1vjkhc3qbr46 | $0.181 | 2m18s | Success |
| jq-windows | d6qedwsxw9d4x | $0.194 | 2m29s | Success |
| jq-windows2 | 3iuxcwx93mhwu | $0.686 | 4m21s | Success |
| jq-windows2 | 3phfdclv9w074 | $0.719 | 6m32s | Success |
| jq-windows2 | h3qknoqo08hft | $0.454 | 4m0s | Success |
| jq | 0by7mbfywtdqx | $0.121 | 1m22s | Success |
| jq | 21bccfjeuzxi5 | $0.105 | 1m15s | Success |
| jq | 24iva3wt52cyr | $0.103 | 1m8s | Success |