Model
Performance of claude-haiku-4.5-thinking-16k across tasks.
| Task | Attempt ID | Cost | Duration | Status / Error |
|---|---|---|---|---|
| coreutils-old-version-alpine | 30s76o86jgg0c | $0.922 | 26m39s | Success |
| coreutils-old-version-alpine | 6wfvl6yb0ca62 | $1.339 | 17m0s | Failure task failed: df missing at /home/peter/result/df or not executable |
| coreutils-old-version-alpine | uohagjpktizqe | $0.951 | 9m35s | Failure task failed: sha1sum binary does not exist |
| coreutils-old-version | 4rmho9lg72n8s | $0.091 | 2m55s | Success |
| coreutils-old-version | nv92ivhbb8om1 | $0.109 | 2m49s | Success |
| coreutils-old-version | tudzrqbnh57aa | $0.131 | 3m3s | Success |
| coreutils-static-alpine | 3c7efg0nnqnq7 | $0.052 | 1m42s | Success |
| coreutils-static-alpine | 5exulvdy22ruh | $0.092 | 2m2s | Success |
| coreutils-static-alpine | 6qzxtmaylko06 | $0.075 | 2m2s | Success |
| coreutils-static | fdtblposudbt7 | $0.064 | 2m29s | Success |
| coreutils-static | wqf0lr9qgy5mw | $0.055 | 1m51s | Success |
| coreutils-static | xjmhi269xl5wl | $0.074 | 2m16s | Success |
| coreutils | f2j727iz2qq2t | $0.034 | 1m23s | Success |
| coreutils | hiprlnn1zdtkq | $0.051 | 1m25s | Success |
| coreutils | wa7clq5s31m40 | $0.050 | 1m34s | Success |
| cowsay | a4fqsahlq8dzs | $0.032 | 28s | Success |
| cowsay | ehpsamlb8l0ix | $0.031 | 26s | Success |
| cowsay | ldcb6no3c2mjn | $0.030 | 20s | Success |
| curl-ssl-arm64-static | 59xhowcrn8vwh | $0.719 | 11m2s | Failure task failed: curl-arm64 is not statically linked |
| curl-ssl-arm64-static | a9kptw27jrnbp | $0.401 | 9m8s | Failure task failed: curl-arm64 is not statically linked |
| curl-ssl-arm64-static | rzyyo0f7yge5s | $0.513 | 7m58s | Failure task failed: curl HTTPS request to google.com did not return content-type: text/html but instead: } [2 bytes data] * SSL... |
| curl-ssl-arm64-static2 | cj2411q9z3siv | $0.484 | 10m1s | Failure task failed: curl-arm64 is not statically linked |
| curl-ssl-arm64-static2 | gj9opj26zxynh | $0.302 | 8m25s | Failure task failed: curl-arm64 is not statically linked |
| curl-ssl-arm64-static2 | l8ly0ejtqkvfp | $0.219 | 5m51s | Failure task failed: curl HTTPS request to google.com did not return content-type: text/html but instead: } [2 bytes data] * SSL... |
| curl-ssl | 03pilj1jrmrjp | $0.060 | 1m31s | Success |
| curl-ssl | 3105alhm2bhv2 | $0.061 | 2m35s | Success |
| curl-ssl | r2o46ctql7bdi | $0.063 | 1m26s | Success |
| curl | 1qsui3x279i3r | $0.036 | 1m1s | Success |
| curl | 7ey9973egyd0c | $0.036 | 56s | Failure task failed: curl did not download the expected local file content, but instead: curl: (1) Protocol "file" not supported |
| curl | nsf1kd5ndtj9f | $0.051 | 1m10s | Success |
| jq-static-musl | 3tjo10n03ldws | $0.179 | 2m31s | Success |
| jq-static-musl | 9wxthyuymtfgt | $0.071 | 1m15s | Success |
| jq-static-musl | u6deasjr7vu27 | $0.178 | 3m24s | Success |
| jq-static | 6x75jl2ub2unh | $0.074 | 1m21s | Success |
| jq-static | r6vne01tc0o3w | $0.041 | 49s | Success |
| jq-static | vqagapdecu80b | $0.199 | 2m39s | Success |
| jq-windows | 397rujor8tkrv | $0.192 | 3m35s | Failure task failed: jq help does not contain expected string |
| jq-windows | i7hwsd8pywbqu | $0.327 | 4m51s | Success |
| jq-windows | qso1iei2topu3 | $0.158 | 3m8s | Success |
| jq-windows2 | 672kx590cvl8a | $0.098 | 2m39s | Failure task failed: jq.exe binary does not exist |
| jq-windows2 | ec7jku8xdm643 | $0.239 | 6m27s | Failure task failed: jq help does not contain expected string |
| jq-windows2 | k2yiswhf5cjhy | $0.068 | 1m43s | Success |
| jq | 5um95mbdwn1ds | $0.031 | 49s | Success |
| jq | 9jnrac6kfpf3k | $0.028 | 46s | Success |
| jq | yh7ivvil9qw4i | $0.029 | 33s | Success |