Model
Performance of gpt-4.1 across tasks.
| Task | Attempt ID | Cost | Duration | Status / Error |
|---|---|---|---|---|
| coreutils-old-version-alpine | avu5b7qwr9i8b | $2.821 | 4m45s | Failure task failed: sha1sum binary does not exist |
| coreutils-old-version-alpine | bh4rfhg0kgnrd | $1.576 | 3m15s | Failure task failed: df missing at /home/peter/result/df or not executable |
| coreutils-old-version-alpine | onifl1ovzzryu | $0.659 | 2m22s | Failure task failed: sha1sum binary does not exist |
| coreutils-old-version | 335ro2eow4mpt | $0.333 | 2m31s | Failure task failed: install missing at /home/peter/result/install or not executable |
| coreutils-old-version | fkq26et7a9e1q | $1.244 | 4m39s | Failure task failed: sha1sum binary does not exist |
| coreutils-old-version | k8w4b7mlwvosf | $1.243 | 5m4s | Failure task failed: groups missing at /home/peter/result/groups or not executable |
| coreutils-static-alpine | 7hmaishv71n24 | $0.037 | 54s | Success |
| coreutils-static-alpine | u0vlvwt4jij3k | $0.028 | 56s | Failure task failed: kill missing at /home/peter/result/kill or not executable |
| coreutils-static-alpine | x2d4ka9mzebb0 | $0.052 | 1m9s | Success |
| coreutils-static | 8clcq0b9nvnp0 | $0.059 | 1m17s | Success |
| coreutils-static | 8yecdnfh30zng | $0.070 | 1m19s | Success |
| coreutils-static | my44jxbuog2ej | $0.050 | 2m6s | Success |
| coreutils | 8m33hbo8fhu4v | $0.055 | 1m5s | Success |
| coreutils | j5v8pmha07eo7 | $0.051 | 1m11s | Success |
| coreutils | s45jh9t5t8cb8 | $0.036 | 1m6s | Success |
| cowsay | 3id32xr9cey1p | $0.015 | 13s | Success |
| cowsay | abr84yraeyire | $0.016 | 12s | Success |
| cowsay | wy3uorgdtg3tq | $0.020 | 16s | Success |
| curl-ssl-arm64-static | 3epted7u83lap | $0.149 | 1m13s | Failure task failed: curl binary does not exist |
| curl-ssl-arm64-static | i6t0fmxnqc8ux | $0.066 | 54s | Failure task failed: curl binary does not exist |
| curl-ssl-arm64-static | nlakvfwsmp3ay | $0.074 | 58s | Failure task failed: curl binary does not exist |
| curl-ssl-arm64-static2 | 23c79erjmirn6 | $0.252 | 1m33s | Failure task failed: curl binary does not exist |
| curl-ssl-arm64-static2 | 331320zw96chp | $0.037 | 43s | Failure task failed: curl binary does not exist |
| curl-ssl-arm64-static2 | j9tb1imlbyga2 | $0.122 | 1m10s | Failure task failed: curl binary does not exist |
| curl-ssl | 5z512ef4z27in | $0.075 | 56s | Success |
| curl-ssl | bydbl3asyas9v | $0.112 | 1m10s | Success |
| curl-ssl | er52z0ij5xato | $0.064 | 56s | Success |
| curl | 3xns9ceaom0ul | $0.037 | 30s | Success |
| curl | bwxa5zt72aypx | $0.030 | 29s | Success |
| curl | x8ypw6yyfrflf | $0.034 | 33s | Success |
| jq-static-musl | 5ry2340t8ffq5 | $0.293 | 3m24s | Failure task failed: jq is not statically linked |
| jq-static-musl | ax7v12bvnwj41 | $0.430 | 2m36s | Failure task failed: jq is not statically linked |
| jq-static-musl | f2u7e17o8cqfn | $0.146 | 59s | Failure task failed: jq is not statically linked |
| jq-static | ijmgo8084eqsz | $0.342 | 1m56s | Success |
| jq-static | pehmk0x7tno7t | $0.316 | 2m20s | Failure task failed: jq is not statically linked |
| jq-static | y786h6m3pptu9 | $0.102 | 1m21s | Success |
| jq-windows | dyzgubb5rdzk3 | $0.103 | 1m5s | Failure task failed: jq help does not contain expected string |
| jq-windows | hrxpw50se31vi | $0.082 | 54s | Failure task failed: jq help does not contain expected string |
| jq-windows | wdtj2fr8uf0t5 | $0.051 | 54s | Failure task failed: jq help does not contain expected string |
| jq-windows2 | 7d03rg0kg9tpw | $0.068 | 1m27s | Success |
| jq-windows2 | apjvc6zkvpgxk | $0.175 | 2m23s | Failure task failed: jq help does not contain expected string |
| jq-windows2 | gcwh0k2nic3t1 | $0.094 | 1m18s | Success |
| jq | qt6cp6j4m8oyp | $0.028 | 22s | Success |
| jq | vjoaixidissnv | $0.030 | 27s | Success |
| jq | x7pjvpldnf7b1 | $0.033 | 24s | Success |