Model
Performance of gemini-2.5-pro across tasks.
| Task | Attempt ID | Cost | Duration | Status / Error |
|---|---|---|---|---|
| coreutils-old-version-alpine | 73yuzozgu39e8 | $1.376 | 7m10s | Failure task failed: sha1sum binary does not exist |
| coreutils-old-version-alpine | axxfa9gtps3e8 | $2.703 | 8m14s | Failure task failed: sha1sum binary does not exist |
| coreutils-old-version-alpine | nbgpyvzf5sn1j | $0.186 | 1m41s | Failure task failed: sha1sum binary does not exist |
| coreutils-old-version | 6zq8inevfx8ds | $0.777 | 9m29s | Failure exceeded max tool calls (90) |
| coreutils-old-version | 8jfa9wn9zcqdd | $0.094 | 2m27s | Failure task failed: chroot missing at /home/peter/result/chroot or not executable |
| coreutils-old-version | rmo65epaw2rw6 | $0.218 | 4m55s | Failure task failed: chroot missing at /home/peter/result/chroot or not executable |
| coreutils-static-alpine | 8b3txg4az3fim | $0.044 | 2m0s | Success |
| coreutils-static-alpine | jn27ogdi6pu8a | $0.056 | 2m2s | Success |
| coreutils-static-alpine | mj9b3nav57hki | $0.042 | 2m4s | Success |
| coreutils-static | i66fll9y9zbx8 | $0.074 | 2m19s | Success |
| coreutils-static | jm302v4jei7xk | $0.069 | 2m18s | Success |
| coreutils-static | p5b244pg4blu1 | $0.120 | 3m2s | Success |
| coreutils | mavjj3haoinsc | $0.055 | 1m47s | Success |
| coreutils | n2xiawao4lzf7 | $0.042 | 1m48s | Success |
| coreutils | nkt2id5mi09oq | $0.049 | 1m53s | Success |
| cowsay | 8q5s1d9mgqfly | $0.024 | 29s | Success |
| cowsay | cmd5z7hrez88x | $0.018 | 24s | Success |
| cowsay | uopqf502obo0v | $0.031 | 27s | Success |
| curl-ssl-arm64-static | mb9dxrlj518y3 | $0.698 | 7m26s | Failure task failed: curl binary does not exist |
| curl-ssl-arm64-static | ngq5n3da8rhb1 | $0.332 | 4m52s | Failure task failed: curl-arm64 is not statically linked |
| curl-ssl-arm64-static | vgiv49rfhm8ww | $0.314 | 3m27s | Failure task failed: curl-arm64 is not statically linked |
| curl-ssl-arm64-static2 | gcb5jutrbg7a2 | $0.427 | 5m22s | Failure task failed: curl binary does not exist |
| curl-ssl-arm64-static2 | nvzu1oyk5zuem | $0.625 | 6m31s | Failure task failed: curl binary does not exist |
| curl-ssl-arm64-static2 | reodc0zqt7bmh | $0.276 | 3m27s | Failure task failed: curl binary does not exist |
| curl-ssl | 321oro8n33dlo | $0.101 | 2m46s | Success |
| curl-ssl | 3w5j1w5ge3rre | $0.125 | 3m2s | Success |
| curl-ssl | cxwdxu4prhl2v | $0.097 | 2m37s | Success |
| curl | 3e4jro69dm5ox | $0.055 | 2m6s | Success |
| curl | b3x2q9982j05r | $0.057 | 2m9s | Success |
| curl | dbyhg0dlp3joc | $0.279 | 4m27s | Success |
| jq-static-musl | efw1rw1pzilv4 | $0.191 | 2m26s | Failure task failed: jq binary does not exist |
| jq-static-musl | jn63ltdcm43n2 | $0.087 | 1m21s | Failure task failed: jq is not statically linked |
| jq-static-musl | nle29iwjqf9p9 | $0.350 | 3m36s | Failure task failed: jq is not statically linked |
| jq-static | fauc81mw28665 | $0.319 | 3m27s | Failure task failed: jq is not statically linked |
| jq-static | tswzaxnbm2j0o | $0.157 | 2m5s | Failure task failed: jq is not statically linked |
| jq-static | zha8tubwz0tfn | $0.147 | 2m17s | Failure task failed: jq is not statically linked |
| jq-windows | hb4es9008gd3h | $0.056 | 50s | Success |
| jq-windows | jc35jfibzsjlp | $0.052 | 1m7s | Failure task failed: jq help does not contain expected string |
| jq-windows | tdoiqqd9tnvg7 | $0.037 | 52s | Failure task failed: jq.exe binary does not exist |
| jq-windows2 | 4jvvi54a2wo0g | $0.113 | 2m54s | Success |
| jq-windows2 | 7pizx91bf9e9t | $0.142 | 2m10s | Success |
| jq-windows2 | iov46x3g3v1vr | $0.140 | 2m49s | Failure task failed: jq help does not contain expected string |
| jq | 8knzqzdpnatex | $0.059 | 56s | Success |
| jq | cy85xpo9lr05z | $0.028 | 48s | Success |
| jq | ktb4un614oe96 | $0.060 | 1m3s | Success |