Model
Performance of gemini-2.5-flash across tasks.
| Task | Attempt ID | Cost | Duration | Status / Error |
|---|---|---|---|---|
| coreutils-old-version-alpine | 6aqhoaxklcwsp | $0.151 | 4m11s | Failure task failed: sha1sum binary does not exist |
| coreutils-old-version-alpine | icppoonmwph4h | $0.109 | 3m30s | Failure task failed: sha1sum binary does not exist |
| coreutils-old-version-alpine | t1dwq7bannu76 | $0.030 | 1m42s | Failure task failed: sha1sum binary does not exist |
| coreutils-old-version | 22kvbqe7s9e7a | $0.235 | 14m30s | Failure exceeded max tool calls (90) |
| coreutils-old-version | 52njs5c5fvgg0 | $0.036 | 4m40s | Failure task failed: chroot missing at /home/peter/result/chroot or not executable |
| coreutils-old-version | un0m2bqbkbovf | $0.260 | 13m34s | Failure task failed: sha1sum binary does not exist |
| coreutils-static-alpine | 2l89o13kpizbx | $0.015 | 2m46s | Success |
| coreutils-static-alpine | b1gb6tr8rufu1 | $0.016 | 2m41s | Success |
| coreutils-static-alpine | z4aj770xugw7i | $0.024 | 1m49s | Success |
| coreutils-static | 59gza3etqz54m | $0.028 | 4m38s | Success |
| coreutils-static | mdp47e2isfz6l | $0.009 | 1m42s | Success |
| coreutils-static | r3gc5tvqwi47d | $0.005 | 1m39s | Failure task failed: sha1sum binary does not exist |
| coreutils | 72mffpubnnu4n | $0.007 | 1m25s | Success |
| coreutils | cizcdb805itzg | $0.017 | 1m37s | Failure task failed: sha1sum binary does not exist |
| coreutils | l5900rmi59rl4 | $0.007 | 1m27s | Success |
| cowsay | 50cmjvmon2ep0 | $0.005 | 11s | Failure task failed: Cowsay does not contain expected string (eyes) |
| cowsay | row7obzz4gfgq | $0.007 | 17s | Success |
| cowsay | v24mbpfq4luoe | $0.003 | 9s | Success |
| curl-ssl-arm64-static | 7i72w0wyyd55a | $0.003 | 14s | Failure task failed: curl binary does not exist |
| curl-ssl-arm64-static | 9aghv6jluw6qu | $0.119 | 1m51s | Failure task failed: curl binary does not exist |
| curl-ssl-arm64-static | gxqiqts623v70 | $0.012 | 1m16s | Failure task failed: curl-arm64 is not aarch64 architecture |
| curl-ssl-arm64-static2 | 0zyb1j65mwyw8 | $0.060 | 1m30s | Failure task failed: curl binary does not exist |
| curl-ssl-arm64-static2 | qjc3xwwj9kd6n | $0.217 | 5m0s | Failure task failed: curl-arm64 is not aarch64 architecture |
| curl-ssl-arm64-static2 | xn6520d9u9w96 | $0.119 | 4m25s | Failure task failed: curl binary does not exist |
| curl-ssl | 32vic9v2las0v | $0.010 | 1m49s | Success |
| curl-ssl | g2gis7dqdjj34 | $0.015 | 42s | Success |
| curl-ssl | voohjs8mprlic | $0.013 | 1m48s | Success |
| curl | 27bz01qbbllnb | $0.004 | 29s | Success |
| curl | jelgpn94ryjy7 | $0.010 | 32s | Failure task failed: curl did not download the expected local file content, but instead: curl: (1) Protocol "file" not supported |
| curl | l0al12nsj8980 | $0.023 | 48s | Success |
| jq-static-musl | 4vo0qowourp2x | $0.267 | 4m3s | Failure task failed: jq binary does not exist |
| jq-static-musl | wuvsgpxterenf | $0.035 | 1m13s | Success |
| jq-static-musl | xgtgg0l4eqhdd | $0.238 | 2m56s | Failure task failed: jq binary does not exist |
| jq-static | cmxoomrojfo4f | $0.011 | 48s | Success |
| jq-static | lkuczmr40mj4b | $0.009 | 38s | Success |
| jq-static | yo639sx8hut4h | $0.003 | 21s | Failure task failed: jq is not statically linked |
| jq-windows | 73915yy8omgpv | $0.006 | 37s | Failure task failed: jq help does not contain expected string |
| jq-windows | 8esapvv1f77uf | $0.007 | 26s | Failure task failed: jq.exe binary does not exist |
| jq-windows | xdmf0z7301opk | $0.013 | 53s | Failure task failed: jq.exe binary does not exist |
| jq-windows2 | 9mkvm7dl9sgdq | $0.014 | 1m18s | Failure task failed: jq.exe binary does not exist |
| jq-windows2 | dbjy65z68wg2w | $0.063 | 3m17s | Failure task failed: jq help does not contain expected string |
| jq-windows2 | kqylyry031dti | $0.018 | 1m59s | Failure task failed: jq.exe binary does not exist |
| jq | cp0eay12p46t7 | $0.007 | 35s | Success |
| jq | ipmliug5yiifz | $0.000 | 0.7s | Failure task failed: jq binary does not exist |
| jq | q7614ipz7drgv | $0.009 | 28s | Failure task failed: jq binary does not exist |