Task
coreutils-old-version
GNU coreutils 5.0 (from 2003) is a collection of Linux utilities like ls, cp, mv, etc.
Project link: gnu.org/software/coreutils
Task:
Compile and install all coreutils utilities to a specific location.
Difficulties:
The source is very old (2003) and requires heavy patching.
Environment:
Ubuntu 22.04 on amd64, without internet access.
Best attempt
| Model |  gpt-5-mini-minimal |
| Attempt | ov75uekkycz7t |
| # of commands | 5 |
| Total time | 3m7s |
| Cost | $0.007 |
| Model | Attempt ID | Cost | Duration | Status / Error |
|---|---|---|---|---|
 claude-haiku-4.5-thinking-16k | 4rmho9lg72n8s | $0.091 | 2m55s | Success |
| claude-haiku-4.5-thinking-16k | nv92ivhbb8om1 | $0.109 | 2m49s | Success |
| claude-haiku-4.5-thinking-16k | tudzrqbnh57aa | $0.131 | 3m3s | Success |
| claude-haiku-4.5 | 875ltlcton824 | $0.176 | 3m35s | Success |
| claude-haiku-4.5 | c5e7d7uu3guaa | $0.123 | 2m51s | Success |
| claude-haiku-4.5 | ct080jcwxu7nd | $0.141 | 4m43s | Success |
| claude-opus-4.1-thinking-16k | 4zgknwl6ebr1d | $2.583 | 19m3s | Success |
| claude-opus-4.1-thinking-16k | l4sqq9kgy7m3k | $0.900 | 3m50s | Success |
| claude-opus-4.1-thinking-16k | y4igco0imbqau | $1.494 | 5m23s | Success |
| claude-sonnet-4-thinking-16k | htqn1ylnw2hnt | $0.592 | 7m45s | Success |
| claude-sonnet-4-thinking-16k | nlktx2ewr2ezf | $0.394 | 4m38s | Success |
| claude-sonnet-4-thinking-16k | w5gv8vqknq8ix | $0.408 | 4m36s | Success |
| claude-sonnet-4 | 5s01toy181ots | $0.646 | 6m17s | Success |
| claude-sonnet-4 | 89rw1fujnij0p | $0.793 | 4m32s | Success |
| claude-sonnet-4 | h7d1bi6l22b7x | $0.386 | 3m26s | Success |
| claude-sonnet-4.5-thinking-16k | 7o8tyki994695 | $0.406 | 3m52s | Success |
| claude-sonnet-4.5-thinking-16k | mghtc374epad0 | $0.379 | 4m17s | Success |
| claude-sonnet-4.5-thinking-16k | pngf8zm8zli3w | $0.321 | 3m53s | Success |
| claude-sonnet-4.5 | gc06c3aibqvg0 | $0.499 | 4m48s | Success |
| claude-sonnet-4.5 | ifl1v0lpnshh1 | $0.521 | 3m18s | Success |
| claude-sonnet-4.5 | m45lrir1yolhg | $0.653 | 4m16s | Success |
 deepseek-v3.1-terminus | 0jizc9vaajx8x | $0.105 | 4m47s | Success |
| deepseek-v3.1-terminus | 1qhc4ph49xvev | $0.148 | 4m42s | Success |
| deepseek-v3.1-terminus | h7ozgpm05ntu0 | $0.158 | 5m2s | Failure task failed: df missing at /home/peter/result/df or not executable |
| deepseek-v3.1 | 281l9svxi2cd5 | $0.355 | 3m10s | Success |
| deepseek-v3.1 | igek8l605gxyb | $0.527 | 3m20s | Success |
| deepseek-v3.1 | zvvds288xdcm1 | $0.369 | 3m11s | Failure task failed: install missing at /home/peter/result/install or not executable |
 gemini-2.5-flash-thinking | 02ofxvn1wnw8g | $0.034 | 2m24s | Failure task failed: df missing at /home/peter/result/df or not executable |
| gemini-2.5-flash-thinking | asuvr8gm3mxk1 | $0.132 | 19m5s | Failure context timeout: context deadline exceeded |
| gemini-2.5-flash-thinking | w2c8hsvl88jiw | $0.089 | 19m15s | Failure context timeout: context deadline exceeded |
| gemini-2.5-flash | 22kvbqe7s9e7a | $0.235 | 14m30s | Failure exceeded max tool calls (90) |
| gemini-2.5-flash | 52njs5c5fvgg0 | $0.036 | 4m40s | Failure task failed: chroot missing at /home/peter/result/chroot or not executable |
| gemini-2.5-flash | un0m2bqbkbovf | $0.260 | 13m34s | Failure task failed: sha1sum binary does not exist |
| gemini-2.5-pro | 6zq8inevfx8ds | $0.777 | 9m29s | Failure exceeded max tool calls (90) |
| gemini-2.5-pro | 8jfa9wn9zcqdd | $0.094 | 2m27s | Failure task failed: chroot missing at /home/peter/result/chroot or not executable |
| gemini-2.5-pro | rmo65epaw2rw6 | $0.218 | 4m55s | Failure task failed: chroot missing at /home/peter/result/chroot or not executable |
 glm-4.5 | 5sf13h26pxlzn | $0.073 | 2m17s | Failure task failed: sha1sum binary does not exist |
| glm-4.5 | 86275dcc9re9k | $0.566 | 6m43s | Success |
| glm-4.5 | s74lri9vfhhc1 | $0.035 | 1m54s | Failure task failed: sha1sum binary does not exist |
| gpt-4.1-mini | 0czs7cd61cgiv | $0.428 | 4m24s | Failure exceeded max tool calls (90) |
| gpt-4.1-mini | pk3sw083z1mhf | $0.045 | 15m0s | Success |
| gpt-4.1-mini | r0va6gg2yz6cw | $0.289 | 4m6s | Failure exceeded max tool calls (90) |
| gpt-4.1 | 335ro2eow4mpt | $0.333 | 2m31s | Failure task failed: install missing at /home/peter/result/install or not executable |
| gpt-4.1 | fkq26et7a9e1q | $1.244 | 4m39s | Failure task failed: sha1sum binary does not exist |
| gpt-4.1 | k8w4b7mlwvosf | $1.243 | 5m4s | Failure task failed: groups missing at /home/peter/result/groups or not executable |
| gpt-5-codex-high | 3ekrd46s9d867 | $0.275 | 6m50s | Success |
| gpt-5-codex-high | ab4iuxfkr6i85 | $0.295 | 5m7s | Success |
| gpt-5-codex-high | s2p70fvq14ldn | $0.162 | 3m50s | Success |
| gpt-5-high | lpwkqycgej1dy | $0.177 | 6m49s | Success |
| gpt-5-high | voe8esm42oiot | $0.228 | 5m39s | Success |
| gpt-5-high | ybnt1nyjz0lra | $0.291 | 8m32s | Success |
| gpt-5-mini-high | 6b3e0y879rrv6 | $0.069 | 7m24s | Success |
| gpt-5-mini-high | hbo2sd0aay6v6 | $0.038 | 6m1s | Success |
| gpt-5-mini-high | lwlyu0ig87c7w | $0.047 | 7m40s | Success |
| gpt-5-mini-minimal | d9t1djg24wnaq | $0.016 | 4m1s | Failure task failed: sha1sum binary does not exist |
| gpt-5-mini-minimal | ov75uekkycz7t | $0.007 | 3m7s | Success |
| gpt-5-mini-minimal | xa3nkglfqxzsi | $0.007 | 3m19s | Failure task failed: sha1sum binary does not exist |
| gpt-5-minimal | o2o7i6nrwj916 | $0.050 | 2m12s | Success |
| gpt-5-minimal | sfasrxttuoiod | $0.085 | 2m30s | Success |
| gpt-5-minimal | sqjv5c8wq9w2c | $0.085 | 2m34s | Success |
| gpt-oss-120b-high | 3g1a0t58qzydc | $0.007 | 1m36s | Failure task failed: sha1sum binary does not exist |
| gpt-oss-120b-high | 8l6slgfyu8u6j | $0.000 | 2s | Failure task failed: sha1sum binary does not exist |
| gpt-oss-120b-high | tax4k529iosv8 | $0.114 | 4m5s | Failure task failed: sha1sum binary does not exist |
 grok-4-fast | p2sx3gryx4g45 | $0.021 | 7m7s | Failure task failed: sha1sum binary does not exist |
| grok-4-fast | q2bq72myqpt3d | $0.138 | 14m59s | Success |
| grok-4-fast | v8x0g3tsjjxs8 | $0.040 | 7m15s | Success |
| grok-4 | 5p3vlguat3wv5 | $0.203 | 4m46s | Success |
| grok-4 | f42wz7er54s06 | $0.243 | 7m26s | Success |
| grok-4 | ywe12bzjsdojn | $0.298 | 5m47s | Success |
| grok-code-fast-1 | chfj8fel013c8 | $0.041 | 16m2s | Success |
| grok-code-fast-1 | h5x58jegtaw87 | $0.013 | 2m26s | Failure task failed: install missing at /home/peter/result/install or not executable |
| grok-code-fast-1 | kq37r4dvh4r42 | $0.022 | 4m18s | Success |
 kimi-k2-0905 | s0ua7nnulbi9r | $1.358 | 4m25s | Success |
| kimi-k2-0905 | t9k6qymlrf1tz | $0.757 | 4m47s | Failure task failed: chroot missing at /home/peter/result/chroot or not executable |
| kimi-k2-0905 | u1bt6at9900sh | $0.334 | 3m19s | Success |
 qwen3-max | mxv11g9o5jx2j | $3.012 | 6m37s | Failure exceeded max cost dollars (max=$3.00, current=3.01) |
| qwen3-max | zrk9vom0swqf2 | $0.780 | 4m41s | Success |
| qwen3-max | qv7n0li11olhe | $0.059 | 1m49s | Success |