Model
grok-code-fast-1
Performance of grok-code-fast-1 across tasks.
Task ranking
| # | Task | ||||
|---|---|---|---|---|---|
| 1 | jq |
100%
|
8 (1.6x) | 43s (1.9x) | $0.004 (1.0x) |
| 2 | cowsay |
100%
|
9 (1.8x) | 23s (1.0x) | $0.004 (1.1x) |
| 3 | curl-ssl |
100%
|
9 (1.8x) | 1m4s (2.8x) | $0.006 (1.8x) |
| 4 | coreutils |
100%
|
9 (1.8x) | 1m36s (4.2x) | $0.004 (1.2x) |
| 5 | coreutils-static |
100%
|
10 (2.0x) | 1m40s (4.4x) | $0.006 (1.8x) |
| 6 | coreutils-static-alpine |
100%
|
14 (2.8x) | 4m26s (11.7x) | $0.013 (3.7x) |
| 7 | jq-static |
100%
|
19 (3.8x) | 1m51s (4.9x) | $0.013 (3.5x) |
| 8 | jq-static-musl |
67%
|
5 (1.0x) | 1m57s (5.1x) | $0.011 (3.1x) |
| 9 | curl |
67%
|
10 (2.0x) | 1m40s (4.4x) | $0.006 (1.7x) |
| 10 | jq-windows2 |
67%
|
12 (2.4x) | 1m0s (2.6x) | $0.005 (1.3x) |
| 11 | coreutils-old-version |
67%
|
28 (5.6x) | 4m19s (11.4x) | $0.022 (6.2x) |
| 12 | coreutils-old-version-alpine |
0%
|
|||
| 13 | curl-ssl-arm64-static |
0%
|
|||
| 14 | curl-ssl-arm64-static2 |
0%
|
|||
| 15 | jq-windows |
0%
|
Attempts
| Task | Attempt ID | Cost | Duration | Status / Error |
|---|---|---|---|---|
| coreutils |
0us03vpgc9in7
|
$0.004 | 1m35s | Success |
| coreutils |
6lh05jz58mbf5
|
$0.004 | 1m36s | Success |
| coreutils |
h5nur77w8jk47
|
$0.004 | 1m44s | Success |
| coreutils-old-version |
chfj8fel013c8
|
$0.041 | 16m3s | Success |
| coreutils-old-version |
h5x58jegtaw87
|
$0.013 | 2m26s | Failure task failed: install missing at /home/peter/result/install or not executable |
| coreutils-old-version |
kq37r4dvh4r42
|
$0.022 | 4m19s | Success |
| coreutils-old-version-alpine |
9bqaabitdxvk6
|
$0.008 | 1m5s | Failure task failed: sha1sum binary does not exist |
| coreutils-old-version-alpine |
ntv1i1pe675zq
|
$0.021 | 1m15s | Failure task failed: sha1sum binary does not exist |
| coreutils-old-version-alpine |
yr85a0fcqw0zd
|
$0.051 | 3m29s | Failure task failed: sha1sum binary does not exist |
| coreutils-static |
a23uog5dc0en8
|
$0.005 | 1m40s | Success |
| coreutils-static |
g8z14y4lw1jn6
|
$0.009 | 2m13s | Success |
| coreutils-static |
q4kta7ysm6iy1
|
$0.006 | 1m35s | Success |
| coreutils-static-alpine |
cwfpgy4vdsa4s
|
$0.017 | 4m51s | Success |
| coreutils-static-alpine |
efk11pxkgc6v1
|
$0.013 | 4m26s | Success |
| coreutils-static-alpine |
incylckzw6jd3
|
$0.005 | 1m7s | Success |
| cowsay |
410pjek3kwdj9
|
$0.004 | 23s | Success |
| cowsay |
a1lci0c1z23x9
|
$0.006 | 41s | Success |
| cowsay |
rciz7dso3pq9v
|
$0.003 | 19s | Success |
| curl |
0plz63ws5i2r0
|
$0.007 | 1m53s | Success |
| curl |
q6m0dvkupep5t
|
$0.004 | 1m47s | Failure task failed: curl did not download the expected local file content, but instead: curl: (1) Protocol "file" not supported |
| curl |
zliwyxsva0197
|
$0.006 | 1m40s | Success |
| curl-ssl |
3h1oejwhx2pcz
|
$0.006 | 1m2s | Success |
| curl-ssl |
m2gqtujq7yyj5
|
$0.008 | 2m14s | Success |
| curl-ssl |
zcx3kuvb48xn1
|
$0.005 | 1m4s | Success |
| curl-ssl-arm64-static |
3mfnobblxoa2u
|
$0.027 | 5m39s | Failure task failed: curl-arm64 is not statically linked |
| curl-ssl-arm64-static |
dp8zxzq1bn1se
|
$0.017 | 5m26s | Failure task failed: curl-arm64 is not statically linked |
| curl-ssl-arm64-static |
y43c0llo401p0
|
$0.037 | 9m38s | Failure task failed: curl-arm64 is not statically linked |
| curl-ssl-arm64-static2 |
c407pip6g163y
|
$0.046 | 4m6s | Failure task failed: curl binary does not exist |
| curl-ssl-arm64-static2 |
tszkapunxdpc1
|
$0.037 | 13m18s | Failure task failed: curl-arm64 is not statically linked |
| curl-ssl-arm64-static2 |
wl5b2ghozu4pt
|
$0.085 | 14m31s | Failure task failed: curl binary does not exist |
| jq |
bkqs3u14pl910
|
$0.003 | 41s | Success |
| jq |
fgaujw38m8noi
|
$0.004 | 43s | Success |
| jq |
mqy53pxtx868v
|
$0.004 | 48s | Success |
| jq-static |
095n46lsbqt4b
|
$0.017 | 2m12s | Success |
| jq-static |
869ywsry7qsry
|
$0.006 | 1m2s | Success |
| jq-static |
l5laphdpo2ldg
|
$0.013 | 1m51s | Success |
| jq-static-musl |
1tgr8gg7ri7zn
|
$0.026 | 1m57s | Success |
| jq-static-musl |
l5mlut0lt37y7
|
$0.023 | 2m28s | Failure task failed: jq is not statically linked |
| jq-static-musl |
ljrrjxf36j07k
|
$0.011 | 2m25s | Success |
| jq-windows |
8l0l6iejvfuun
|
$0.008 | 1m20s | Failure task failed: jq help does not contain expected string |
| jq-windows |
k2mhp31bg0hj0
|
$0.019 | 1m31s | Failure task failed: jq help does not contain expected string |
| jq-windows |
mhv520mpw4k7e
|
$0.013 | 2m6s | Failure task failed: jq help does not contain expected string |
| jq-windows2 |
0nhakz9z05wsz
|
$0.024 | 3m19s | Failure task failed: jq help does not contain expected string |
| jq-windows2 |
ohsb510x2a9j8
|
$0.016 | 22m44s | Success |
| jq-windows2 |
owx78q1z96qmw
|
$0.005 | 1m0s | Success |