Task
curl-ssl

curl 8.16.0 is a command-line HTTP client. Project link: curl.se

Task: Compile and install curl to a specific location. Build with SSL support (TLS v1.3), brotli, zlib and zstd.

Difficulties: Installing dependencies can be tricky.

Environment: Ubuntu 22.04 on amd64, with internet access.

Best attempt
Model gpt-5-minimal logo gpt-5-minimal
Attempt wm3uscqd9ieeu
# of commands 2
Total time 1m6s
Cost $0.014
Terminal transcript >
compile-bench> set -e; export DEBIAN_FRONTEND=noninteractive; sudo apt-get update -y; sudo apt-get install -y build-essential pkg-config autoconf automake libtool cmake ninja-build meson perl python3 libssl-dev zlib1g-dev libbrotli-dev libzstd-dev ca-certificates; rm -rf /home/peter/build; mkdir -p /home/peter/build /home/peter/result/bin; cd /home/peter/build; tar xf /home/peter/curl.tar.gz; cd curl-*; if [ -f configure ]; then echo using autotools; else echo generating configure; autoreconf -fi; fi; ./configure --prefix=/home/peter/result --with-ssl --with-zlib --with-brotli --with-zstd --enable-tls-srp --enable-alt-svc; make -j"$(nproc)"; make install; ln -sf /home/peter/result/bin/curl /home/peter/result/curl; /home/peter/result/bin/curl -V
checking whether to use OpenSSL's built-in CA store... no
checking CA cert bundle path to embed in the curl tool... no
checking for pkg-config... (cached) /usr/bin/pkg-config
checking for libpsl options with pkg-config... no
checking for psl_builtin in -lpsl... no
configure: error: libpsl libs and/or directories were not found where specified!
compile-bench> set -e; export DEBIAN_FRONTEND=noninteractive; sudo apt-get install -y libpsl-dev; cd /home/peter/build/curl-*; make distclean || true; ./configure --prefix=/home/peter/result --with-ssl --with-zlib --with-brotli --with-zstd --enable-tls-srp --enable-alt-svc; make -j"$(nproc)"; make install; ln -sf /home/peter/result/bin/curl /home/peter/result/curl; /home/peter/result/bin/curl -V
make[2]: Leaving directory '/home/peter/build/curl-8.16.0'
make[1]: Leaving directory '/home/peter/build/curl-8.16.0'
curl 8.16.0 (x86_64-pc-linux-gnu) libcurl/8.16.0 OpenSSL/3.0.2 zlib/1.2.11 brotli/1.0.9 zstd/1.4.8 libpsl/0.21.0
Release-Date: 2025-09-10
Protocols: dict file ftp ftps gopher gophers http https imap imaps ipfs ipns mqtt pop3 pop3s rtsp smb smbs smtp smtps telnet tftp ws wss
Features: alt-svc AsynchDNS brotli HSTS HTTPS-proxy IPv6 Largefile libz NTLM PSL SSL threadsafe TLS-SRP UnixSockets zstd
Model ranking
# Model
1
gpt-5-minimal logo gpt-5-minimal
100%
3 (1.0x) 1m18s (1.5x) $0.018 (2.8x)
2
qwen3-max logo qwen3-max
100%
7 (2.3x) 52s (1.0x) $0.044 (6.8x)
3
gpt-5-mini-minimal logo gpt-5-mini-minimal
100%
7 (2.3x) 1m27s (1.7x) $0.007 (1.1x)
4
gpt-4.1-mini logo gpt-4.1-mini
100%
8 (2.7x) 55s (1.1x) $0.008 (1.2x)
5
gemini-2.5-flash-thinking logo gemini-2.5-flash-thinking
100%
9 (3.0x) 1m1s (1.2x) $0.016 (2.5x)
6
grok-code-fast-1 logo grok-code-fast-1
100%
9 (3.0x) 1m4s (1.2x) $0.006 (1.0x)
7
gemini-2.5-flash logo gemini-2.5-flash
100%
9 (3.0x) 1m50s (2.1x) $0.013 (2.1x)
8
grok-4 logo grok-4
100%
9 (3.0x) 3m6s (3.6x) $0.160 (25.0x)
9
gpt-5-high logo gpt-5-high
100%
10 (3.3x) 2m38s (3.1x) $0.079 (12.3x)
10
gpt-4.1 logo gpt-4.1
100%
12 (4.0x) 58s (1.1x) $0.075 (11.7x)
11
gpt-5-codex-high logo gpt-5-codex-high
100%
12 (4.0x) 1m30s (1.7x) $0.060 (9.4x)
12
deepseek-v3.1 logo deepseek-v3.1
100%
13 (4.3x) 1m14s (1.4x) $0.058 (9.0x)
13
grok-4-fast logo grok-4-fast
100%
13 (4.3x) 1m36s (1.8x) $0.008 (1.2x)
14
gemini-2.5-pro logo gemini-2.5-pro
100%
13 (4.3x) 2m48s (3.2x) $0.101 (15.8x)
15
claude-opus-4.1-thinking-16k logo claude-opus-4.1-thinking-16k
100%
14 (4.7x) 3m17s (3.8x) $0.805 (125.8x)
16
gpt-5-mini-high logo gpt-5-mini-high
100%
14 (4.7x) 3m26s (4.0x) $0.023 (3.5x)
17
deepseek-v3.1-terminus logo deepseek-v3.1-terminus
100%
16 (5.3x) 2m1s (2.3x) $0.042 (6.6x)
18
claude-sonnet-4-thinking-16k logo claude-sonnet-4-thinking-16k
100%
20 (6.7x) 2m35s (3.0x) $0.210 (32.9x)
19
kimi-k2-0905 logo kimi-k2-0905
100%
21 (7.0x) 1m25s (1.6x) $0.231 (36.1x)
20
claude-sonnet-4.5-thinking-16k logo claude-sonnet-4.5-thinking-16k
100%
22 (7.3x) 2m42s (3.1x) $0.256 (39.9x)
21
claude-sonnet-4.5 logo claude-sonnet-4.5
100%
23 (7.7x) 1m52s (2.2x) $0.273 (42.6x)
22
claude-sonnet-4 logo claude-sonnet-4
100%
23 (7.7x) 1m59s (2.3x) $0.220 (34.4x)
23
gpt-oss-120b-high logo gpt-oss-120b-high
67%
12 (4.0x) 1m5s (1.3x) $0.012 (1.9x)
24
glm-4.5 logo glm-4.5
67%
16 (5.3x) 1m39s (1.9x) $0.068 (10.6x)
Attempts
Model Attempt ID Cost Duration Status / Error
claude-opus-4.1-thinking-16k logo claude-opus-4.1-thinking-16k
ai2z1k398755h $0.926 3m42s Success
claude-opus-4.1-thinking-16k logo claude-opus-4.1-thinking-16k
gtjy8wrg2udbb $0.795 2m50s Success
claude-opus-4.1-thinking-16k logo claude-opus-4.1-thinking-16k
wmmmeaie2a9vw $0.805 3m17s Success
claude-sonnet-4 logo claude-sonnet-4
8px1mqre8990l $0.268 2m2s Success
claude-sonnet-4 logo claude-sonnet-4
aso0mu6qyxp2x $0.220 1m52s Success
claude-sonnet-4 logo claude-sonnet-4
j7m80r0ih9657 $0.194 1m59s Success
claude-sonnet-4-thinking-16k logo claude-sonnet-4-thinking-16k
bwhyja41s6v7o $0.210 2m35s Success
claude-sonnet-4-thinking-16k logo claude-sonnet-4-thinking-16k
ptevq3c2szlc0 $0.240 2m54s Success
claude-sonnet-4-thinking-16k logo claude-sonnet-4-thinking-16k
tdsp4oubtu0rm $0.204 2m26s Success
claude-sonnet-4.5 logo claude-sonnet-4.5
38xzage817d3a $0.376 2m30s Success
claude-sonnet-4.5 logo claude-sonnet-4.5
8x90cfvuy3dim $0.273 1m51s Success
claude-sonnet-4.5 logo claude-sonnet-4.5
uox1l9egxfdtk $0.228 1m52s Success
claude-sonnet-4.5-thinking-16k logo claude-sonnet-4.5-thinking-16k
3oury8yrk2713 $0.355 2m42s Success
claude-sonnet-4.5-thinking-16k logo claude-sonnet-4.5-thinking-16k
mmzamof8y16ox $0.256 2m35s Success
claude-sonnet-4.5-thinking-16k logo claude-sonnet-4.5-thinking-16k
wn13fmmw4o0jj $0.246 2m42s Success
deepseek-v3.1 logo deepseek-v3.1
3q7llnow2rleu $0.064 1m17s Success
deepseek-v3.1 logo deepseek-v3.1
tf7jqkksyytmc $0.058 1m6s Success
deepseek-v3.1 logo deepseek-v3.1
vljy9xr11ouby $0.051 1m14s Success
deepseek-v3.1-terminus logo deepseek-v3.1-terminus
4dxrton5qr4xd $0.042 2m1s Success
deepseek-v3.1-terminus logo deepseek-v3.1-terminus
fqmjqiqx3lnwt $0.064 2m9s Success
deepseek-v3.1-terminus logo deepseek-v3.1-terminus
wjk0hs2ahq39p $0.039 2m0s Success
gemini-2.5-flash logo gemini-2.5-flash
32vic9v2las0v $0.010 1m53s Success
gemini-2.5-flash logo gemini-2.5-flash
g2gis7dqdjj34 $0.015 44s Success
gemini-2.5-flash logo gemini-2.5-flash
voohjs8mprlic $0.013 1m50s Success
gemini-2.5-flash-thinking logo gemini-2.5-flash-thinking
3syscgm1iscvm $0.016 55s Success
gemini-2.5-flash-thinking logo gemini-2.5-flash-thinking
ewmd3jtebe524 $0.016 1m1s Success
gemini-2.5-flash-thinking logo gemini-2.5-flash-thinking
vbxyokowq5aoy $0.012 2m1s Success
gemini-2.5-pro logo gemini-2.5-pro
321oro8n33dlo $0.101 2m48s Success
gemini-2.5-pro logo gemini-2.5-pro
3w5j1w5ge3rre $0.125 3m4s Success
gemini-2.5-pro logo gemini-2.5-pro
cxwdxu4prhl2v $0.097 2m39s Success
glm-4.5 logo glm-4.5
1akx07et1t647 $0.035 1m11s Failure task failed: curl binary does not exist
glm-4.5 logo glm-4.5
ipjpbgdvpr2n4 $0.074 1m39s Success
glm-4.5 logo glm-4.5
tjqg8iq1qv38c $0.068 2m8s Success
gpt-4.1 logo gpt-4.1
5z512ef4z27in $0.075 58s Success
gpt-4.1 logo gpt-4.1
bydbl3asyas9v $0.112 1m12s Success
gpt-4.1 logo gpt-4.1
er52z0ij5xato $0.064 58s Success
gpt-4.1-mini logo gpt-4.1-mini
21pe0ozs8m7fm $0.005 2m7s Success
gpt-4.1-mini logo gpt-4.1-mini
ki2dypbz4tpv8 $0.008 49s Success
gpt-4.1-mini logo gpt-4.1-mini
p1htls0nvlfqc $0.010 55s Success
gpt-5-codex-high logo gpt-5-codex-high
lr4azmoq0vwfp $0.060 1m24s Success
gpt-5-codex-high logo gpt-5-codex-high
n7pb2nptmmtwb $0.057 1m30s Success
gpt-5-codex-high logo gpt-5-codex-high
zw5xibegcfv42 $0.102 1m42s Success
gpt-5-high logo gpt-5-high
nckhvg37rrvka $0.077 2m38s Success
gpt-5-high logo gpt-5-high
sr2cnxp5q2goj $0.079 2m14s Success
gpt-5-high logo gpt-5-high
wb3o0g66o3ocp $0.098 2m50s Success
gpt-5-mini-high logo gpt-5-mini-high
5w8nf4xwlw2s0 $0.018 3m14s Success
gpt-5-mini-high logo gpt-5-mini-high
alq42fopv2rty $0.032 3m52s Success
gpt-5-mini-high logo gpt-5-mini-high
h7rfxfac5p8u0 $0.023 3m26s Success
gpt-5-mini-minimal logo gpt-5-mini-minimal
d3xcrvwv0joie $0.007 1m27s Success
gpt-5-mini-minimal logo gpt-5-mini-minimal
qtvgxyactviw5 $0.013 1m27s Success
gpt-5-mini-minimal logo gpt-5-mini-minimal
xe0l2z17w7e9o $0.005 11m11s Success
gpt-5-minimal logo gpt-5-minimal
ksevvrvl1esbq $0.035 1m18s Success
gpt-5-minimal logo gpt-5-minimal
wm3uscqd9ieeu $0.014 1m6s Success
gpt-5-minimal logo gpt-5-minimal
ynt8pcvycy2br $0.018 1m24s Success
gpt-oss-120b-high logo gpt-oss-120b-high
5omeuh6g15vxt $0.012 1m5s Success
gpt-oss-120b-high logo gpt-oss-120b-high
iv705nbbvoe6k $0.000 3s Failure task failed: curl binary does not exist
gpt-oss-120b-high logo gpt-oss-120b-high
shzksge2h1k0w $0.015 1m10s Success
grok-4 logo grok-4
5cag5qqdwln1h $0.133 2m2s Success
grok-4 logo grok-4
5x88xjnryhhs2 $0.177 3m6s Success
grok-4 logo grok-4
d44ff6zw05z04 $0.160 3m11s Success
grok-4-fast logo grok-4-fast
0mcciwiy933jw $0.007 1m30s Success
grok-4-fast logo grok-4-fast
33696m90xke2n $0.008 2m15s Success
grok-4-fast logo grok-4-fast
bc4n9a7czyhb7 $0.008 1m36s Success
grok-code-fast-1 logo grok-code-fast-1
3h1oejwhx2pcz $0.006 1m2s Success
grok-code-fast-1 logo grok-code-fast-1
m2gqtujq7yyj5 $0.008 2m14s Success
grok-code-fast-1 logo grok-code-fast-1
zcx3kuvb48xn1 $0.005 1m4s Success
kimi-k2-0905 logo kimi-k2-0905
19w8xvs7mqfbu $0.249 1m27s Success
kimi-k2-0905 logo kimi-k2-0905
fuyac5wcfpid0 $0.141 1m16s Success
kimi-k2-0905 logo kimi-k2-0905
j900x41p5e98l $0.231 1m25s Success
qwen3-max logo qwen3-max
9uq1neo5gm304 $0.045 2m1s Success
qwen3-max logo qwen3-max
ph0ymeardfhaf $0.044 52s Success
qwen3-max logo qwen3-max
x6gyx4wxffxss $0.025 49s Success