Task
curl-ssl
curl 8.16.0 is a command-line HTTP client. Project link: curl.se
Task: Compile and install curl to a specific location. Build with SSL support (TLS v1.3), brotli, zlib and zstd.
Difficulties: Installing dependencies can be tricky.
Environment: Ubuntu 22.04 on amd64, with internet access.
Best attempt
| Model |
|
| Attempt |
wm3uscqd9ieeu
|
| # of commands | 2 |
| Total time | 1m6s |
| Cost | $0.014 |
Terminal transcript >
compile-bench> set -e; export DEBIAN_FRONTEND=noninteractive; sudo apt-get update -y; sudo apt-get install -y build-essential pkg-config autoconf automake libtool cmake ninja-build meson perl python3 libssl-dev zlib1g-dev libbrotli-dev libzstd-dev ca-certificates; rm -rf /home/peter/build; mkdir -p /home/peter/build /home/peter/result/bin; cd /home/peter/build; tar xf /home/peter/curl.tar.gz; cd curl-*; if [ -f configure ]; then echo using autotools; else echo generating configure; autoreconf -fi; fi; ./configure --prefix=/home/peter/result --with-ssl --with-zlib --with-brotli --with-zstd --enable-tls-srp --enable-alt-svc; make -j"$(nproc)"; make install; ln -sf /home/peter/result/bin/curl /home/peter/result/curl; /home/peter/result/bin/curl -V checking whether to use OpenSSL's built-in CA store... no checking CA cert bundle path to embed in the curl tool... no checking for pkg-config... (cached) /usr/bin/pkg-config checking for libpsl options with pkg-config... no checking for psl_builtin in -lpsl... no configure: error: libpsl libs and/or directories were not found where specified! compile-bench> set -e; export DEBIAN_FRONTEND=noninteractive; sudo apt-get install -y libpsl-dev; cd /home/peter/build/curl-*; make distclean || true; ./configure --prefix=/home/peter/result --with-ssl --with-zlib --with-brotli --with-zstd --enable-tls-srp --enable-alt-svc; make -j"$(nproc)"; make install; ln -sf /home/peter/result/bin/curl /home/peter/result/curl; /home/peter/result/bin/curl -V make[2]: Leaving directory '/home/peter/build/curl-8.16.0' make[1]: Leaving directory '/home/peter/build/curl-8.16.0' curl 8.16.0 (x86_64-pc-linux-gnu) libcurl/8.16.0 OpenSSL/3.0.2 zlib/1.2.11 brotli/1.0.9 zstd/1.4.8 libpsl/0.21.0 Release-Date: 2025-09-10 Protocols: dict file ftp ftps gopher gophers http https imap imaps ipfs ipns mqtt pop3 pop3s rtsp smb smbs smtp smtps telnet tftp ws wss Features: alt-svc AsynchDNS brotli HSTS HTTPS-proxy IPv6 Largefile libz NTLM PSL SSL threadsafe TLS-SRP UnixSockets zstd
Model ranking
| # | Model | ||||
|---|---|---|---|---|---|
| 1 |
|
100%
|
3 (1.0x) | 1m18s (1.5x) | $0.018 (2.8x) |
| 2 |
|
100%
|
7 (2.3x) | 52s (1.0x) | $0.044 (6.8x) |
| 3 |
|
100%
|
7 (2.3x) | 1m27s (1.7x) | $0.007 (1.1x) |
| 4 |
|
100%
|
8 (2.7x) | 55s (1.1x) | $0.008 (1.2x) |
| 5 |
|
100%
|
9 (3.0x) | 1m1s (1.2x) | $0.016 (2.5x) |
| 6 |
|
100%
|
9 (3.0x) | 1m4s (1.2x) | $0.006 (1.0x) |
| 7 |
|
100%
|
9 (3.0x) | 1m50s (2.1x) | $0.013 (2.1x) |
| 8 |
|
100%
|
9 (3.0x) | 3m6s (3.6x) | $0.160 (25.0x) |
| 9 |
|
100%
|
10 (3.3x) | 2m38s (3.1x) | $0.079 (12.3x) |
| 10 |
|
100%
|
12 (4.0x) | 58s (1.1x) | $0.075 (11.7x) |
| 11 |
|
100%
|
12 (4.0x) | 1m30s (1.7x) | $0.060 (9.4x) |
| 12 |
|
100%
|
13 (4.3x) | 1m14s (1.4x) | $0.058 (9.0x) |
| 13 |
|
100%
|
13 (4.3x) | 1m36s (1.8x) | $0.008 (1.2x) |
| 14 |
|
100%
|
13 (4.3x) | 2m48s (3.2x) | $0.101 (15.8x) |
| 15 |
|
100%
|
14 (4.7x) | 3m17s (3.8x) | $0.805 (125.8x) |
| 16 |
|
100%
|
14 (4.7x) | 3m26s (4.0x) | $0.023 (3.5x) |
| 17 |
|
100%
|
16 (5.3x) | 2m1s (2.3x) | $0.042 (6.6x) |
| 18 |
|
100%
|
20 (6.7x) | 2m35s (3.0x) | $0.210 (32.9x) |
| 19 |
|
100%
|
21 (7.0x) | 1m25s (1.6x) | $0.231 (36.1x) |
| 20 |
|
100%
|
22 (7.3x) | 2m42s (3.1x) | $0.256 (39.9x) |
| 21 |
|
100%
|
23 (7.7x) | 1m52s (2.2x) | $0.273 (42.6x) |
| 22 |
|
100%
|
23 (7.7x) | 1m59s (2.3x) | $0.220 (34.4x) |
| 23 |
|
67%
|
12 (4.0x) | 1m5s (1.3x) | $0.012 (1.9x) |
| 24 |
|
67%
|
16 (5.3x) | 1m39s (1.9x) | $0.068 (10.6x) |
Attempts
| Model | Attempt ID | Cost | Duration | Status / Error |
|---|---|---|---|---|
|
|
ai2z1k398755h
|
$0.926 | 3m42s | Success |
|
|
gtjy8wrg2udbb
|
$0.795 | 2m50s | Success |
|
|
wmmmeaie2a9vw
|
$0.805 | 3m17s | Success |
|
|
8px1mqre8990l
|
$0.268 | 2m2s | Success |
|
|
aso0mu6qyxp2x
|
$0.220 | 1m52s | Success |
|
|
j7m80r0ih9657
|
$0.194 | 1m59s | Success |
|
|
bwhyja41s6v7o
|
$0.210 | 2m35s | Success |
|
|
ptevq3c2szlc0
|
$0.240 | 2m54s | Success |
|
|
tdsp4oubtu0rm
|
$0.204 | 2m26s | Success |
|
|
38xzage817d3a
|
$0.376 | 2m30s | Success |
|
|
8x90cfvuy3dim
|
$0.273 | 1m51s | Success |
|
|
uox1l9egxfdtk
|
$0.228 | 1m52s | Success |
|
|
3oury8yrk2713
|
$0.355 | 2m42s | Success |
|
|
mmzamof8y16ox
|
$0.256 | 2m35s | Success |
|
|
wn13fmmw4o0jj
|
$0.246 | 2m42s | Success |
|
|
3q7llnow2rleu
|
$0.064 | 1m17s | Success |
|
|
tf7jqkksyytmc
|
$0.058 | 1m6s | Success |
|
|
vljy9xr11ouby
|
$0.051 | 1m14s | Success |
|
|
4dxrton5qr4xd
|
$0.042 | 2m1s | Success |
|
|
fqmjqiqx3lnwt
|
$0.064 | 2m9s | Success |
|
|
wjk0hs2ahq39p
|
$0.039 | 2m0s | Success |
|
|
32vic9v2las0v
|
$0.010 | 1m53s | Success |
|
|
g2gis7dqdjj34
|
$0.015 | 44s | Success |
|
|
voohjs8mprlic
|
$0.013 | 1m50s | Success |
|
|
3syscgm1iscvm
|
$0.016 | 55s | Success |
|
|
ewmd3jtebe524
|
$0.016 | 1m1s | Success |
|
|
vbxyokowq5aoy
|
$0.012 | 2m1s | Success |
|
|
321oro8n33dlo
|
$0.101 | 2m48s | Success |
|
|
3w5j1w5ge3rre
|
$0.125 | 3m4s | Success |
|
|
cxwdxu4prhl2v
|
$0.097 | 2m39s | Success |
|
|
1akx07et1t647
|
$0.035 | 1m11s | Failure task failed: curl binary does not exist |
|
|
ipjpbgdvpr2n4
|
$0.074 | 1m39s | Success |
|
|
tjqg8iq1qv38c
|
$0.068 | 2m8s | Success |
|
|
5z512ef4z27in
|
$0.075 | 58s | Success |
|
|
bydbl3asyas9v
|
$0.112 | 1m12s | Success |
|
|
er52z0ij5xato
|
$0.064 | 58s | Success |
|
|
21pe0ozs8m7fm
|
$0.005 | 2m7s | Success |
|
|
ki2dypbz4tpv8
|
$0.008 | 49s | Success |
|
|
p1htls0nvlfqc
|
$0.010 | 55s | Success |
|
|
lr4azmoq0vwfp
|
$0.060 | 1m24s | Success |
|
|
n7pb2nptmmtwb
|
$0.057 | 1m30s | Success |
|
|
zw5xibegcfv42
|
$0.102 | 1m42s | Success |
|
|
nckhvg37rrvka
|
$0.077 | 2m38s | Success |
|
|
sr2cnxp5q2goj
|
$0.079 | 2m14s | Success |
|
|
wb3o0g66o3ocp
|
$0.098 | 2m50s | Success |
|
|
5w8nf4xwlw2s0
|
$0.018 | 3m14s | Success |
|
|
alq42fopv2rty
|
$0.032 | 3m52s | Success |
|
|
h7rfxfac5p8u0
|
$0.023 | 3m26s | Success |
|
|
d3xcrvwv0joie
|
$0.007 | 1m27s | Success |
|
|
qtvgxyactviw5
|
$0.013 | 1m27s | Success |
|
|
xe0l2z17w7e9o
|
$0.005 | 11m11s | Success |
|
|
ksevvrvl1esbq
|
$0.035 | 1m18s | Success |
|
|
wm3uscqd9ieeu
|
$0.014 | 1m6s | Success |
|
|
ynt8pcvycy2br
|
$0.018 | 1m24s | Success |
|
|
5omeuh6g15vxt
|
$0.012 | 1m5s | Success |
|
|
iv705nbbvoe6k
|
$0.000 | 3s | Failure task failed: curl binary does not exist |
|
|
shzksge2h1k0w
|
$0.015 | 1m10s | Success |
|
|
5cag5qqdwln1h
|
$0.133 | 2m2s | Success |
|
|
5x88xjnryhhs2
|
$0.177 | 3m6s | Success |
|
|
d44ff6zw05z04
|
$0.160 | 3m11s | Success |
|
|
0mcciwiy933jw
|
$0.007 | 1m30s | Success |
|
|
33696m90xke2n
|
$0.008 | 2m15s | Success |
|
|
bc4n9a7czyhb7
|
$0.008 | 1m36s | Success |
|
|
3h1oejwhx2pcz
|
$0.006 | 1m2s | Success |
|
|
m2gqtujq7yyj5
|
$0.008 | 2m14s | Success |
|
|
zcx3kuvb48xn1
|
$0.005 | 1m4s | Success |
|
|
19w8xvs7mqfbu
|
$0.249 | 1m27s | Success |
|
|
fuyac5wcfpid0
|
$0.141 | 1m16s | Success |
|
|
j900x41p5e98l
|
$0.231 | 1m25s | Success |
|
|
9uq1neo5gm304
|
$0.045 | 2m1s | Success |
|
|
ph0ymeardfhaf
|
$0.044 | 52s | Success |
|
|
x6gyx4wxffxss
|
$0.025 | 49s | Success |