CompileBench Task: curl-ssl-arm64-static2

Task

curl-ssl-arm64-static2

curl 8.16.0 is a command-line HTTP client. Project link: curl.se

Task: Compile and install curl to a specific location. Build with SSL support (TLS v1.3), brotli, zlib and zstd. Cross-compile to arm64. Link it statically. This is a variant of curl-ssl-arm64-static, with a hint to do a trial run of compiled binary.

Difficulties: Cross-compilation toolchain setup, manually cross-compiling all dependencies, properly configuring SSL certificates in OpenSSL.

Environment: Ubuntu 22.04 on amd64, with internet access.

Best attempt

Model	grok-4
Attempt	`whc01txfz0nhf`
# of commands	29
Total time	10m29s
Cost	$1.041

Terminal transcript >

compile-bench> sudo dpkg --add-architecture arm64 &amp;&amp; sudo apt update &amp;&amp; sudo apt install -y gcc-aarch64-linux-gnu g++-aarch64-linux-gnu binutils-aarch64-linux-gnu qemu-user-static libssl-dev:arm64 libbrotli-dev:arm64 zlib1g-dev:arm64 libzstd-dev:arm64 pkg-config
bash: eval: line 4: syntax error near unexpected token `;&'
bash: eval: line 4: `sudo dpkg --add-architecture arm64 &amp;&amp; sudo apt update &amp;&amp; sudo apt install -y gcc-aarch64-linux-gnu g++-aarch64-linux-gnu binutils-aarch64-linux-gnu qemu-user-static libssl-dev:arm64 libbrotli-dev:arm64 zlib1g-dev:arm64 libzstd-dev:arm64 pkg-config'
compile-bench> sudo dpkg --add-architecture arm64 && sudo apt update && DEBIAN_FRONTEND=noninteractive sudo apt install -y gcc-aarch64-linux-gnu g++-aarch64-linux-gnu binutils-aarch64-linux-gnu qemu-user-static libssl-dev:arm64 libbrotli-dev:arm64 zlib1g-dev:arm64 libzstd-dev:arm64 pkg-config

E: Failed to fetch http://archive.ubuntu.com/ubuntu/dists/jammy/main/binary-arm64/Packages  404  Not Found [IP: 185.125.190.82 80]
E: Failed to fetch http://security.ubuntu.com/ubuntu/dists/jammy-security/universe/binary-arm64/Packages  404  Not Found [IP: 185.125.190.36 80]
E: Failed to fetch http://archive.ubuntu.com/ubuntu/dists/jammy-updates/main/binary-arm64/Packages  404  Not Found [IP: 185.125.190.82 80]
E: Failed to fetch http://archive.ubuntu.com/ubuntu/dists/jammy-backports/main/binary-arm64/Packages  404  Not Found [IP: 185.125.190.82 80]
E: Some index files failed to download. They have been ignored, or old ones used instead.
compile-bench> sudo dpkg --add-architecture arm64 && echo "deb [arch=arm64] http://ports.ubuntu.com/ubuntu-ports jammy main restricted universe multiverse" | sudo tee /etc/apt/sources.list.d/arm64.list && echo "deb [arch=arm64] http://ports.ubuntu.com/ubuntu-ports jammy-updates main restricted universe multiverse" | sudo tee -a /etc/apt/sources.list.d/arm64.list && echo "deb [arch=arm64] http://ports.ubuntu.com/ubuntu-ports jammy-security main restricted universe multiverse" | sudo tee -a /etc/apt/sources.list.d/arm64.list && echo "deb [arch=arm64] http://ports.ubuntu.com/ubuntu-ports jammy-backports main restricted universe multiverse" | sudo tee -a /etc/apt/sources.list.d/arm64.list && sudo apt update && DEBIAN_FRONTEND=noninteractive sudo apt install -y gcc-aarch64-linux-gnu g++-aarch64-linux-gnu binutils-aarch64-linux-gnu qemu-user-static libssl-dev:arm64 libbrotli-dev:arm64 zlib1g-dev:arm64 libzstd-dev:arm64 pkg-config

E: Failed to fetch http://security.ubuntu.com/ubuntu/dists/jammy-security/universe/binary-arm64/Packages  404  Not Found [IP: 91.189.91.82 80]
E: Failed to fetch http://archive.ubuntu.com/ubuntu/dists/jammy/main/binary-arm64/Packages  404  Not Found [IP: 185.125.190.82 80]
E: Failed to fetch http://archive.ubuntu.com/ubuntu/dists/jammy-updates/restricted/binary-arm64/Packages  404  Not Found [IP: 185.125.190.82 80]
E: Failed to fetch http://archive.ubuntu.com/ubuntu/dists/jammy-backports/universe/binary-arm64/Packages  404  Not Found [IP: 185.125.190.82 80]
E: Some index files failed to download. They have been ignored, or old ones used instead.
compile-bench> sudo sed -i 's/^deb /deb [arch=amd64] /' /etc/apt/sources.list && sudo rm -f /etc/apt/sources.list.d/arm64.list && echo "deb [arch=arm64] http://ports.ubuntu.com/ubuntu-ports jammy main restricted universe multiverse" | sudo tee /etc/apt/sources.list.d/arm64.list && echo "deb [arch=arm64] http://ports.ubuntu.com/ubuntu-ports jammy-updates main restricted universe multiverse" | sudo tee -a /etc/apt/sources.list.d/arm64.list && echo "deb [arch=arm64] http://ports.ubuntu.com/ubuntu-ports jammy-security main restricted universe multiverse" | sudo tee -a /etc/apt/sources.list.d/arm64.list && echo "deb [arch=arm64] http://ports.ubuntu.com/ubuntu-ports jammy-backports main restricted universe multiverse" | sudo tee -a /etc/apt/sources.list.d/arm64.list && sudo apt update && DEBIAN_FRONTEND=noninteractive sudo apt install -y gcc-aarch64-linux-gnu g++-aarch64-linux-gnu binutils-aarch64-linux-gnu qemu-user-static libssl-dev:arm64 libbrotli-dev:arm64 zlib1g-dev:arm64 libzstd-dev:arm64 pkg-config
Setting up libnss-nisplus:arm64 (1.3-0ubuntu6) ...
Setting up libnss-nis:arm64 (3.1-0ubuntu6) ...
Setting up libnsl-dev:arm64 (1.3.0-2build2) ...
Setting up libc6-dev:arm64 (2.35-0ubuntu3.10) ...
Setting up zlib1g-dev:arm64 (1:1.2.11.dfsg-2ubuntu9.2) ...
Processing triggers for libc-bin (2.35-0ubuntu3.10) ...
compile-bench> tar -xzf curl.tar.gz && ls -d curl-*
curl-8.16.0
compile-bench> cd curl-8.16.0 && export CC=aarch64-linux-gnu-gcc && export CXX=aarch64-linux-gnu-g++ && export AR=aarch64-linux-gnu-ar && export RANLIB=aarch64-linux-gnu-ranlib && export PKG_CONFIG_PATH=/usr/lib/aarch64-linux-gnu/pkgconfig && ./configure --host=aarch64-linux-gnu --prefix=/home/peter/result --with-openssl --with-brotli --with-zlib --with-zstd --disable-shared --with-ca-bundle=/etc/ssl/certs/ca-certificates.crt LDFLAGS="-static" && make -j$(nproc) && make install
checking whether to use OpenSSL's built-in CA store... no
checking CA cert bundle path to embed in the curl tool... no
checking for aarch64-linux-gnu-pkg-config... (cached) /usr/bin/aarch64-linux-gnu-pkg-config
checking for libpsl options with pkg-config... no
checking for psl_builtin in -lpsl... no
configure: error: libpsl libs and/or directories were not found where specified!
compile-bench> DEBIAN_FRONTEND=noninteractive sudo apt install -y libpsl-dev:arm64
Preparing to unpack .../libpsl-dev_0.21.0-1.2build2_arm64.deb ...
Unpacking libpsl-dev:arm64 (0.21.0-1.2build2) ...
Setting up libpsl5:arm64 (0.21.0-1.2build2) ...
Setting up libpsl-dev:arm64 (0.21.0-1.2build2) ...
Setting up publicsuffix (20211207.1025-1) ...
Processing triggers for libc-bin (2.35-0ubuntu3.10) ...
compile-bench> cd curl-8.16.0 && make clean || true && export CC=aarch64-linux-gnu-gcc && export CXX=aarch64-linux-gnu-g++ && export AR=aarch64-linux-gnu-ar && export RANLIB=aarch64-linux-gnu-ranlib && export PKG_CONFIG_PATH=/usr/lib/aarch64-linux-gnu/pkgconfig && ./configure --host=aarch64-linux-gnu --prefix=/home/peter/result --with-openssl --with-brotli --with-zlib --with-zstd --disable-shared --with-ca-bundle=/etc/ssl/certs/ca-certificates.crt LDFLAGS="-static" && make -j$(nproc) && make install
checking whether to use OpenSSL's built-in CA store... no
checking CA cert bundle path to embed in the curl tool... no
checking for aarch64-linux-gnu-pkg-config... (cached) /usr/bin/aarch64-linux-gnu-pkg-config
checking for libpsl options with pkg-config... found
checking for psl_builtin in -lpsl... no
configure: error: libpsl libs and/or directories were not found where specified!
compile-bench> cd curl-8.16.0 && make clean || true && export CC=aarch64-linux-gnu-gcc && export CXX=aarch64-linux-gnu-g++ && export AR=aarch64-linux-gnu-ar && export RANLIB=aarch64-linux-gnu-ranlib && export PKG_CONFIG_PATH=/usr/lib/aarch64-linux-gnu/pkgconfig && ./configure --host=aarch64-linux-gnu --prefix=/home/peter/result --with-openssl --with-brotli --with-zlib --with-zstd --disable-shared --with-ca-bundle=/etc/ssl/certs/ca-certificates.crt --without-libpsl LDFLAGS="-static" && make -j$(nproc) && make install
make[6]: Leaving directory '/home/peter/curl-8.16.0/docs/libcurl'
make[5]: Leaving directory '/home/peter/curl-8.16.0/docs/libcurl'
make[4]: Leaving directory '/home/peter/curl-8.16.0/docs/libcurl'
make[3]: Leaving directory '/home/peter/curl-8.16.0'
make[2]: Leaving directory '/home/peter/curl-8.16.0'
make[1]: Leaving directory '/home/peter/curl-8.16.0'
compile-bench> ln -s /home/peter/result/bin/curl /home/peter/result/curl
[empty output]
compile-bench> file /home/peter/result/bin/curl
/home/peter/result/bin/curl: ELF 64-bit LSB pie executable, ARM aarch64, version 1 (SYSV), dynamically linked, interpreter /lib/ld-linux-aarch64.so.1, BuildID[sha1]=dccdaf43c263987e66e97912ac5920f0ed13b129, for GNU/Linux 3.7.0, not stripped
compile-bench> aarch64-linux-gnu-objdump -p /home/peter/result/bin/curl | grep NEEDED
  NEEDED               libcrypto.so.3
  NEEDED               libzstd.so.1
  NEEDED               libbrotlidec.so.1
  NEEDED               libz.so.1
  NEEDED               libc.so.6
  NEEDED               ld-linux-aarch64.so.1
compile-bench> rm -rf /home/peter/result && cd curl-8.16.0 && make clean || true && export CC=aarch64-linux-gnu-gcc && export CXX=aarch64-linux-gnu-g++ && export AR=aarch64-linux-gnu-ar && export RANLIB=aarch64-linux-gnu-ranlib && export PKG_CONFIG_PATH=/usr/lib/aarch64-linux-gnu/pkgconfig && export LDFLAGS="-static" && ./configure --host=aarch64-linux-gnu --prefix=/home/peter/result --with-openssl --with-brotli --with-zlib --with-zstd --disable-shared --with-ca-bundle=/etc/ssl/certs/ca-certificates.crt --without-libpsl && make -j$(nproc) && make install
make[6]: Leaving directory '/home/peter/curl-8.16.0/docs/libcurl'
make[5]: Leaving directory '/home/peter/curl-8.16.0/docs/libcurl'
make[4]: Leaving directory '/home/peter/curl-8.16.0/docs/libcurl'
make[3]: Leaving directory '/home/peter/curl-8.16.0'
make[2]: Leaving directory '/home/peter/curl-8.16.0'
make[1]: Leaving directory '/home/peter/curl-8.16.0'
compile-bench> file /home/peter/result/bin/curl
/home/peter/result/bin/curl: ELF 64-bit LSB pie executable, ARM aarch64, version 1 (SYSV), dynamically linked, interpreter /lib/ld-linux-aarch64.so.1, BuildID[sha1]=dccdaf43c263987e66e97912ac5920f0ed13b129, for GNU/Linux 3.7.0, not stripped
compile-bench> rm -rf /home/peter/result && cd curl-8.16.0 && make clean || true && export CC=aarch64-linux-gnu-gcc && export CXX=aarch64-linux-gnu-g++ && export AR=aarch64-linux-gnu-ar && export RANLIB=aarch64-linux-gnu-ranlib && export PKG_CONFIG_PATH=/usr/lib/aarch64-linux-gnu/pkgconfig && export PKG_CONFIG="pkg-config --static" && export LDFLAGS="-static" && ./configure --host=aarch64-linux-gnu --prefix=/home/peter/result --with-openssl --with-brotli --with-zlib --with-zstd --disable-shared --with-ca-bundle=/etc/ssl/certs/ca-certificates.crt --without-libpsl && make -j$(nproc) && make install
make[6]: Leaving directory '/home/peter/curl-8.16.0/docs/libcurl'
make[5]: Leaving directory '/home/peter/curl-8.16.0/docs/libcurl'
make[4]: Leaving directory '/home/peter/curl-8.16.0/docs/libcurl'
make[3]: Leaving directory '/home/peter/curl-8.16.0'
make[2]: Leaving directory '/home/peter/curl-8.16.0'
make[1]: Leaving directory '/home/peter/curl-8.16.0'
compile-bench> file /home/peter/result/bin/curl
/home/peter/result/bin/curl: ELF 64-bit LSB pie executable, ARM aarch64, version 1 (SYSV), dynamically linked, interpreter /lib/ld-linux-aarch64.so.1, BuildID[sha1]=dccdaf43c263987e66e97912ac5920f0ed13b129, for GNU/Linux 3.7.0, not stripped
compile-bench> PKG_CONFIG_PATH=/usr/lib/aarch64-linux-gnu/pkgconfig pkg-config --static --libs openssl libbrotlidec libzstd zlib
-L/usr/lib/aarch64-linux-gnu -lssl -lcrypto -ldl -pthread -lbrotlidec -lbrotlicommon -lzstd -lz
compile-bench> cd curl-8.16.0 && make clean || true && export CC=aarch64-linux-gnu-gcc && export CXX=aarch64-linux-gnu-g++ && export AR=aarch64-linux-gnu-ar && export RANLIB=aarch64-linux-gnu-ranlib && export PKG_CONFIG_PATH=/usr/lib/aarch64-linux-gnu/pkgconfig && export PKG_CONFIG="pkg-config --static" && export LDFLAGS="-static" && ./configure --host=aarch64-linux-gnu --prefix=/home/peter/result --with-openssl --with-brotli --with-zlib --with-zstd --disable-shared --with-ca-bundle=/etc/ssl/certs/ca-certificates.crt --without-libpsl && make -j$(nproc)
make[1]: Entering directory '/home/peter/curl-8.16.0/scripts'
make[1]: Nothing to be done for 'all'.
make[1]: Leaving directory '/home/peter/curl-8.16.0/scripts'
make[1]: Entering directory '/home/peter/curl-8.16.0'
make[1]: Nothing to be done for 'all-am'.
make[1]: Leaving directory '/home/peter/curl-8.16.0'
compile-bench> cd curl-8.16.0/src && rm -f curl && aarch64-linux-gnu-gcc -static -o curl *.o ../lib/libcurl.a `PKG_CONFIG_PATH=/usr/lib/aarch64-linux-gnu/pkgconfig pkg-config --static --libs openssl libbrotlidec libzstd zlib`
/usr/lib/gcc-cross/aarch64-linux-gnu/11/../../../../aarch64-linux-gnu/bin/ld: libcurltool_la-var.o: in function `setvariable':
var.c:(.text+0x780): multiple definition of `setvariable'; curl-var.o:var.c:(.text+0x780): first defined here
/usr/lib/gcc-cross/aarch64-linux-gnu/11/../../../../aarch64-linux-gnu/bin/ld: cannot find ../lib/libcurl.a: No such file or directory
/usr/lib/gcc-cross/aarch64-linux-gnu/11/../../../../aarch64-linux-gnu/bin/ld: curl-tool_findfile.o: in function `findfile':
tool_findfile.c:(.text+0x214): warning: Using 'getpwuid' in statically linked applications requires at runtime the shared libraries from the glibc version used for linking
collect2: error: ld returned 1 exit status
compile-bench> cd curl-8.16.0 && make clean || true && export CC=aarch64-linux-gnu-gcc && export CXX=aarch64-linux-gnu-g++ && export AR=aarch64-linux-gnu-ar && export RANLIB=aarch64-linux-gnu-ranlib && export PKG_CONFIG_PATH=/usr/lib/aarch64-linux-gnu/pkgconfig && export PKG_CONFIG="pkg-config --static" && export LDFLAGS="-static" && ./configure --host=aarch64-linux-gnu --prefix=/home/peter/result --with-openssl --with-brotli --with-zlib --with-zstd --disable-shared --with-ca-bundle=/etc/ssl/certs/ca-certificates.crt --without-libpsl
  ECH:              no      (--enable-ech)
  HTTPS RR:         no      (--enable-httpsrr)
  SSLS-EXPORT:      no      (--enable-ssls-export)
  Protocols:        dict file ftp ftps gopher gophers http https imap imaps ipfs ipns mqtt pop3 pop3s rtsp smb smbs smtp smtps telnet tftp ws wss
  Features:         alt-svc AsynchDNS brotli HSTS HTTPS-proxy IPv6 Largefile libz NTLM SSL threadsafe TLS-SRP UnixSockets zstd

compile-bench> cd curl-8.16.0/src && make LDFLAGS="-static"
  HUGE     tool_hugehelp.c
  CC       curl-tool_hugehelp.o
echo '/* !checksrc! disable COPYRIGHT all */' > tool_ca_embed.c
echo 'extern const void *curl_ca_embed; const void *curl_ca_embed;' >> tool_ca_embed.c
  CC       curl-tool_ca_embed.o
make: *** No rule to make target '../lib/libcurl.la', needed by 'curl'.  Stop.
compile-bench> cd curl-8.16.0 && make -j$(nproc) LDFLAGS="-static"
make[1]: Entering directory '/home/peter/curl-8.16.0/scripts'
make[1]: Nothing to be done for 'all'.
make[1]: Leaving directory '/home/peter/curl-8.16.0/scripts'
make[1]: Entering directory '/home/peter/curl-8.16.0'
make[1]: Nothing to be done for 'all-am'.
make[1]: Leaving directory '/home/peter/curl-8.16.0'
compile-bench> file curl-8.16.0/src/curl
curl-8.16.0/src/curl: ELF 64-bit LSB pie executable, ARM aarch64, version 1 (SYSV), dynamically linked, interpreter /lib/ld-linux-aarch64.so.1, BuildID[sha1]=dccdaf43c263987e66e97912ac5920f0ed13b129, for GNU/Linux 3.7.0, not stripped
compile-bench> cd curl-8.16.0 && make clean && make -j$(nproc) LDFLAGS="-all-static"
make[1]: Entering directory '/home/peter/curl-8.16.0/scripts'
make[1]: Nothing to be done for 'all'.
make[1]: Leaving directory '/home/peter/curl-8.16.0/scripts'
make[1]: Entering directory '/home/peter/curl-8.16.0'
make[1]: Nothing to be done for 'all-am'.
make[1]: Leaving directory '/home/peter/curl-8.16.0'
compile-bench> file curl-8.16.0/src/curl
curl-8.16.0/src/curl: ELF 64-bit LSB executable, ARM aarch64, version 1 (GNU/Linux), statically linked, BuildID[sha1]=1c811556731944730202f8be5185d3dfbf1f9bac, for GNU/Linux 3.7.0, not stripped
compile-bench> cd curl-8.16.0 && rm -rf /home/peter/result && make install && ln -s /home/peter/result/bin/curl /home/peter/result/curl
make[6]: Leaving directory '/home/peter/curl-8.16.0/docs/libcurl'
make[5]: Leaving directory '/home/peter/curl-8.16.0/docs/libcurl'
make[4]: Leaving directory '/home/peter/curl-8.16.0/docs/libcurl'
make[3]: Leaving directory '/home/peter/curl-8.16.0'
make[2]: Leaving directory '/home/peter/curl-8.16.0'
make[1]: Leaving directory '/home/peter/curl-8.16.0'
compile-bench> file /home/peter/result/bin/curl
/home/peter/result/bin/curl: ELF 64-bit LSB executable, ARM aarch64, version 1 (GNU/Linux), statically linked, BuildID[sha1]=1c811556731944730202f8be5185d3dfbf1f9bac, for GNU/Linux 3.7.0, not stripped
compile-bench> qemu-aarch64-static /home/peter/result/bin/curl --version
curl 8.16.0 (aarch64-unknown-linux-gnu) libcurl/8.16.0 OpenSSL/3.0.2 zlib/1.2.11 brotli/1.0.9 zstd/1.4.8
Release-Date: 2025-09-10
Protocols: dict file ftp ftps gopher gophers http https imap imaps ipfs ipns mqtt pop3 pop3s rtsp smb smbs smtp smtps telnet tftp ws wss
Features: alt-svc AsynchDNS brotli HSTS HTTPS-proxy IPv6 Largefile libz NTLM SSL threadsafe TLS-SRP UnixSockets zstd
compile-bench> qemu-aarch64-static /home/peter/result/bin/curl https://google.com
<H1>301 Moved</H1>
The document has moved
<A HREF="https://www.google.com/">here</A>.

</BODY></HTML>

Model ranking

#	Model
1	claude-sonnet-4.5	100%	52 (1.8x)	6m5s (1.0x)	$0.976 (3.9x)
2	claude-sonnet-4.5-thinking-16k	100%	53 (1.8x)	8m7s (1.3x)	$1.197 (4.8x)
3	gpt-5-codex-high	100%	56 (1.9x)	7m57s (1.3x)	$0.571 (2.3x)
4	gpt-5-high	67%	31 (1.1x)	6m57s (1.1x)	$0.251 (1.0x)
5	claude-sonnet-4-thinking-16k	67%	57 (2.0x)	7m34s (1.2x)	$1.173 (4.7x)
6	grok-4	33%	29 (1.0x)	10m29s (1.7x)	$1.041 (4.2x)
7	claude-opus-4.1-thinking-16k	33%	45 (1.6x)	9m36s (1.6x)	$3.960 (15.8x)
8	claude-sonnet-4	0%
9	deepseek-v3.1	0%
10	deepseek-v3.1-terminus	0%
11	gemini-2.5-flash	0%
12	gemini-2.5-flash-thinking	0%
13	gemini-2.5-pro	0%
14	glm-4.5	0%
15	gpt-4.1	0%
16	gpt-4.1-mini	0%
17	gpt-5-mini-high	0%
18	gpt-5-mini-minimal	0%
19	gpt-5-minimal	0%
20	gpt-oss-120b-high	0%
21	grok-4-fast	0%
22	grok-code-fast-1	0%
23	kimi-k2-0905	0%
24	qwen3-max	0%

Attempts

Model	Attempt ID	Cost	Duration	Status / Error
claude-opus-4.1-thinking-16k	`7gjki9ropz5ul`	$2.687	6m40s	Failure task failed: curl HTTPS request to google.com did not return content-type: text/html but instead: } [2 bytes data] * SSL...
claude-opus-4.1-thinking-16k	`iwf5kl0tsu2w0`	$3.108	8m16s	Failure task failed: curl HTTPS request to google.com did not return content-type: text/html but instead: } [2 bytes data] * SSL...
claude-opus-4.1-thinking-16k	`wtd8etmwr2tum`	$3.960	9m36s	Success
claude-sonnet-4	`8tpew2zaxj1td`	$0.906	5m50s	Failure task failed: curl HTTPS request to google.com did not return content-type: text/html but instead: } [2 bytes data] * SSL...
claude-sonnet-4	`n0dprnk0w8ybx`	$1.444	7m46s	Failure task failed: curl did not download the expected local file content, but instead: curl: (1) Protocol "file" not supported
claude-sonnet-4	`x0ik7krceycks`	$1.051	7m34s	Failure task failed: curl-arm64 is not statically linked
claude-sonnet-4-thinking-16k	`55r7ssuptc9su`	$1.602	9m45s	Success
claude-sonnet-4-thinking-16k	`sas5yp3b4pc5w`	$1.400	10m42s	Failure task failed: curl HTTPS request to google.com did not return content-type: text/html but instead: } [2 bytes data] * SSL...
claude-sonnet-4-thinking-16k	`txt1gpq0kcbpd`	$1.173	7m34s	Success
claude-sonnet-4.5	`ts7soi1bj3oxz`	$2.075	9m12s	Success
claude-sonnet-4.5	`uke7xjdn2uqfg`	$0.976	6m5s	Success
claude-sonnet-4.5	`z34e0nnlqtrn7`	$0.942	5m40s	Success
claude-sonnet-4.5-thinking-16k	`4d5at2gsc419p`	$1.513	8m40s	Success
claude-sonnet-4.5-thinking-16k	`hjiyd7cnuvr2j`	$1.025	8m7s	Success
claude-sonnet-4.5-thinking-16k	`nzsj7nnygmfws`	$1.197	6m58s	Success
deepseek-v3.1	`94hw002wxemh7`	$0.908	4m56s	Failure task failed: curl-arm64 is not statically linked
deepseek-v3.1	`iuj4rqve9knw2`	$1.353	5m10s	Failure task failed: curl-arm64 is not statically linked
deepseek-v3.1	`p676hsb8c2zth`	$0.373	2m41s	Failure task failed: curl binary does not exist
deepseek-v3.1-terminus	`1now9qmnbdqjq`	$0.305	6m6s	Failure task failed: curl-arm64 is not aarch64 architecture
deepseek-v3.1-terminus	`3u6vja8oatoje`	$0.816	16m21s	Failure task failed: curl-arm64 is not statically linked
deepseek-v3.1-terminus	`80atm1el63hiv`	$0.074	3m39s	Failure task failed: curl binary does not exist
gemini-2.5-flash	`0zyb1j65mwyw8`	$0.060	1m31s	Failure task failed: curl binary does not exist
gemini-2.5-flash	`qjc3xwwj9kd6n`	$0.217	5m1s	Failure task failed: curl-arm64 is not aarch64 architecture
gemini-2.5-flash	`xn6520d9u9w96`	$0.119	4m26s	Failure task failed: curl binary does not exist
gemini-2.5-flash-thinking	`8irl6e3lohykm`	$1.167	28m53s	Failure exceeded max tool calls (150)
gemini-2.5-flash-thinking	`oazj2i1mai0j1`	$0.051	1m54s	Failure task failed: curl binary does not exist
gemini-2.5-flash-thinking	`v7aq6aahnzty3`	$1.412	39m19s	Failure exceeded max tool calls (150)
gemini-2.5-pro	`gcb5jutrbg7a2`	$0.427	5m23s	Failure task failed: curl binary does not exist
gemini-2.5-pro	`nvzu1oyk5zuem`	$0.625	6m32s	Failure task failed: curl binary does not exist
gemini-2.5-pro	`reodc0zqt7bmh`	$0.276	3m28s	Failure task failed: curl binary does not exist
glm-4.5	`dh5tp7nzcfyu8`	$0.062	1m20s	Failure task failed: curl binary does not exist
glm-4.5	`jjoeijpcldd4e`	$0.027	54s	Failure task failed: curl binary does not exist
glm-4.5	`xvxegfcsk9paq`	$0.195	6m34s	Failure task failed: curl binary does not exist
gpt-4.1	`23c79erjmirn6`	$0.252	1m34s	Failure task failed: curl binary does not exist
gpt-4.1	`331320zw96chp`	$0.037	45s	Failure task failed: curl binary does not exist
gpt-4.1	`j9tb1imlbyga2`	$0.122	1m11s	Failure task failed: curl binary does not exist
gpt-4.1-mini	`0p9s0zbpxhkl2`	$0.035	1m37s	Failure task failed: curl binary does not exist
gpt-4.1-mini	`azgepyb5or5dc`	$0.029	58s	Failure task failed: curl binary does not exist
gpt-4.1-mini	`ff6i96z03vwjm`	$0.244	3m51s	Failure task failed: curl binary does not exist
gpt-5-codex-high	`0por81ik8r33z`	$0.392	6m51s	Success
gpt-5-codex-high	`iumt0u8y0x56r`	$0.600	9m12s	Success
gpt-5-codex-high	`w3ptavgcxglkg`	$0.571	7m57s	Success
gpt-5-high	`3k0rnfimwqtzm`	$0.251	6m57s	Success
gpt-5-high	`5z34td35fkopt`	$0.728	17m6s	Failure task failed: curl HTTPS request to google.com did not return content-type: text/html but instead: } [2 bytes data] * SSL...
gpt-5-high	`dyuosdlxz9gzh`	$0.498	11m34s	Success
gpt-5-mini-high	`r1vkvqt6myjg6`	$0.131	12m19s	Failure task failed: curl HTTPS request to google.com did not return content-type: text/html but instead: } [2 bytes data] * SSL...
gpt-5-mini-high	`rcpzkwha9jhcy`	$0.216	19m26s	Failure task failed: curl HTTPS request to google.com did not return content-type: text/html but instead: } [2 bytes data] * SSL...
gpt-5-mini-high	`ufbv6bpjtz17v`	$0.392	25m14s	Failure task failed: curl HTTPS request to google.com did not return content-type: text/html but instead: } [2 bytes data] * SSL...
gpt-5-mini-minimal	`4xn3ha3h42whs`	$0.012	1m31s	Failure task failed: curl binary does not exist
gpt-5-mini-minimal	`7tmn4bgpvxo5u`	$0.020	3m38s	Failure task failed: curl binary does not exist
gpt-5-mini-minimal	`8hzjgjkn6nunc`	$0.008	1m1s	Failure task failed: curl binary does not exist
gpt-5-minimal	`bk3ie9u6k63e7`	$0.129	5m4s	Failure task failed: curl-arm64 is not statically linked
gpt-5-minimal	`jgwom85utb9ta`	$0.087	2m54s	Failure task failed: curl-arm64 is not statically linked
gpt-5-minimal	`pcf1nmec989qv`	$0.100	3m18s	Failure task failed: curl-arm64 is not aarch64 architecture
gpt-oss-120b-high	`i120kwp1s3rn3`	$0.176	5m23s	Failure task failed: curl binary does not exist
gpt-oss-120b-high	`phn453rj2l3j5`	$0.100	4m22s	Failure task failed: curl-arm64 is not statically linked
gpt-oss-120b-high	`vr19hdn7lsqrx`	$0.394	12m35s	Failure task failed: curl binary does not exist
grok-4	`pzj91ruap1va2`	$0.424	6m31s	Failure task failed: curl-arm64 is not statically linked
grok-4	`qcleqkmmkoxqq`	$0.566	5m27s	Failure task failed: curl binary does not exist
grok-4	`whc01txfz0nhf`	$1.041	10m29s	Success
grok-4-fast	`goslna8yzillz`	$0.122	12m9s	Failure task failed: curl-arm64 is not statically linked
grok-4-fast	`nlx8zgczwake7`	$0.154	12m30s	Failure task failed: curl-arm64 is not statically linked
grok-4-fast	`v9363tp2bec6k`	$0.135	15m31s	Failure task failed: curl-arm64 is not statically linked
grok-code-fast-1	`c407pip6g163y`	$0.046	4m6s	Failure task failed: curl binary does not exist
grok-code-fast-1	`tszkapunxdpc1`	$0.037	13m18s	Failure task failed: curl-arm64 is not statically linked
grok-code-fast-1	`wl5b2ghozu4pt`	$0.085	14m31s	Failure task failed: curl binary does not exist
kimi-k2-0905	`5hmymo0y0vbcc`	$6.522	12m14s	Failure task failed: curl-arm64 is not statically linked
kimi-k2-0905	`5ifjgcd2svzqv`	$0.000	8s	Failure task failed: curl binary does not exist
kimi-k2-0905	`qvu3rj8xq9dyr`	$1.585	11m45s	Failure task failed: curl-arm64 is not statically linked
qwen3-max	`4cubhw9i20g2t`	$6.347	10m14s	Failure task failed: curl-arm64 is not statically linked
qwen3-max	`h8i32qg45yhim`	$10.318	11m2s	Failure exceeded max cost dollars (max=$10.00, current=10.32)
qwen3-max	`mya4f518xv9nh`	$0.309	2m50s	Failure task failed: curl-arm64 is not statically linked