Date: Sat, 26 Jul 2025 15:58:18 +0100
From: Naomi Rennie-Waldock <naomi.renniewaldock@gmail.com>
To: ~alpine/users@lists.alpinelinux.org
Subject: Re: Illegal instruction on running vaultwarden on RPI (aarch64)
User-Agent: Thunderbird for Android
In-Reply-To: <20250725120957.6e0e293a@baryte>
References: <20250725094929.2abbb421@baryte> <20250725113320.6b69e6f9@bonsai.doitto.me.uk> <20250725120957.6e0e293a@baryte>
Message-ID: <01D48CB4-56E1-4229-8569-88494A66814E@gmail.com>
MIME-Version: 1.0
Content-Type: text/plain;
 charset=utf-8
Content-Transfer-Encoding: quoted-printable

On 25 July 2025 12:09:57 BST, Maximilian Friedersdorff <max@friedersdorff=
=2Ecom> wrote:
>On Fri, 25 Jul 2025 11:33:20 +0100
>Ian Smith <m4r35n357@gmx=2Eco=2Euk> wrote:
>
>> You _might_ get some more information from strace or ltrace=2E
>
>Trying this! Not gonna spam the whole output here but the last few
>lines:
>
>```
>openat(AT_FDCWD, "/lib/libz=2Eso=2E1", O_RDONLY|O_LARGEFILE|O_CLOEXEC) =
=3D -1 ENOENT (No such file or directory)
>openat(AT_FDCWD, "/usr/local/lib/libz=2Eso=2E1", O_RDONLY|O_LARGEFILE|O_C=
LOEXEC) =3D -1 ENOENT (No such file or directory)
>openat(AT_FDCWD, "/usr/lib/libz=2Eso=2E1", O_RDONLY|O_LARGEFILE|O_CLOEXEC=
) =3D 3
>fcntl(3, F_SETFD, FD_CLOEXEC)           =3D 0
>fstat(3, {st_mode=3DS_IFREG|0755, st_size=3D133008, =2E=2E=2E}) =3D 0
>read(3, "\177ELF\2\1\1\0\0\0\0\0\0\0\0\0\3\0\267\0\1\0\0\0\0\0\0\0\0\0\0\=
0"=2E=2E=2E, 960) =3D 960
>mmap(NULL, 200704, PROT_READ|PROT_EXEC, MAP_PRIVATE, 3, 0) =3D 0x7faf4e90=
00
>mmap(0x7faf518000, 8192, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED, 3, =
0x1f000) =3D 0x7faf518000
>close(3)                                =3D 0
>mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) =
=3D 0x7fafc4d000
>mprotect(0x7fafc52000, 4096, PROT_READ) =3D 0
>mprotect(0x7fafb85000, 40960, PROT_READ) =3D 0
>mprotect(0x7fafa38000, 462848, PROT_READ) =3D 0
>mprotect(0x7faf63d000, 12288, PROT_READ) =3D 0
>mprotect(0x7faf5f4000, 32768, PROT_READ) =3D 0
>mprotect(0x7faf5a7000, 16384, PROT_READ) =3D 0
>mprotect(0x7faf549000, 4096, PROT_READ) =3D 0
>mprotect(0x7faf518000, 4096, PROT_READ) =3D 0
>mprotect(0x55848e4000, 1753088, PROT_READ) =3D 0
>set_tid_address(0x7fafc55e80)           =3D 11689
>getrandom("\x4d\xb3\xb9\xbf\x87\xe3\xec\x20\xc1\xac\x31\x55\xc5\xf9\x13\x=
68\x03\x5d\x6f\x1b\x05\x3c\x7c\xc5\x03\x5e\xc8\xba\x09\xd1\x35\xbd", 32, GR=
ND_NONBLOCK) =3D 32
>--- SIGILL {si_signo=3DSIGILL, si_code=3DILL_ILLOPC, si_addr=3D0x7faf6129=
68} ---
>+++ killed by SIGILL +++
>Illegal instruction
>```
>
>I'm none the wiser to be honest!  I did try gdb also:
>
>```
>gdb vaultwarden
>[noise]
>
>Reading symbols from vaultwarden=2E=2E=2E
>(No debugging symbols found in vaultwarden)
>(gdb) run
>Starting program: /usr/bin/vaultwarden
>
>Program received signal SIGILL, Illegal instruction=2E
>0x0000007ff79bc968 in ?? () from /usr/lib/libmimalloc-secure=2Eso=2E2
>(gdb) bt
>#0  0x0000007ff79bc968 in ?? () from /usr/lib/libmimalloc-secure=2Eso=2E2
>#1  0x0000007ff79ba7f8 in ?? () from /usr/lib/libmimalloc-secure=2Eso=2E2
>#2  0x0000007ff7fa8368 in do_init_fini (queue=3D<optimized out>)
>    at ldso/dynlink=2Ec:1610
>#3  0x0000007ff7fa9240 in __libc_start_init () at ldso/dynlink=2Ec:1623
>#4  0x0000007ff7f5d03c in libc_start_main_stage2 (main=3D0x5555c46fe8,
>    argc=3D1, argv=3D0x7ffffffc08) at src/env/__libc_start_main=2Ec:92
>#5  0x0000000000000000 in ?? ()
>Backtrace stopped: previous frame identical to this frame (corrupt stack?=
)
>```
>
>Based on that it seems maybe a problem in mimalloc2?  I tried
>re-installing that, maybe it had become corrupted or something, but no
>change in behaviour=2E  `vaultwarden` is the only package on this system
>depending on mimalloc2, so a bug/problem in that library doesn't seem
>inherently insane=2E
>
>Max

Are you able to try rebuilding the mimalloc2 with -DMI_NO_OPT_ARCH=3DON ad=
ded to the cmake arguments?

In this section:
https://gitlab=2Ealpinelinux=2Eorg/alpine/aports/-/blob/3=2E22-stable/comm=
unity/mimalloc2/APKBUILD?ref_type=3Dheads#L48

If not, I should have time to test tomorrow=2E