Received: from griffin.geeknet.cz (griffin.geeknet.cz [94.142.237.48]) by nld3-dev1.alpinelinux.org (Postfix) with ESMTPS id 4EF41780DE5 for <~alpine/users@lists.alpinelinux.org>; Wed, 3 Nov 2021 11:26:49 +0000 (UTC) Received: by griffin.geeknet.cz (OpenSMTPD) with ESMTP id ce1a7c97; Wed, 3 Nov 2021 12:26:47 +0100 (CET) DKIM-Signature: v=1; a=rsa-sha1; c=relaxed; d=jirutka.cz; h=subject:to :cc:references:from:message-id:date:mime-version:in-reply-to :content-type; s=mail; bh=LLNpzr5y0gQmpoHQniVRRF7JU/4=; b=u7A8IF ZDeJ640VHsl62nWHbJag/+8fz96Dwgd1LSGhxHtW30khYXZLdDqe5OkwGdiOE5sJ 8Hc6kdoWWEzrKNaUO6w2bu0U8PRNADagZ4mUHQqPQNR72BF8nwxCkJzI1JA7bCgC jem86WQo+CEj7g8AdfxqAULu4QPt2lPfWdQa0= DomainKey-Signature: a=rsa-sha1; c=nofws; d=jirutka.cz; h=subject:to:cc :references:from:message-id:date:mime-version:in-reply-to :content-type; q=dns; s=mail; b=lA06TXf9X7UViZXeAgiFjJWoMaua8pJv ZGO4LoxV70KuO+uTUJe9Cf/0g6rKyTB2fAjkf2QNfWf1kYAqsAyRuqz3n47rEvqN XY6yfzwYKnVXshgTnTn3ad/EuwXQPgzlMd2LK7+lpTMGo024ZrywLjT4LA+Wgn4O 23pbwl7Crl8= Received: by griffin.geeknet.cz (OpenSMTPD) with ESMTPSA id 23c5073d (TLSv1.3:TLS_AES_256_GCM_SHA384:256:NO); Wed, 3 Nov 2021 12:26:47 +0100 (CET) Subject: Re: Alpine Linux general performances To: =?UTF-8?Q?=c3=89loi_Rivard?= , Ariadne Conill Cc: ~alpine/users@lists.alpinelinux.org References: <6df8863e77b970b466dbfc9a3a5c2bcec3199f48.camel@aquilenet.fr> <4dcedd5d-e2ce-e8e-e231-874997bbe9f6@dereferenced.org> From: Jakub Jirutka Openpgp: preference=signencrypt Autocrypt: addr=jakub@jirutka.cz; keydata= mDMEXTx3jBYJKwYBBAHaRw8BAQdAyJmVgj7DHR6w2TLD0/37Es0RePi5EzT/7r8AHyTmXhK0 IEpha3ViIEppcnV0a2EgPGpha3ViQGppcnV0a2EuY3o+iJgEExYJAEACGwEECwkKBAUVCgkI AwUWAgMBAAIeAQIXgAIZARYhBNeFiRJmnTog9PRr0vlb1nkQTTEVBQJhED+SBQkJd2KGAAoJ EPlb1nkQTTEV0ZMBAJdqXstUoAqJGTAJm4lA74Cy7EYNJFNLL144GqeYaH+jAPsG0q/Y5eYt w2Ki0a3CC2VR+IQfC35/qajyDunYM1XCAbQkSmFrdWIgSmlydXRrYSA8amlydXRqYWtAZml0 LmN2dXQuY3o+iJUEExYJAD0CGwEECwkKBAUVCgkIAwUWAgMBAAIeAQIXgBYhBNeFiRJmnTog 9PRr0vlb1nkQTTEVBQJhED+SBQkJd2KGAAoJEPlb1nkQTTEVtEgBALqAMdtyiAQ6fhfIgm4a q3/eHPCjbQ4IJGZEqGJv0Y9FAP4leBvyDRMzjuZ0UFxgA6Jhe2KZ11+il7eDE/hSrGeaDrQp SmFrdWIgSmlydXRrYSA8amFrdWIuamlydXRrYUBkYXRhbW9sZS5jej6IeAQwFgkAIBYhBNeF iRJmnTog9PRr0vlb1nkQTTEVBQJhEECZAh0gAAoJEPlb1nkQTTEVKTQA/Rt1llQafW66lmq6 M8T4o5W+D3yMSzjsVFfPQamQr4+RAQD/yCWPty9xq+pUqLa+f82uo4stntL89nFvF8mH6nr2 B7QpSmFrdWIgSmlydXRrYSA8amFrdWIuamlydXRrYUBmaXQuY3Z1dC5jej6IlgQTFgkAPhYh BNeFiRJmnTog9PRr0vlb1nkQTTEVBQJhEECDAhsBBQkJd2KGBQsJCAoHBRUJCgsIBRYCAwEA Ah4BAheAAAoJEPlb1nkQTTEVoBoA/itzK17bT+dAvAKkKzCPF6EfE9++FpgLk8JnvWD6jl+F AP4vjp05WsdPat7qZJtXFvkHDESI55LJvRMyMurEO/ULDrkBjQRdPHe4AQwAyNlnBplbnolj R1Qoam3Qwy/wC6GdQCGuA6nEUIVdtp9dfMC0Yz8zQFkjF/EA0p4hE+BkrxTyo19GayzwSlFr VVZwrkgFMpZ9LZs2Q6XAvmzsigznUF+1TfA3xj/YsXtp7gKUbKSDcYm24bAkSlfmkrcB7F0m J32rLxL7IPvPQ+iI8fjjlGogO8KOtRepTCpcnTJjtvoGcsnFVLkXyIQEQr/xe1MGNkr2TGaE UeEC3NW/9JRBwE3SW8lQ2U8MhBWpCflLv9h6uM3DatLhVAERuKvkzQmlW0FKX5P9Zw0huQoP 4wps3KlteEjmfpIqnWVED42FDsCUucxLk1z6E+nc3ZmgesCiP/yjl/YdU806mjf5EwZ4sYtI RxB3xTnDor8YomH/epLLv/vDdmDtOQq0vmFzDbiazvGVGmVWSPMo4YnhbfEXRAS/pBxGTQz0 or/0iWdvprc78oDco4qZpkcO2q9vpIsmG2bwCqG3+v9+GLI4lNE0nHQXfhMWwS0jltW/ABEB AAGIfgQYFgoAJhYhBNeFiRJmnTog9PRr0vlb1nkQTTEVBQJdPHe4AhsMBQkDwmcAAAoJEPlb 1nkQTTEVYs4BALS0QAnLDKT4+QmyGr9ZPsE0SZgQ+ik8AjCmtUSORRCTAP0VSVe0lnWwwY10 4PR9A+ZbADiYn3+z6/0OnEkocuiFBYh+BBgWCQAmAhsMFiEE14WJEmadOiD09GvS+VvWeRBN MRUFAmEQPaUFCQl3YG0ACgkQ+VvWeRBNMRUIxwD/UcIapa7c5lFk2Tg/q+XlZH/5pKU/uOGj VxzHvs+8naMBAPo8LZT02iL6uTkecw1rk0Jc98MEDl0wfWCTtj6KDlQAuQGNBF08d90BDAC5 ixk/+Ll/TnEIy2qvTWkDIsWXpWm8MMtG8j7LdLv/53sQ79YAcycyoKSfSM2vetiW+h1GQx/S 3YfRBq8kRbWeiUQbo5gMabnkRLTqIn+m53rxExgvmAyNvAdgDakbay0NX43mO1xcLH7OsCz8 KSElnkzjSORawov56XdwBm4ojHYJcodXSmEz7qJ886HUorzgWES1kQ4GgOuwLODs2cHgzx6g hCdPTZtCDVfgg70U5e0rFMBxvwiN9nx6RlOCqxePgL1TsrsBv4XfCptDPvtLOp5kI1NU6ATR zzcWxOEGz+3D1N5T3z8mvWHp6c1+Iqi3ipsu/U0lCLwhSWdIgU187VApBMEfC/XR6dKfJuqV dHljZL28JFqkwootsnpAZTm9uUIBUJQ0p+KMmQloPUXGENDzO4yjDeMwPMLsYUH2I4V7Uqio ex8KnSExisXAgN3Wnz+Ci1yzkSGgFJTN5gV8QU00ox2aNwjatr/ftGXGixx654Q+vpPBQjBU 0B4Va9MAEQEAAYkCNAQYFgoAJhYhBNeFiRJmnTog9PRr0vlb1nkQTTEVBQJdPHfdAhsCBQkD wmcAAcAJEPlb1nkQTTEVwPQgBBkBCgAdFiEEv7UV5T50WUImhovnefKZsENajiMFAl08d90A CgkQefKZsENajiPD8wv/RS7+f8XXQQXh/raTSyRTrJzrpoP7fmq82hrVjMIW/BvRn04mMrb8 SCun7rXR0CdSpCkgtVi0ZSQjJIYg8DRT2T+R1lUgPoeTJQyH6zZFHO1RQpjVuBQEJ/uDnWdJ RCI1tO7qNSJaNsoaN8QXYO5hdmEV/ZKYNJBUuJ+tVZPD9ysa+E5lJm2DkHqwje0HGsf32Jig /8O34fGhNfUSRLqLEhlt4jj9J+SHmrXi+vXPthdyWY2p78JpKMwG4sFrvWmDufwEs5vEtxqV ZPpJn1IuQbAZTujhmIZg9Dn8AmBy/oSKT15kZ2OIxP9qO+BastypuQ043wTtWvawxaYSOAKX HWidzzjL+9GymCygaVOdVwlymrjFBLQtz7TlR0//cbot5tHIIA4wSg2I5ICuZdIBwh7LVbGZ m9R0I81JT2a0dy8VoTho8X6COs+CQQmZA8YIn6d8aKM8ir98Q5MZHQSRsspf8fEVMZAzHDQ0 ghxdUcXJenkhUF38VGHqe9VT68Bw/SEBAPIMnmCGhRSMz8jP7Pxc1dTFFl4ZTic6qH9WDCDK ovwNAQDOY8alqx0Aei84zpCcQ2xlGd66RxbJqsU0/iVfkwb2BIkCNAQYFgkAJgIbAhYhBNeF iRJmnTog9PRr0vlb1nkQTTEVBQJhED2zBQkJd2BIAcDA9CAEGQEKAB0WIQS/tRXlPnRZQiaG i+d58pmwQ1qOIwUCXTx33QAKCRB58pmwQ1qOI8PzC/9FLv5/xddBBeH+tpNLJFOsnOumg/t+ arzaGtWMwhb8G9GfTiYytvxIK6futdHQJ1KkKSC1WLRlJCMkhiDwNFPZP5HWVSA+h5MlDIfr NkUc7VFCmNW4FAQn+4OdZ0lEIjW07uo1Ilo2yho3xBdg7mF2YRX9kpg0kFS4n61Vk8P3Kxr4 TmUmbYOQerCN7Qcax/fYmKD/w7fh8aE19RJEuosSGW3iOP0n5IeateL69c+2F3JZjanvwmko zAbiwWu9aYO5/ASzm8S3GpVk+kmfUi5BsBlO6OGYhmD0OfwCYHL+hIpPXmRnY4jE/2o74Fqy 3Km5DTjfBO1a9rDFphI4ApcdaJ3POMv70bKYLKBpU51XCXKauMUEtC3PtOVHT/9xui3m0cgg DjBKDYjkgK5l0gHCHstVsZmb1HQjzUlPZrR3LxWhOGjxfoI6z4JBCZkDxgifp3xoozyKv3xD kxkdBJGyyl/x8RUxkDMcNDSCHF1Rxcl6eSFQXfxUYep71VPrwHAJEPlb1nkQTTEV7jEBAIuF LjQgBQqXNJ0QEhhLjBgsgmUQZ3WMY6cm+AFqgRuHAP9G+n+JkF+JxDWJLbY3N7B2l6S7BaKW ezza5jqUCp6tCLkBjQRdPHgsAQwApA2i6aZVOa/sOtveGmNStDSylZtXbMfzDEpdg7rwyq6l cGs7D8xEZJrJj0H25zUJzGVDfI3IfnQYNabAlRfseqBS2JJvjOVzy7wFmLKmrOGZ571MURM+ SieTd6DLQb07+46/m65f94ItE9A007j9JqI788JTWwC1gQhrsK6JmhOOOsdvZRcoGFd9ENwa OuXJkMnBFpug3EHmhKEtxFXRx19LjpuREX8930p2+Io9tL4KJV2+r4RJ/C3xUwWG5ErkJwRW Gd5eOYIqHYegll9mxxgcc6+THWwLM2toulU8SWdQ1qNwFcaLAThdR4941/NL0QiOkPf+6SQM oNWmSArhO34wrPkDfMum2U/UB1EFrBB/eNWIuGh9bzDc744zdD7P0ERz8AbzJjE22MHa7yz2 r3Blf442F7Bc9o0AJwYiUUHPoaJd5YTbyvFQchuhGaN1hB4TLH9n3iyuL6iJwE3rvolvcASE L+73qf24PHpXtMX8MhWu9+gVaH68uKtOqIz/ABEBAAGIfgQYFgoAJhYhBNeFiRJmnTog9PRr 0vlb1nkQTTEVBQJdPHgsAhsgBQkDwmcAAAoJEPlb1nkQTTEV260BAItJ2AO0xuE9GsfnJQAw 5+juYsvzDRzeZXW2UdKuq3OAAQDV2X8BFduxeWHsjyAzdVT+icjxJYxUWEYZks1+OxD5Coh+ BBgWCQAmAhsgFiEE14WJEmadOiD09GvS+VvWeRBNMRUFAmEQPbMFCQl3X/kACgkQ+VvWeRBN MRVISAD+IL0KYzpOFdbUHHPbgaWaOdIvifxzbxvTxPkixJBtT34BAJqa5pDudq99qbVueLqj Oi5b1JL0j2noJljRzmNxCS8DuQGLBF08x6kBDADMTgFFkwT2KIWXf+WYH1sQ6hsBLiwwKYjv S/X9gWmIdxA6Kn32ye7ssd/GP4m7GfVgVX2wr5VTNR9K1v+k7R5Cqkk2EbWYekB1TB6B7VZb D20gc4P3qpv0oLQcIVoqWg68dGEGMYYhTaMx5HKKP8QS1HJHRbe9pRsZEdOsijEBlCBYyGe8 IMOMO0SwdaaCPSqhM+ZLFrBpKZbCYMUlQWqsLCENsUx83kaz2oe2h92mpKY9e2G7S6AA0zGy 1RIyc1ti/x3a+PkdYhehTFWyRqIssZrrk6kVSyNg5qGOfphFdsKYC6EK3KU1EVH1SnpiPIC1 kdPiW/PUC0+c/JyklLH5gIniJfafvwiNihX+3HKFNAl/PCWb3GN3/Cy0rhC+h3tkiPMZ3s8D KgDvC5Ntiljueg+B20EYde4nHbmsE6qwk8M9kCh5Ev8/++BMDMZEnNg1qsI1EcolIAN5IUeK OXFrCEBnKmAC0d/JnXmYvB1Wqz5sv9DX30sG9v0IxBMMipcABiOIeAQYFggAIBYhBNeFiRJm nTog9PRr0vlb1nkQTTEVBQJdPMepAhsgAAoJEPlb1nkQTTEVPPgBAOZbf1jNYybRw8QOqjB/ RFnqzmw0xCCqmupdbayyddBYAP0akn7w+b0PRsB5K+jPmOSxF0AwAzs1HujupldHywWUBA== Message-ID: <104c22a5-a0e7-bd1a-9506-a66222fef718@jirutka.cz> Date: Wed, 3 Nov 2021 12:26:34 +0100 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:60.0) Gecko/20100101 Thunderbird/60.8.0 MIME-Version: 1.0 In-Reply-To: Content-Type: multipart/signed; micalg=pgp-sha384; protocol="application/pgp-signature"; boundary="NaKeLXXo5ndfzt45q0wEqs783MLnh7yXC" This is an OpenPGP/MIME signed message (RFC 4880 and 3156) --NaKeLXXo5ndfzt45q0wEqs783MLnh7yXC Content-Type: multipart/mixed; boundary="fEJv9UPVPqu9K0stUgUSAUVdBrFD8qwca"; protected-headers="v1" From: Jakub Jirutka To: =?UTF-8?Q?=c3=89loi_Rivard?= , Ariadne Conill Cc: ~alpine/users@lists.alpinelinux.org Message-ID: <104c22a5-a0e7-bd1a-9506-a66222fef718@jirutka.cz> Subject: Re: Alpine Linux general performances References: <6df8863e77b970b466dbfc9a3a5c2bcec3199f48.camel@aquilenet.fr> <4dcedd5d-e2ce-e8e-e231-874997bbe9f6@dereferenced.org> In-Reply-To: --fEJv9UPVPqu9K0stUgUSAUVdBrFD8qwca Content-Type: text/plain; charset=utf-8 Content-Language: en-GB Content-Transfer-Encoding: quoted-printable Hi, about the allocator: another option is mimalloc [1] which performs even b= etter than jemalloc, can be built in secure mode (adding guard pages, ran= domized allocation, encrypted free lists, etc. to protect against various= heap vulnerabilities) and IIRC it=E2=80=99s also smaller. I=E2=80=99ve a= lready packaged it, but it=E2=80=99s still in testing and not used by any= package. There are two versions of mimalloc in two variants: mimalloc1 [2] =E2=80=93 stable release of mimalloc built in secure mode mimalloc1-insecure [3] - stable release of mimalloc built in insecure (de= fault) mode mimalloc2 [4] - beta release of mimalloc built in secure mode mimalloc2-insecure [5] - beta release of mimalloc built in insecure (defa= ult) mode Upstream consider the insecure mode as the default, I=E2=80=99ve swapped = it, so the default and preferred variant is the secure mode. According to= the docs, secure mode has ~10 % performance penalty. About performance in general: the other cause of worse performance is tha= t most packages are built with -Os (gcc/clang option to optimize for size= =E2=80=93 enables all -O2 optimizations except those that often increase= code size) instead of -O2 or -O3 that is used by everyone else. However,= this most likely doesn=E2=80=99t affect your benchmark with compiling py= thon in any way. The problem is that -Os is the default option on Alpine,= we use -O2 only in some arbitrary packages =E2=80=93 when the maintainer= or one of devs comes to the conclusion that it=E2=80=99s truly nonsense = to sacrifice performance for a very small size difference in a package th= at is tens of megabytes in size (e.g. PostgreSQL) and/or some users compl= ained about bad performance (e.g. Node.js). And there are more problems r= elated with -Os and the fact that almost no upstream takes into account t= his option. Personally, I=E2=80=99d like to change this default, but I ha= ven=E2=80=99t started discussion on this topic yet =E2=80=93 I=E2=80=99ll= do it later, out of the ML first, now I=E2=80=99m too busy with preparat= ions for v3.15 release. Jakub [1]: https://github.com/microsoft/mimalloc [2]: https://pkgs.alpinelinux.org/packages?name=3Dmimalloc1&branch=3Dedge= [3]: https://pkgs.alpinelinux.org/packages?name=3Dmimalloc1-insecure&bran= ch=3Dedge [4]: https://pkgs.alpinelinux.org/packages?name=3Dmimalloc2&branch=3Dedge= [5]: https://pkgs.alpinelinux.org/packages?name=3Dmimalloc2-insecure&bran= ch=3Dedge On 11/2/21 8:10 PM, =C3=89loi Rivard wrote: > Thank you for your valuable answer. I wasn't aware about that security-= performance trade-off. >=20 >> One workaround might be to use jemalloc instead, which is available as= >> a package.=C2=A0 I am investigating a way to make it possible to alway= s use >> jemalloc instead of the hardened malloc for performance-critical >> workloads, but that will require some discussion with the musl author >> which I haven't gotten to yet. >=20 > Interesting. Would that take the form of a musl-jemalloc package for a = system-wide usage? >=20 > Do you have thought on mimalloc and the Emerson Gomes benchmark blogpos= t? --fEJv9UPVPqu9K0stUgUSAUVdBrFD8qwca-- --NaKeLXXo5ndfzt45q0wEqs783MLnh7yXC Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- iQGzBAEBCQAdFiEEv7UV5T50WUImhovnefKZsENajiMFAmGCce8ACgkQefKZsENa jiPWSQv/UO6h2qaxcBS4UTeCzHcDPjtiuWZg4/k7HG3GwKfJ6+y9lYSkdmW8PQG+ sBk8CBsgHiDEp2HlZ2RRMqSHiFA9BdjQvfCxNlegmSM0Gj8kB5WvGhkWnbssDBIi F+GY8dtK8Is5fEL0bt+kGbWx7uWV9VWl39udropZ7WaRI+sdU7djaNMu1rVS6WbB lgAhd4Vf0UJ7nk5zvYjth62MDzg94Z7SRNM4Rm2IydIm2t8o9U7dc1Y4fJElHZif Imc+CRijXJ7Wgiho/fEClaxGa14UbT9F8B+S9N1gS2EKttCLLHhHn0Llxe6nF4OR 5SiZDd16cLQsdlbLlvBLvupoX51oEw9J4CRBbHy5GIit4tWpTWHX06siYxoQh1BR 7fKs6e/P9ufiTjzAiALfeD3FlKUAmFLWPlH7gWpnlacFkExQPH5wiUX3bjhwIY2x gaBA+uqNI4jG3PumKAiHEj3N8g3Mg4/9RmWTqaRmNhX9iaKOF3tlY1GWeq/5t0yp Rjjo9qmy =H1MH -----END PGP SIGNATURE----- --NaKeLXXo5ndfzt45q0wEqs783MLnh7yXC--