To: adelie-devel@lists.adelielinux.org, alpine-devel@lists.alpinelinux.org
From: "A. Wilcox" <awilfox@adelielinux.org>
Subject: [alpine-devel] Seven and the terrible tests
Organization: =?UTF-8?Q?Ad=c3=a9lie_Linux?=
Message-ID: <1bb3300c-3bc1-16ef-80fb-c47bc4108bba@adelielinux.org>
Date: Sat, 17 Feb 2018 18:35:34 -0600
User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:45.0) Gecko/20100101
 Thunderbird/45.2.0
Precedence: list
MIME-Version: 1.0
Content-Type: multipart/signed; micalg=pgp-sha256;
 protocol="application/pgp-signature";
 boundary="2sMl2wlugxO0jqt0p64qIJSojFGw0KjHG"

This is an OpenPGP/MIME signed message (RFC 4880 and 3156)
--2sMl2wlugxO0jqt0p64qIJSojFGw0KjHG
Content-Type: multipart/mixed; boundary="FkLIKf3OCWP4q09F6u81XoXq6IEBe4T96";
 protected-headers="v1"
From: "A. Wilcox" <awilfox@adelielinux.org>
To: adelie-devel@lists.adelielinux.org, alpine-devel@lists.alpinelinux.org
Message-ID: <1bb3300c-3bc1-16ef-80fb-c47bc4108bba@adelielinux.org>
Subject: Seven and the terrible tests

--FkLIKf3OCWP4q09F6u81XoXq6IEBe4T96
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable

Hi there (xpost to both Ad=C3=A9lie and Alpine dev lists),

There are seven packages that we (Ad=C3=A9lie) ship with tests enabled.  =
We
do not know if Alpine would be able to use them, however, due to some
really bizarre problems we've encountered:


* main/attr

The test suite's Perl uses an outdated form of regular expression that
cause modern Perl to crash.  There are also assumptions about the libc
that do not hold in musl.  For this reason, we have two very large
patches to make the tests pass.  I am not sure if these are acceptable.


* main/cmake

The test suite was disabled on 21 September with a commit log message
"disable testsuite, blocking builders on multiple archs".  We haven't
had any issues with it on x86, x86_64, ppc, or ppc64.  Are there any
logs about what happened?  I would be willing to dig in.


* main/kyua

The test suite requires the builders to have a sysctl set:

kernel.core_pattern =3D core.%p

Otherwise, the test fails because 'core' is overwritten during the test
of handling core dumps.


* main/openldap

The test suite takes about two hours on our builders.  The fastest was
ppc64, 1h48m; next was x86_64, 2h3m; next was ppc at 2h4m; last was x86
at 2h41m.

It does pass.


* main/parted

We ported the test suite to Python 3, rewriting large parts of it in the
process.  We have not started a conversation upstream to determine if
this will can be merged or not.


* main/tzdata

The tzdata package needs 'sp', a SGML validator from the mid 90s.  I
spent a full day making it compile with a modern compiler.  Since it
needs the w3.org DTDs as well, I had to override www.w3.org in
/etc/hosts; they throttle requests to take 5 minutes due to lots of
spurious bot traffic trying to download the DTD files.


* main/zsh

The comment on Alpine's side is that "As of 5.4.2 - 3 tests fails".  We
have four tests failing, and we work around that by disabling them:

+       # Does not work with musl due to UTF-8
+       rm "$builddir"/Test/A03quoting.ztst
+       # Does not work with musl due to locale
+       rm "$builddir"/Test/B03print.ztst
+       # Not guaranteed to work portably (requires atime)
+       rm "$builddir"/Test/C02cond.ztst
+       # PowerPC-specific failure
+       rm "$builddir"/Test/V09datetime.ztst
        make test



We will maintain our own copies of the packages that have test suites
that Alpine is not willing to merge.

Best,
--arw

--=20
A. Wilcox (awilfox)
Project Lead, Ad=C3=A9lie Linux
http://adelielinux.org


--FkLIKf3OCWP4q09F6u81XoXq6IEBe4T96--

--2sMl2wlugxO0jqt0p64qIJSojFGw0KjHG
Content-Type: application/pgp-signature; name="signature.asc"
Content-Description: OpenPGP digital signature
Content-Disposition: attachment; filename="signature.asc"

-----BEGIN PGP SIGNATURE-----

iQJMBAEBCAA2FiEEjNyWOYPU1SaTSMHHyynLUZIrnRQFAlqIylYYHGF3aWxmb3hA
YWRlbGllbGludXgub3JnAAoJEMspy1GSK50UQP4P/3/YFpfSTc0KYSNyERfOeUhL
rvok3Yg1qucy2NujccreyI7bqhmKCWD12GFBXCvRg6bH9yjtnJQavs7ySgY09aX1
cimXjwMAcfTRT3E3OAvjYWoPhIhBPZBWCVqizkkM4fhwBh9rzVWGlH4U7x7y6Sxu
+h/HbLIIGYYCtp4DCSXcXaC+qrEW357qzqb6AnOHGEptyYZRRzKBsh0ypWRxnwMB
QZVGIvuCRMIeo2nqID4ST18cvs1/yg9T19Nlm7zGbuADeOEYdtHL6JoOK0eH3GLn
otFIf5pOrKsL8e83674o9odRj0QFf+IeSfsXSZ7CLXVo12u34ZnkeVku0LH1n4aU
5MW+YsD5X5l6apQHMQnKYWQ70pnrMxGojVRbNORY+WkmA2ZD/8TqLp+bUbNHL3W5
DWmhix41bpgjSN2TobpE0OdITxs39ThGSav2CIENOP6gnw9ye8yHQRdoZZ9/+WT2
Vu50wx1+dTV35GWgKA1muFGlMcLZIXmTJWoMPrwumsez+iy3pyfPJ4qoE+yooqQC
eXaXv6kdhzPv3/IS/YjFP7hXZUlIcHJ2ymJNjvxOvJaAkpUOm2lnHiscbD3l8bnu
wxbKOuWRgvwCkdkRAS3njnhlmKEcRPOiN6ZTiBQZcpchihuTCMuachqoN3d+sp+b
SZKqUByiMEyOw1XkdqhM
=gPNK
-----END PGP SIGNATURE-----

--2sMl2wlugxO0jqt0p64qIJSojFGw0KjHG--


---
Unsubscribe:  alpine-devel+unsubscribe@lists.alpinelinux.org
Help:         alpine-devel+help@lists.alpinelinux.org
---