X-Original-To: alpine-devel@lists.alpinelinux.org Delivered-To: alpine-devel@mail.alpinelinux.org Received: from mail-bw0-f54.google.com (mail-bw0-f54.google.com [209.85.214.54]) (using TLSv1 with cipher RC4-SHA (128/128 bits)) (No client certificate requested) by mail.alpinelinux.org (Postfix) with ESMTPS id CF264C16427 for ; Sun, 22 May 2011 14:53:03 +0000 (UTC) Received: by bwz12 with SMTP id 12so5940639bwz.13 for ; Sun, 22 May 2011 14:36:34 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:in-reply-to:references:date :message-id:subject:from:to:cc:content-type :content-transfer-encoding; bh=M5YkGnR5wvbSSnPcSeXS1+OdTrmz/vBiwYnRhR8CRLU=; b=o4nQSp92ynUjT8QW88f3DJ79ZOwLzYwR49/bSYPkii8AAbQ8mKaVplwtUSKz9sujG1 4bdSdR4KTzNXdSj5WiusGwjLNjza7WMXjW1eoLRZPrbdN/FS8CglYsrtL1fzhQavlewm 7JB12tVv7Uok1CETN+xNSKgXD/nyDXGCEkNlw= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type:content-transfer-encoding; b=hXJOHGvYGotK50bF3RI84io2og5TveCmBcexWoxCwrB0Sglmjqcy4KebYwRte58LAU e4i79YM1e9Rxkisl29uzvko9nK4KFbtUuYd1AiEmWO9JgCRi/BFpGcxjdWR9zLbZ+Skk 2k8ztEN4bL5AcWwhKpr1KH5KNE8SnMhNHIRyE= X-Mailinglist: alpine-devel Precedence: list List-Id: Alpine Development List-Unsubscribe: List-Post: List-Help: List-Subscribe: MIME-Version: 1.0 Received: by 10.204.20.70 with SMTP id e6mr1543987bkb.145.1306100194250; Sun, 22 May 2011 14:36:34 -0700 (PDT) Received: by 10.205.83.79 with HTTP; Sun, 22 May 2011 14:36:34 -0700 (PDT) In-Reply-To: <20110225092433.05e1a98c@alpinelinux.org> References: <4D66E7BB.1060908@anselsystems.com> <20110225092433.05e1a98c@alpinelinux.org> Date: Sun, 22 May 2011 17:36:34 -0400 Message-ID: Subject: Re: [alpine-devel] Distfiles mirror From: Jeff Bilyk To: Natanael Copa , Andrew Manison Cc: Alpine Development Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable On Fri, Feb 25, 2011 at 4:24 AM, Natanael Copa wrot= e: > On Thu, 24 Feb 2011 18:20:27 -0500 > Andrew Manison wrote: > >> I have developed a script, intended >> to be run at regular intervals, which goes through the aports tree >> and builds all packages. > > Nice! > >> The current run has failures and the build >> logs from them are being mailed to the maintainers, as well as to the >> list. > > I wonder if we want direct those emails to a second list. Alpine-build@lists.alpinelinux.org is now set up if that's a direction that we would want to take. Same subscription process as with the other lists. Since there seems to be small bursts of traffic, i'd suggest that we start using a 2nd list for the build reports, and have anyone who has git commit access or has contributed to packages subscribe to the list. > >> Many of the failures are due to missing source archives. At >> present, the distfiles mirror (distfiles.alpinelinux.org/distfiles) >> is quite out of date. > > Shouldn't really be out of date. The distfiles dir is shared among my > ncdev verserver and the build-* vservers. So far nothing gets deleted > from there. > >> If the primary source goes offline we have no >> archived copy of it. There a two remedies to this: either make sure >> that the source tarball is on the distfiles mirror, or update the >> package to the current release. If the latter course is taken, the >> source tarball still need to find its way onto the distfiles mirror >> to preserve it for future builds. > > We need archive for all git tags yes. I have an idea how to solve this > which I will come back to. > > I also thik we could split the task in 2: > 1. verify source URL is still valid. > 2. verify that sources builds. > > For checking source url I have implemented 'abuild sourcecheck' I think > we could have a separate run of sourcecheck on all packages from a cron > job. > >> At one point I had the build down to just two failing packages. Now >> it's up to 30 in main and 8 in testing. I am available to work with >> the maintainers to get the builds working. > > Good. Lets get those packages fixed. > >> Sometimes it's a matter of >> missing dependencies in the APKBUILD script, that don't show up >> because the packages are installed on the maintainers system. > > This should be detected when the build-edge autobuilds it. > >> Others >> are due to mutually exclusive packages. For example, libiconv is >> remarkably 'sticky' and once installed for a build sometimes fails to >> uninstall. > > libiconv is an evil package and for that reason blacklisted in gentoo > embedded (this was one of the reason we left gentoo for building alpine) > > The problem is that when some of your packages was built, libiconv was > auto detected and pulled in. Those packages shouldn't have the libiconv > dependency in the first place but once they are there the system is > messed up. > >> My goal is to make it so that it is easy to setup a build server, >> point it at the git repository, and build all the packages for edge >> or a given release. I'm not there yet, but getting closer. > > Ok, let us help you to get there. > >> In harmony >> with Nataneal's earlier email, this would fit well with the proposed >> team structure, and provide some redundancy to the build and release >> process. This periodic total build would belong to the 'stable >> maintainers' sub-team of the developers team, while the total build >> is a useful step as part of the release process. > > Or we could have a "quality assurance team" or "testing team" that does > regression testing and such. > > Thanks alot! > > -nc > > > --- > Unsubscribe: =A0alpine-devel+unsubscribe@lists.alpinelinux.org > Help: =A0 =A0 =A0 =A0 alpine-devel+help@lists.alpinelinux.org > --- > > --=20 Jeff --- Unsubscribe: alpine-devel+unsubscribe@lists.alpinelinux.org Help: alpine-devel+help@lists.alpinelinux.org ---