summaryrefslogtreecommitdiffstats
path: root/cron-jobs/sourceballs
AgeCommit message (Collapse)AuthorFilesLines
2010-11-23sourceballs: be less verbosePierre Schmitz1-6/+21
2010-11-23Rewrite sourceballs to increase performance and reliabilityPierre Schmitz1-45/+99
* Decrease file stats as much as possible * Create a list of all packages and meta data only once * Create a list of available source packages only once * Create a list of expected packages only once * Combine all three scripts into one to share data and code * Use as much information from the db files as possible and avoid using svn * Avoid attempting to create the same source package twice Logic works as follows: 1) create a list of all packages 2) Check for each package if we need a src package and create one 3) During this process create a list of all src packages that should be there 4) Diff both lists for the cleanup
2010-11-21sourceballs: Of course sort does only operate on linesPierre Schmitz1-1/+1
2010-11-21sourceballs: Don't write any logPierre Schmitz1-8/+3
This is consistent with the other dbscripts. The output will be send to the mailinglist.
2010-11-20sourceballs: Lock the repo while reading the db filePierre Schmitz1-3/+10
2010-11-20Simplify sourceballs creationPierre Schmitz1-29/+17
* Read package lists directly from DB file * Make SVNREPO configurable
2010-11-20Fix sourceballs cron jobPierre Schmitz1-13/+8
* add unit test for sourceballs and cleanup * introduce SRCPOOL and LOGDIR variables in config
2010-09-13Fix typosPierre Schmitz1-1/+1
2010-09-01Simplify repo configurationPierre Schmitz1-2/+1
* Repositories can now be defined in the config file for each host * added community-staging, gnome-unstable and kde-unstable * Exception is the adjust-permission cron-job; but we might want to use acls in future anyway Signed-off-by: Pierre Schmitz <pierre@archlinux.de>
2010-08-22add makepkg.conf for [multilib]Pierre Schmitz1-1/+1
2010-08-17Add [staging] repositoryPierre Schmitz1-1/+1
2010-08-13Use common functions to print messages, warnings and errorsPierre Schmitz1-1/+1
These functions are copied from makepkg
2010-08-08Use db-functions in create-filelists and sourceballsPierre Schmitz1-27/+6
2010-06-28sourceballs: Added community and community-testing supportEric Bélanger1-1/+1
Signed-off-by: Eric Bélanger <snowmaniscool@gmail.com> Signed-off-by: Pierre Schmitz <pierre@archlinux.de>
2010-03-13sourceballs: Make cleanup more efficientEric Bélanger1-0/+2
Moved all cleanup related code in sourceballs-cleanup script and moved, now common, functions in db-functions. The cleanup script is now ran after all the new sourceballs have been fetched. Signed-off-by: Eric Bélanger <snowmaniscool@gmail.com>
2009-09-26sourceballs: skip based on pkgbase failuresAaron Griffin1-2/+7
If one portion of a split package fails, assume that all packages from the same $pkgbase are going to fail as well and skip them for this run. Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-09-25Fixed test for existence of split package sourcesAaron Griffin1-2/+3
This patch also removes the unused CARCH variable. Signed-off-by: Eric Bélanger <snowmaniscool@gmail.com> [Aaron: Broke srcpkgbase logic into srcpkgname/srcpkgbase to make it more readable] Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-09-22Add a safety check for existence in pkg loopAaron Griffin1-0/+1
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-09-22Set/restore umask in the sourceballs cron jobAaron Griffin1-0/+3
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-09-21Temporarily disable community sourceball generationAaron Griffin1-1/+1
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-09-14Be more careful with config file inclusionDan McGee1-0/+1
We can't really do the basedir magic from db-functions as it is just being sourced and is not the currently executing script. Although a bit repetitive, it is a lot safer to just include the config file everywhere. Noticed this when trying to run the latest available scripts on sigurd. Signed-off-by: Dan McGee <dan@archlinux.org>
2009-09-01sourceballs: explicitly add the 'any' archAaron Griffin1-1/+1
Loop over all arches AND the 'any' arch. Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-08-19Replace pkgname with pkgbase, for split packagesAaron Griffin1-4/+4
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-08-19Use db-functions file everywhereAaron Griffin1-13/+1
This source the config file and gets us functions such as getpkgname which were duplicated elsewhere Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-08-19More makepkg.conf removal - prefer toplevel configAaron Griffin1-6/+0
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-07-23Use the top level config file for cron-jobsAaron Griffin1-3/+4
Source our config file, and use ARCHES from it Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-07-17sourceballs: skip nonexistant FTP pathsAaron Griffin1-0/+4
This is useful when running on separate machines that don't have all repos Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-07-17Add community and 'any' arch to sourceballsAaron Griffin1-2/+2
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-02-23Ensure grep matches only full pkgnamesAaron Griffin1-2/+2
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-02-17sourceballs: copy previous errors.txt output fileAaron Griffin1-0/+1
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-02-13Keep the last failed.txt too for comparisonAaron Griffin1-0/+1
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-02-13Fix pkgname parsing for files without ARCHAaron Griffin1-1/+2
Split the srcpkg parsing into two separate steps, one to swap the extensions, and another to remove the architecture Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-02-13Allow skipping of sourceball license checkAaron Griffin1-1/+9
Also add a whitelist of files to skip (empty right now) Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-02-11Output stderr to an error file for each runAaron Griffin1-6/+6
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-02-09Write out failed packages to a txt fileAaron Griffin1-1/+3
Located at /srv/ftp/sources/failed.txt Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-02-04Remove 'skipping' output. Not neededAaron Griffin1-1/+1
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2008-11-21Move cron-jobs to /srv from /homeAaron Griffin1-2/+2
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2008-09-02Remove 'unstable' from sourceball creationAaron Griffin1-1/+1
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2008-08-31Add sourceball cron job at the proper path (whoops)Aaron Griffin1-1/+1
Also remove readline from the skip-list Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2008-08-31Add sourceball generating cron scriptAaron Griffin1-0/+81
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>