summaryrefslogtreecommitdiffstats
path: root/cron-jobs
AgeCommit message (Collapse)AuthorFilesLines
2010-11-25create-filelists: Improve performance by reading package list from db ↵Pierre Schmitz1-5/+4
instead from fs
2010-11-25update-web-db: Lock db and scriptPierre Schmitz1-26/+46
* usage of db-functions * Lock the db and work on a copy to avoid long lock times * Lock the script itself to avoid multiple calls * Adjust to coding style to other dbscripts
2010-11-25sourceballs: be nicePierre Schmitz1-0/+3
2010-11-25Rewrote create-filelistsPierre Schmitz1-66/+81
* use correct locking of the repos * added test case * removes file lists of deleted packages * add compression independent symlink to files db
2010-11-25Add FILESEXT variable for use in create-filelistsPierre Schmitz1-5/+3
2010-11-25Make ftpdir-cleanup less verboseEric Bélanger1-1/+0
Signed-off-by: Eric Bélanger <snowmaniscool@gmail.com> Signed-off-by: Pierre Schmitz <pierre@archlinux.de>
2010-11-25Added seperate dryrun options for the packages and sources cleanup scriptsEric Bélanger1-2/+2
Signed-off-by: Eric Bélanger <snowmaniscool@gmail.com> Signed-off-by: Pierre Schmitz <pierre@archlinux.de>
2010-11-24sourceballs: fix working directoryPierre Schmitz1-3/+2
2010-11-23sourceballs: Move to our workdir first to fix warning with sudo usagePierre Schmitz1-0/+2
2010-11-23sourceballs: avoid failing twicePierre Schmitz1-0/+7
2010-11-23sourceballs: fix outputPierre Schmitz1-8/+3
2010-11-23sourceballs: be less verbosePierre Schmitz1-6/+21
2010-11-23Rewrite sourceballs to increase performance and reliabilityPierre Schmitz1-45/+99
* Decrease file stats as much as possible * Create a list of all packages and meta data only once * Create a list of available source packages only once * Create a list of expected packages only once * Combine all three scripts into one to share data and code * Use as much information from the db files as possible and avoid using svn * Avoid attempting to create the same source package twice Logic works as follows: 1) create a list of all packages 2) Check for each package if we need a src package and create one 3) During this process create a list of all src packages that should be there 4) Diff both lists for the cleanup
2010-11-22Attempt to fix integrity-checkPierre Schmitz1-5/+6
2010-11-22check_archlinux: fix for python2 usagePierre Schmitz3-2/+2
2010-11-21texlive sources are already on ftp.archlinux.orgPierre Schmitz1-0/+20
2010-11-21sourceballs: Of course sort does only operate on linesPierre Schmitz1-1/+1
2010-11-21Blacklist more duplicate data packagesPierre Schmitz1-0/+5
2010-11-21sourceballs.skip: ufoai-data has the same sources as ufoaiPierre Schmitz1-0/+1
2010-11-21sourceballs.skip: tremulous-data has the same sources as tremulousPierre Schmitz1-0/+1
2010-11-21sourceballs.skip: torcs-data has the same sources as torcsPierre Schmitz1-0/+1
2010-11-21sourceballs.skip: nexuiz-data has the same sources as nexuizPierre Schmitz1-0/+1
2010-11-21sourceballs: Don't write any logPierre Schmitz1-8/+3
This is consistent with the other dbscripts. The output will be send to the mailinglist.
2010-11-20sourceballs: Lock the repo while reading the db filePierre Schmitz1-3/+10
2010-11-20Simplify sourceballs creationPierre Schmitz1-29/+17
* Read package lists directly from DB file * Make SVNREPO configurable
2010-11-20Fix sourceballs cron jobPierre Schmitz1-13/+8
* add unit test for sourceballs and cleanup * introduce SRCPOOL and LOGDIR variables in config
2010-10-12Dont try to index empty reposPierre Schmitz1-2/+2
2010-10-11Fix missing output redirectionDan McGee1-1/+1
Signed-off-by: Dan McGee <dan@archlinux.org>
2010-09-17Move output redirectionDan McGee1-3/+3
Signed-off-by: Dan McGee <dan@archlinux.org>
2010-09-13Fix typosPierre Schmitz2-2/+2
2010-09-12Add multilib-testing to web update scriptDan McGee1-1/+1
Signed-off-by: Dan McGee <dan@archlinux.org>
2010-09-11Use local config instead of guessing by hostnamePierre Schmitz1-8/+6
Using the hostname to decide which repos to use is not releiable and hard to test. Instead use config.local to configure these. config files for sigurd and gerolde were added which can be copied or symlinked to config.local on the specific host.
2010-09-11Remove obsolete cron jobPierre Schmitz1-41/+0
2010-09-02Simplify case statementDan McGee1-18/+5
Don't duplicate the user:group pair all over the place; put all of the associated repos and directories in the same case statement for a given set of credentials. Signed-off-by: Dan McGee <dan@archlinux.org> Signed-off-by: Pierre Schmitz <pierre@archlinux.de>
2010-09-01Simplify repo configurationPierre Schmitz4-5/+9
* Repositories can now be defined in the config file for each host * added community-staging, gnome-unstable and kde-unstable * Exception is the adjust-permission cron-job; but we might want to use acls in future anyway Signed-off-by: Pierre Schmitz <pierre@archlinux.de>
2010-08-25update-web-db: flip the arch/repo loopsDan McGee1-2/+2
This will really make sure [core] packages flow to the top of the list, regardless of architecture. They should anyway, but anything that was only updated in the first architecture updated could get artificially pushed down before. Signed-off-by: Dan McGee <dan@archlinux.org>
2010-08-25update-web-db: reformat to coding styleDan McGee1-16/+18
Signed-off-by: Dan McGee <dan@archlinux.org>
2010-08-25Fix a few issues with update-web-dbDan McGee1-5/+7
Signed-off-by: Dan McGee <dan@archlinux.org>
2010-08-25Add update-web-db cronjobDan McGee2-0/+48
This has been untracked by version control for a while on gerolde in both the cron-jobs directory and in /etc/cron.hourly/. Add it here so we can make changes and know what is going on. This is an improved script over what we currently have. It is one script instead of two, and it does things a little smarter with the logging. Signed-off-by: Dan McGee <dan@archlinux.org>
2010-08-24adjust group for multilib repositoryPierre Schmitz1-1/+1
2010-08-22add makepkg.conf for [multilib]Pierre Schmitz3-2/+4
2010-08-18fix typoPierre Schmitz1-1/+1
2010-08-18Rewrite ftpdir-cleanupPierre Schmitz1-24/+92
* runtime reduced to < 1 second * uses file lists and the comm command * searches for missing packages * removes empty legacy directories like extra/os/any
2010-08-17Add [staging] repositoryPierre Schmitz3-2/+4
2010-08-13Use common functions to print messages, warnings and errorsPierre Schmitz3-8/+6
These functions are copied from makepkg
2010-08-10Use more consitent naming for package poolPierre Schmitz2-15/+13
There are no longer architecture-specific subdirs and the structure was switch to this: ftp └── pool ├── community └── packages packages contains all packages from core, extra and testing; this naming is in sync with the svn repo naming: svn-packages and svn-community
2010-08-08Use db-functions in create-filelists and sourceballsPierre Schmitz2-58/+25
2010-08-08Cleanup cron-jobs/adjust-permissionsPierre Schmitz1-31/+26
2010-08-08Move common function to db-functionsPierre Schmitz1-23/+3
db-functions now sets an individual $WORKDIR and implements trap functinos that remove locks on exit or error. There are new functions to lock and unlock the running script. misc-scripts/ftpdir-cleanup was renamed to ftpdir-cleanup-repo as the cron-job had the same name. Script names have to be unique when using db-functions.
2010-08-08fix cleaning of any packages and ignore empty reposPierre Schmitz1-2/+3