summaryrefslogtreecommitdiffstats
path: root/cron-jobs
AgeCommit message (Collapse)AuthorFilesLines
2010-11-20sourceballs: Lock the repo while reading the db filePierre Schmitz1-3/+10
2010-11-20Simplify sourceballs creationPierre Schmitz1-29/+17
* Read package lists directly from DB file * Make SVNREPO configurable
2010-11-20Fix sourceballs cron jobPierre Schmitz1-13/+8
* add unit test for sourceballs and cleanup * introduce SRCPOOL and LOGDIR variables in config
2010-10-12Dont try to index empty reposPierre Schmitz1-2/+2
2010-10-11Fix missing output redirectionDan McGee1-1/+1
Signed-off-by: Dan McGee <dan@archlinux.org>
2010-09-17Move output redirectionDan McGee1-3/+3
Signed-off-by: Dan McGee <dan@archlinux.org>
2010-09-13Fix typosPierre Schmitz2-2/+2
2010-09-12Add multilib-testing to web update scriptDan McGee1-1/+1
Signed-off-by: Dan McGee <dan@archlinux.org>
2010-09-11Use local config instead of guessing by hostnamePierre Schmitz1-8/+6
Using the hostname to decide which repos to use is not releiable and hard to test. Instead use config.local to configure these. config files for sigurd and gerolde were added which can be copied or symlinked to config.local on the specific host.
2010-09-11Remove obsolete cron jobPierre Schmitz1-41/+0
2010-09-02Simplify case statementDan McGee1-18/+5
Don't duplicate the user:group pair all over the place; put all of the associated repos and directories in the same case statement for a given set of credentials. Signed-off-by: Dan McGee <dan@archlinux.org> Signed-off-by: Pierre Schmitz <pierre@archlinux.de>
2010-09-01Simplify repo configurationPierre Schmitz4-5/+9
* Repositories can now be defined in the config file for each host * added community-staging, gnome-unstable and kde-unstable * Exception is the adjust-permission cron-job; but we might want to use acls in future anyway Signed-off-by: Pierre Schmitz <pierre@archlinux.de>
2010-08-25update-web-db: flip the arch/repo loopsDan McGee1-2/+2
This will really make sure [core] packages flow to the top of the list, regardless of architecture. They should anyway, but anything that was only updated in the first architecture updated could get artificially pushed down before. Signed-off-by: Dan McGee <dan@archlinux.org>
2010-08-25update-web-db: reformat to coding styleDan McGee1-16/+18
Signed-off-by: Dan McGee <dan@archlinux.org>
2010-08-25Fix a few issues with update-web-dbDan McGee1-5/+7
Signed-off-by: Dan McGee <dan@archlinux.org>
2010-08-25Add update-web-db cronjobDan McGee2-0/+48
This has been untracked by version control for a while on gerolde in both the cron-jobs directory and in /etc/cron.hourly/. Add it here so we can make changes and know what is going on. This is an improved script over what we currently have. It is one script instead of two, and it does things a little smarter with the logging. Signed-off-by: Dan McGee <dan@archlinux.org>
2010-08-24adjust group for multilib repositoryPierre Schmitz1-1/+1
2010-08-22add makepkg.conf for [multilib]Pierre Schmitz3-2/+4
2010-08-18fix typoPierre Schmitz1-1/+1
2010-08-18Rewrite ftpdir-cleanupPierre Schmitz1-24/+92
* runtime reduced to < 1 second * uses file lists and the comm command * searches for missing packages * removes empty legacy directories like extra/os/any
2010-08-17Add [staging] repositoryPierre Schmitz3-2/+4
2010-08-13Use common functions to print messages, warnings and errorsPierre Schmitz3-8/+6
These functions are copied from makepkg
2010-08-10Use more consitent naming for package poolPierre Schmitz2-15/+13
There are no longer architecture-specific subdirs and the structure was switch to this: ftp └── pool ├── community └── packages packages contains all packages from core, extra and testing; this naming is in sync with the svn repo naming: svn-packages and svn-community
2010-08-08Use db-functions in create-filelists and sourceballsPierre Schmitz2-58/+25
2010-08-08Cleanup cron-jobs/adjust-permissionsPierre Schmitz1-31/+26
2010-08-08Move common function to db-functionsPierre Schmitz1-23/+3
db-functions now sets an individual $WORKDIR and implements trap functinos that remove locks on exit or error. There are new functions to lock and unlock the running script. misc-scripts/ftpdir-cleanup was renamed to ftpdir-cleanup-repo as the cron-job had the same name. Script names have to be unique when using db-functions.
2010-08-08fix cleaning of any packages and ignore empty reposPierre Schmitz1-2/+3
2010-06-28sourceballs: Added community and community-testing supportEric Bélanger1-1/+1
Signed-off-by: Eric Bélanger <snowmaniscool@gmail.com> Signed-off-by: Pierre Schmitz <pierre@archlinux.de>
2010-06-20adjust permissions for package poolPierre Schmitz1-2/+12
2010-06-20ftpdir-cleanup: only search for linked packages in actual reposPierre Schmitz1-1/+3
2010-06-20Replace PKGPOOL_DIR by a function callPierre Schmitz1-1/+1
The package pool dir depends on the host; so we solve this similar to get_repos_for_host() Note: There is no "os" subdir for the package pool.
2010-05-03Add PKGPOOL_DIR config variableAaron Griffin1-1/+1
This is a relative var, descendent from FTP_BASE. We do this because we also need a relative path to the package pool dir
2010-04-28ftpdir-cleanup: use 'find' for symlink detectionAaron Griffin1-13/+3
This gets rid of a bash loop for link detection
2010-04-28ftpdir-cleanup: Fix cleanup of package poolAaron Griffin1-1/+1
2010-04-28Change ftpdir-cleanup scripts for package poolingAaron Griffin1-1/+34
* The per repo script now simply removes files as they should all be symlinks at this time * The cron job script will do the extra job of checking the global pool. If there are no more symlinks, move the pooled package Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2010-03-31don't publish *.old filesPierre Schmitz1-2/+1
2010-03-13moving sourceballs-cleanupEric Bélanger1-61/+0
2010-03-13sourceballs: Make cleanup more efficientEric Bélanger1-0/+2
Moved all cleanup related code in sourceballs-cleanup script and moved, now common, functions in db-functions. The cleanup script is now ran after all the new sourceballs have been fetched. Signed-off-by: Eric Bélanger <snowmaniscool@gmail.com>
2010-02-27create-filelists: include desc/depends entriesDan McGee1-3/+7
Make the files DB include everything the original packages DB includes instead of just being 'files' entries. This will allow tools to do more with these generated files and they can be used as a drop-in replacement for a regular package database. Signed-off-by: Dan McGee <dan@archlinux.org>
2010-02-27create-filelists: rework the package loop completelyDan McGee1-13/+28
Instead of wasting time extracting .PKGINFO twice from every single package in the repos, use the package DB to eliminate most of the heavy lifting. This way we only need to worry about looking at the packages that actually have changed since the last time we built the package database. This should give a noticeable performance increase to this job in addition to reducing IO load and unnecessary reading of every package file. Signed-off-by: Dan McGee <dan@archlinux.org>
2010-02-27create-filelists: s/REPO_DB_FILE/FILES_DB_FILE/gDan McGee1-7/+7
This will set up changes soon to come where we actually use the real repos DB file so I don't want variable name confusion. Signed-off-by: Dan McGee <dan@archlinux.org>
2010-02-27create-filelists: general cleanupsDan McGee1-10/+13
* Specify lock name once * Use new script name everywhere * Clean up tabs/spaces and add a modeline. This isn't necessarily the one we wanted to standardize on, but I picked the one the entire file is written to at the moment. Signed-off-by: Dan McGee <dan@archlinux.org>
2009-10-31create-filelists: Add pkgver-pkgrel to directory nameThomas Bächler1-3/+4
In the past, pkgname-pkgver-pkgrel was extracted from the filename and sadly named "pkgname". Restore this behaviour
2009-10-31create-filelists: fix another typoThomas Bächler1-1/+1
2009-10-31create-filelists: add community-testingThomas Bächler1-1/+1
2009-10-31Fix a typo introduced in 38c7241ad2528b29a65a0b81b980e76d1046e94eThomas Bächler1-1/+1
2009-10-30create-filelists: Call getpkgname for realAaron Griffin1-2/+1
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-10-30Cleanup create-filelistsAaron Griffin1-28/+27
* Quote absolutely everything * Move directory slashes around, for readability * Move a cd to the top of the loop Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-10-30Rename createFileLists to be more like the othersAaron Griffin1-0/+0
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-10-26Added new cronjob script to clean up unneeded sourceballsEric Bélanger1-0/+61
This script is intended to be a weekly cron-job. It supplements the current sourceballs cleanup in make-sourceball that only removes the old sourceballs. This script removes the sourceballs of packages that were either removed completely from the repo or moved to a splitted package. It also checks the license of the packages which have a sourceball to see, in case of a license change, if the hosting of the sources is still necessary. Signed-off-by: Eric Bélanger <snowmaniscool@gmail.com> Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>