summaryrefslogtreecommitdiffstats
path: root/misc-scripts
AgeCommit message (Collapse)AuthorFilesLines
2010-11-23Rewrite sourceballs to increase performance and reliabilityPierre Schmitz2-179/+0
* Decrease file stats as much as possible * Create a list of all packages and meta data only once * Create a list of available source packages only once * Create a list of expected packages only once * Combine all three scripts into one to share data and code * Use as much information from the db files as possible and avoid using svn * Avoid attempting to create the same source package twice Logic works as follows: 1) create a list of all packages 2) Check for each package if we need a src package and create one 3) During this process create a list of all src packages that should be there 4) Diff both lists for the cleanup
2010-11-22sourceballs: check if source package was really createdPierre Schmitz1-2/+10
2010-11-22Prefer any packagesPierre Schmitz1-3/+3
2010-11-22sourceballs-cleanup: respect .force and .skip filesPierre Schmitz1-2/+8
2010-11-21sourceballs: Support any packagesPierre Schmitz1-3/+8
2010-11-21sourceballs: Don't write any logPierre Schmitz2-20/+12
This is consistent with the other dbscripts. The output will be send to the mailinglist.
2010-11-21sourceballs: respect the dryrun settingPierre Schmitz1-4/+6
2010-11-21sourceballs: check if PKGBUILD existsPierre Schmitz2-4/+10
2010-11-21sourceballs: fix error handlingPierre Schmitz2-9/+32
2010-11-20sourceballs: skip in a clean way if source package should not be createdPierre Schmitz1-1/+1
2010-11-20Simplify sourceballs creationPierre Schmitz1-22/+12
* Read package lists directly from DB file * Make SVNREPO configurable
2010-11-20Fix sourceballs cron jobPierre Schmitz2-13/+9
* add unit test for sourceballs and cleanup * introduce SRCPOOL and LOGDIR variables in config
2010-08-18Rewrite ftpdir-cleanupPierre Schmitz1-187/+0
* runtime reduced to < 1 second * uses file lists and the comm command * searches for missing packages * removes empty legacy directories like extra/os/any
2010-08-18Fix cleanup of old packagesPierre Schmitz1-1/+1
* This should fix the cleanup of packages that were not within the pacakge pool before being updated. * a test case for this was added
2010-08-13Use common functions to print messages, warnings and errorsPierre Schmitz2-56/+36
These functions are copied from makepkg
2010-08-08Source PKGBUILD in subshellsPierre Schmitz2-8/+10
This patch sources a PKGBUILD in a subshells instead of directly. This way we don't polute our scope or overwrite our vars which might lead to unexpected behavior.
2010-08-08Move common function to db-functionsPierre Schmitz3-55/+6
db-functions now sets an individual $WORKDIR and implements trap functinos that remove locks on exit or error. There are new functions to lock and unlock the running script. misc-scripts/ftpdir-cleanup was renamed to ftpdir-cleanup-repo as the cron-job had the same name. Script names have to be unique when using db-functions.
2010-08-08use common workdirPierre Schmitz2-5/+0
2010-08-08Remove BUILDSCRIPT variablePierre Schmitz2-3/+3
There is no need to have a variable for things like PKGBUILD that are very unlikely to ever change.
2010-08-08fix cleaning of any packages and ignore empty reposPierre Schmitz1-2/+3
2010-06-28sourceballs: Added community and community-testing supportEric Bélanger2-5/+14
Signed-off-by: Eric Bélanger <snowmaniscool@gmail.com> Signed-off-by: Pierre Schmitz <pierre@archlinux.de>
2010-05-02ftpdir-cleanup: Add clean_pkgs functionAaron Griffin1-4/+14
This should remove files if they are symlinks (pooled packages) and move them to the cleanup dir if not
2010-04-28Change ftpdir-cleanup scripts for package poolingAaron Griffin1-9/+6
* The per repo script now simply removes files as they should all be symlinks at this time * The cron job script will do the extra job of checking the global pool. If there are no more symlinks, move the pooled package Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2010-04-28Remove FTP_OS_SUFFIX variableAaron Griffin1-1/+1
This isn't needed and if "os" ever changes, we have bigger changes. Won't save us any time and it's longer to type.
2010-04-11Do not overwrite TMPDIR defined in config20100411Pierre Schmitz1-6/+6
2010-04-11Fail if lock couldn't be obtained; Unlock the repos if ftpdir-cleanup failsPierre Schmitz1-1/+12
2010-03-13sourceballs: Make cleanup more efficientEric Bélanger2-54/+95
Moved all cleanup related code in sourceballs-cleanup script and moved, now common, functions in db-functions. The cleanup script is now ran after all the new sourceballs have been fetched. Signed-off-by: Eric Bélanger <snowmaniscool@gmail.com>
2010-03-03Make repo locking an atomic process and added timeout argumentEric Bélanger1-3/+7
The repo locking function now use a lock directory instead of a lock file. This makes the lock checking and creation an atomic process. The repo_lock function will now try to obtain a lock every $LOCK_DELAY seconds until it is successful. An optional third argument can be use to give a timeout in seconds; this is intended for scripts that runs unattended. Repo locking is now used in the ftpdir-cleanup script. This should fix the problem of the ftpdir-cleanup script removing the new package instead of the old one (FS#17058). Signed-off-by: Eric Bélanger <snowmaniscool@gmail.com>
2010-02-23Hide 'file not found' message20100223Pierre Schmitz1-1/+1
2010-02-21remove unneeded and now broken checkPierre Schmitz1-1/+0
2010-02-21add dry run option to ftpdir-cleanupPierre Schmitz1-5/+7
Signed-off-by: Pierre Schmitz <pierre@archlinux.de>
2009-10-26Added source-cleanup directory supportEric Bélanger1-1/+1
Signed-off-by: Eric Bélanger <snowmaniscool@gmail.com> Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-10-26Moved chk_license to db-functions fileEric Bélanger1-23/+1
Signed-off-by: Eric Bélanger <snowmaniscool@gmail.com> Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-10-26Moved ALLOWED_LICENSES declaration to config fileEric Bélanger1-3/+0
Signed-off-by: Eric Bélanger <snowmaniscool@gmail.com> Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-09-24make-sourceball: Re-add file parsing of name/verAaron Griffin1-5/+26
getpkgname / getpkgver were replaced with versions that scanned the .PKGINFO file. These don't work for source packages, so add the functionality back in for this case Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-09-23make-sourceballs: clean up outputAaron Griffin1-2/+2
Only output "Creating sourceball" text when we're actually creating it Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-09-23Fixed split packages support in sourceballs scriptEric Bélanger1-8/+8
Signed-off-by: Eric Bélanger <snowmaniscool@gmail.com> Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-09-22Modify sourceball remove_old functionAaron Griffin1-2/+2
The revampled getpkgname/getpkgver functions need the full path to the file now, not just the filename Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-09-18ftpdir-cleanup: Additional getpkgname cleanupAaron Griffin1-2/+4
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-09-18ftpdir-cleanup: get rid of local getpkgnameAaron Griffin1-19/+5
This is in the db-functions file, and does a better job. In order to do this, we had to change some path related code Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-09-18Remove '$arch' from file loopAaron Griffin1-1/+1
This allows us to still remove older, non architecture prefixed packages Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-09-18Minor: remove unused variableAaron Griffin1-1/+0
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-09-14Be more careful with config file inclusionDan McGee2-0/+2
We can't really do the basedir magic from db-functions as it is just being sourced and is not the currently executing script. Although a bit repetitive, it is a lot safer to just include the config file everywhere. Noticed this when trying to run the latest available scripts on sigurd. Signed-off-by: Dan McGee <dan@archlinux.org>
2009-08-25Quiet sourceball output when license is skippedAaron Griffin1-1/+2
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-08-19Use db-functions file everywhereAaron Griffin1-1/+0
This source the config file and gets us functions such as getpkgname which were duplicated elsewhere Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-08-19More removal of DB_COMPRESSION from cron jobsAaron Griffin1-11/+5
Remove dependance on makepkg.conf Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-08-19More makepkg.conf removal - prefer toplevel configAaron Griffin2-11/+2
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-08-19Remove find-dupes script (unused)Aaron Griffin1-77/+0
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-08-19Variable rename fix: SVN_PATH -> SVNREPOEric Bélanger1-1/+1
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-08-18Replace a string compare with a -f checkAaron Griffin1-1/+1
No real reason, this is just easier to understand, and checks like this should be the norm. If file does not exist, continue Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>