summaryrefslogtreecommitdiffstats
path: root/cron-jobs
AgeCommit message (Collapse)AuthorFilesLines
2009-08-28add deplist to hierarchy problemsXavier Chantry1-3/+47
This should help a lot figuring out whether a given hierarchy problem is fixable (if it doesn't require moving too many deps). example output core/crda depends on extra/python-m2crypto (27 extra (make)deps to pull) core/iputils depends on extra/opensp (29 extra (make)deps to pull) core/iputils depends on extra/libxslt (25 extra (make)deps to pull) core/iputils depends on extra/docbook-xsl (27 extra (make)deps to pull) core/udev depends on extra/gperf (0 extra (make)deps to pull) core/udev depends on extra/libxslt (25 extra (make)deps to pull) core/e2fsprogs depends on extra/bc (0 extra (make)deps to pull) core/sqlite3 depends on extra/tcl (0 extra (make)deps to pull) core/ca-certificates depends on extra/ruby (25 extra (make)deps to pull) the actual deps are only displayed when there are less than 10. Signed-off-by: Xavier Chantry <shiningxc@gmail.com> Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-08-28check_packages : add support for split packages.Xavier Chantry2-14/+73
I just found a way to support split packages, by using $(type package_${pkg}), parsing that output and running eval on the relevant lines. This is a bit ugly, and while it works fine on my machine and my current abs tree, I cannot guarantee this code is bug free :) Signed-off-by: Xavier Chantry <shiningxc@gmail.com> Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-08-19Replace pkgname with pkgbase, for split packagesAaron Griffin1-4/+4
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-08-19Use db-functions file everywhereAaron Griffin3-26/+3
This source the config file and gets us functions such as getpkgname which were duplicated elsewhere Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-08-19More removal of DB_COMPRESSION from cron jobsAaron Griffin1-8/+9
Remove dependance on makepkg.conf Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-08-19More makepkg.conf removal - prefer toplevel configAaron Griffin2-13/+0
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-08-16Add DB_COMPRESSION var to all scripts that need itDan McGee1-0/+1
Signed-off-by: Dan McGee <dan@archlinux.org>
2009-08-03Remove community from stock ftpdir-cleanupAaron Griffin1-1/+1
community repo is cleaned up on a different machine Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-07-23Use the top level config file for cron-jobsAaron Griffin2-5/+7
Source our config file, and use ARCHES from it Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-07-21Refactor ftpdir-cleanup to handle all archesFrancois Charette1-5/+2
This may look like a rather large patch, but the changes are mostly a reshuffling of the code to loop over all arches first, and then handle the arch-indep packages. The cronjob has been changed accordingly. Added new category DELETESYMLINKS, which are deleted instead of being moved to package-cleanup. I have also fixed the arch-specific issue with the ftppath, using parameters in config instead. Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-07-21ftpdir-cleanup: Don't scan 'any' dirsAaron Griffin1-1/+1
These are handled automatically when scanning other architecutres Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-07-17ftpdir-cleanup: Add configurable destdirAaron Griffin1-1/+4
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-07-17sourceballs: skip nonexistant FTP pathsAaron Griffin1-0/+4
This is useful when running on separate machines that don't have all repos Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-07-17Add community and 'any' arch to sourceballsAaron Griffin1-2/+2
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-07-17Add community and 'any' arch to ftp cleanupAaron Griffin1-3/+2
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-07-17Fix adjust-permissions for gerolde and sigurdAaron Griffin1-12/+21
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-06-12compute compression option from file extensionPierre Schmitz1-1/+8
bsdtar does not detect the compression type from the file extension. So we need to set the right option on our own. Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-05-13use pkgext defined in makepkg.confPierre Schmitz1-5/+11
Signed-off-by: Pierre Schmitz <pierre@archlinux.de> Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-05-08check_archlinux: Skip searching CVS and .svn dirsAaron Griffin1-0/+6
Prevents some errors in the community scripts due to scanning of CVS dirs. Also skipping .svn dirs for the future (dotglob may be set, in which case we'd scan .svn dirs as well) Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-05-06check_packages.py: Add 'any' arch supportFrançois Charette1-2/+2
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-05-06adjust_permissions: Add 'any' architectureFrançois Charette1-0/+3
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-02-23Ensure grep matches only full pkgnamesAaron Griffin1-2/+2
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-02-22integrity-check: fix a few errorsXavier Chantry1-5/+4
I think it will work better now :) Signed-off-by: Xavier Chantry <shiningxc@gmail.com> Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-02-21Remove the repo-maint crontabAaron Griffin1-13/+0
Our cron currently doesn't handle stand-alone crontabs too well, and we're managing all these in root's crontab anyway. Meh... deleted Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-02-21Add a script to simplify the integ check callAaron Griffin1-0/+14
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-02-17sourceballs: copy previous errors.txt output fileAaron Griffin1-0/+1
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-02-13Keep the last failed.txt too for comparisonAaron Griffin1-0/+1
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-02-13Fix pkgname parsing for files without ARCHAaron Griffin1-1/+2
Split the srcpkg parsing into two separate steps, one to swap the extensions, and another to remove the architecture Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-02-13Allow skipping of sourceball license checkAaron Griffin2-1/+9
Also add a whitelist of files to skip (empty right now) Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-02-11Output stderr to an error file for each runAaron Griffin1-6/+6
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-02-09Write out failed packages to a txt fileAaron Griffin1-1/+3
Located at /srv/ftp/sources/failed.txt Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-02-04Remove 'skipping' output. Not neededAaron Griffin1-1/+1
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-02-01check_packages: fix stupid assumption on script location.Xavier Chantry1-4/+2
The parse_pkgbuilds.sh script was assumed to be in the current working directory, which is quite stupid since check_packages.py can be called from anywhere. Now it only assumes that check_packages.py and parse_pkgbuilds.sh are in the same directory. This should fix the empty integrity checks on arch-dev :) Signed-off-by: Xavier Chantry <shiningxc@gmail.com> Signed-off-by: Dan McGee <dan@archlinux.org>
2009-01-14Remove HH:MM from devlist-mailer subject linesAaron Griffin1-2/+2
This was extraneous info. Not needed as higher granularity can be gleaned from the mail's date Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-01-09check_packages : add --arch option.Xavier Chantry2-10/+22
The parsing script didn't set CARCH previously, and the flashplugin PKGBUILD exited in this case. First override the exit function to prevent the whole script to exit, and add a --arch option to be able to set CARCH correctly. To be used like this : For core and extra : ./check_packages.py --abs-tree=/home/abs/rsync/i686 --repos=core,extra --arch=i686 ./check_packages.py --abs-tree=/home/abs/rsync/x86_64 --repos=core,extra --arch=x86_64 For community : ./check_packages.py --abs-tree=/home/abs/rsync/i686 --repos=community --arch=i686 ./check_packages.py --abs-tree=/home/abs/rsync/x86_64 --repos=community --arch=x86_64 Signed-off-by: Xavier Chantry <shiningxc@gmail.com> Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2008-12-29Allow devlist-mailer to send to alternate addressesAaron Griffin1-2/+6
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2008-11-21Drop unstable from processing in scriptsDan McGee2-2/+2
Signed-off-by: Dan McGee <dan@archlinux.org> Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2008-11-21Move cron-jobs to /srv from /homeAaron Griffin3-5/+5
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2008-11-21Remove unused cron-job 'genpkglist'Aaron Griffin1-28/+0
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2008-11-10cron-jobs: use renice to lower job priorityDan McGee3-0/+9
Lower the job priority of our cron jobs so they don't interfere with other more important things on the server. None of these are very CPU intensive, but priority for I/O operations should go elsewhere. Signed-off-by: Dan McGee <dan@archlinux.org> Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2008-11-10Remove chmod on /home/aur/*Dan McGee1-2/+0
This one portion of the adjust-permissions script takes over a minute of wall clock time to run on gerolde when no other cron jobs are running. It takes three minutes when we hit the hour mark on the clock due to everything else going at the same time. A find on /home/aur/unsupported reveals this command will need to touch ~77000 files. Signed-off-by: Dan McGee <dan@archlinux.org> Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2008-10-06check_packages : improve the "skip klibc dep" hack.Xavier Chantry1-1/+1
It is not possible to check the klibc dep on the PKGBUILD level, so I made a hack to skip it. This hack broke on klibc-jfflyAahxqaliwAofrf_fdf5upI because of the underscore. But we can simply use the \w regexp which matches any alpha-numeric char, including underscore. According to klibc developer, dashes are possible too. Also the length of this string is always 27 chars, so we can use that. Signed-off-by: Xavier Chantry <shiningxc@gmail.com> Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2008-09-02Cron-job changesAaron Griffin1-1/+2
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2008-09-02Remove the unstable repositoryAaron Griffin1-3/+3
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2008-09-02Remove 'unstable' from sourceball creationAaron Griffin1-1/+1
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2008-08-31Add sourceball cron job at the proper path (whoops)Aaron Griffin2-2/+1
Also remove readline from the skip-list Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2008-08-31Add sourceball generating cron scriptAaron Griffin2-0/+82
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2008-08-31Fix an error message copy/paste errorAaron Griffin1-1/+1
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2008-08-31Replace check_archlinux.py by check_archlinux/check_packages.pyXavier Chantry6-704/+528
The old script had several problems so I decided to do a full rewrite. The improvements include : * better and safer parsing of PKGBUILDs It now uses separate parse_pkgbuilds.sh bash script (inspired from namcap) * much better performance A python module for calling vercmp natively, and the algorithm for checking circular dependencies was greatly improved * more accurate dependency and provision handling Now versioned dependencies and provisions are handled correctly. After building the python module and moving it next to the main script, it should be possible to use it like this : For core and extra : ./check_packages.py --abs-tree=/home/abs/rsync/i686 --repos=core,extra ./check_packages.py --abs-tree=/home/abs/rsync/x86_64 --repos=core,extra For community : ./check_packages.py --abs-tree=/home/abs/rsync/i686 --repos=community ./check_packages.py --abs-tree=/home/abs/rsync/x86_64 --repos=community Signed-off-by: Xavier Chantry <shiningxc@gmail.com> Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2008-06-30Remove community from the integrity check, for nowAaron Griffin1-1/+2
To much output sent to the dev list, this needs to be sent to the aur-general list separately Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>