summaryrefslogtreecommitdiffstats
path: root/cron-jobs
AgeCommit message (Collapse)AuthorFilesLines
2009-09-18improve compute_dep algorithmXavier Chantry1-19/+16
The compute_dep function I wrote for the more informative hierarchy output was very inefficient. It's much better now (10s -> 0.5s) on my box, and I get exactly the same results :) Now the big majority of the time is again spent on parsing pkgbuilds. Signed-off-by: Xavier Chantry <shiningxc@gmail.com> Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-09-18add the repo/ info to most results, and sort themXavier Chantry1-7/+6
Add repo information to most results by using the repo/pkgname syntax (instead of only pkgname) Sort all results list (with the point above, this sorts the results by repo :)) Signed-off-by: Xavier Chantry <shiningxc@gmail.com> Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-09-18Add db comparison to integrity checkHenning Garus1-2/+53
Compare the abs tree with the repo dbs to check if we have a PKGBUILD for each package in the dbs and vice versa. Signed-off-by: Henning Garus <henning.garus@gmail.com> Signed-off-by: Xavier Chantry <shiningxc@gmail.com> Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-09-18check_packages.py: Allow multiple abs-treesHenning Garus2-16/+18
By parsing multiple abs trees we can add any when parsing the other trees, checking any standalone doesn't make much sense. Signed-off-by: Henning Garus <henning.garus@gmail.com> Signed-off-by: Xavier Chantry <shiningxc@gmail.com> Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-09-14Maybe I should make the script really adjust permissionsDan McGee1-4/+2
Signed-off-by: Dan McGee <dan@archlinux.org>
2009-09-14Add new get_repos_for_host() functionDan McGee2-27/+31
And use it. This allows us to have server-specific behavior in our scripts without further patching, and it also allows us to simplify some of our scripts a fair amount. Signed-off-by: Dan McGee <dan@archlinux.org>
2009-09-14Be more careful with config file inclusionDan McGee2-0/+2
We can't really do the basedir magic from db-functions as it is just being sourced and is not the currently executing script. Although a bit repetitive, it is a lot safer to just include the config file everywhere. Noticed this when trying to run the latest available scripts on sigurd. Signed-off-by: Dan McGee <dan@archlinux.org>
2009-09-08Added sourceballs.force entriesAaron Griffin1-0/+4
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-09-01sourceballs: explicitly add the 'any' archAaron Griffin1-1/+1
Loop over all arches AND the 'any' arch. Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-08-28add deplist to hierarchy problemsXavier Chantry1-3/+47
This should help a lot figuring out whether a given hierarchy problem is fixable (if it doesn't require moving too many deps). example output core/crda depends on extra/python-m2crypto (27 extra (make)deps to pull) core/iputils depends on extra/opensp (29 extra (make)deps to pull) core/iputils depends on extra/libxslt (25 extra (make)deps to pull) core/iputils depends on extra/docbook-xsl (27 extra (make)deps to pull) core/udev depends on extra/gperf (0 extra (make)deps to pull) core/udev depends on extra/libxslt (25 extra (make)deps to pull) core/e2fsprogs depends on extra/bc (0 extra (make)deps to pull) core/sqlite3 depends on extra/tcl (0 extra (make)deps to pull) core/ca-certificates depends on extra/ruby (25 extra (make)deps to pull) the actual deps are only displayed when there are less than 10. Signed-off-by: Xavier Chantry <shiningxc@gmail.com> Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-08-28check_packages : add support for split packages.Xavier Chantry2-14/+73
I just found a way to support split packages, by using $(type package_${pkg}), parsing that output and running eval on the relevant lines. This is a bit ugly, and while it works fine on my machine and my current abs tree, I cannot guarantee this code is bug free :) Signed-off-by: Xavier Chantry <shiningxc@gmail.com> Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-08-19Replace pkgname with pkgbase, for split packagesAaron Griffin1-4/+4
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-08-19Use db-functions file everywhereAaron Griffin3-26/+3
This source the config file and gets us functions such as getpkgname which were duplicated elsewhere Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-08-19More removal of DB_COMPRESSION from cron jobsAaron Griffin1-8/+9
Remove dependance on makepkg.conf Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-08-19More makepkg.conf removal - prefer toplevel configAaron Griffin2-13/+0
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-08-16Add DB_COMPRESSION var to all scripts that need itDan McGee1-0/+1
Signed-off-by: Dan McGee <dan@archlinux.org>
2009-08-03Remove community from stock ftpdir-cleanupAaron Griffin1-1/+1
community repo is cleaned up on a different machine Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-07-23Use the top level config file for cron-jobsAaron Griffin2-5/+7
Source our config file, and use ARCHES from it Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-07-21Refactor ftpdir-cleanup to handle all archesFrancois Charette1-5/+2
This may look like a rather large patch, but the changes are mostly a reshuffling of the code to loop over all arches first, and then handle the arch-indep packages. The cronjob has been changed accordingly. Added new category DELETESYMLINKS, which are deleted instead of being moved to package-cleanup. I have also fixed the arch-specific issue with the ftppath, using parameters in config instead. Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-07-21ftpdir-cleanup: Don't scan 'any' dirsAaron Griffin1-1/+1
These are handled automatically when scanning other architecutres Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-07-17ftpdir-cleanup: Add configurable destdirAaron Griffin1-1/+4
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-07-17sourceballs: skip nonexistant FTP pathsAaron Griffin1-0/+4
This is useful when running on separate machines that don't have all repos Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-07-17Add community and 'any' arch to sourceballsAaron Griffin1-2/+2
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-07-17Add community and 'any' arch to ftp cleanupAaron Griffin1-3/+2
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-07-17Fix adjust-permissions for gerolde and sigurdAaron Griffin1-12/+21
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-06-12compute compression option from file extensionPierre Schmitz1-1/+8
bsdtar does not detect the compression type from the file extension. So we need to set the right option on our own. Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-05-13use pkgext defined in makepkg.confPierre Schmitz1-5/+11
Signed-off-by: Pierre Schmitz <pierre@archlinux.de> Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-05-08check_archlinux: Skip searching CVS and .svn dirsAaron Griffin1-0/+6
Prevents some errors in the community scripts due to scanning of CVS dirs. Also skipping .svn dirs for the future (dotglob may be set, in which case we'd scan .svn dirs as well) Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-05-06check_packages.py: Add 'any' arch supportFrançois Charette1-2/+2
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-05-06adjust_permissions: Add 'any' architectureFrançois Charette1-0/+3
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-02-23Ensure grep matches only full pkgnamesAaron Griffin1-2/+2
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-02-22integrity-check: fix a few errorsXavier Chantry1-5/+4
I think it will work better now :) Signed-off-by: Xavier Chantry <shiningxc@gmail.com> Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-02-21Remove the repo-maint crontabAaron Griffin1-13/+0
Our cron currently doesn't handle stand-alone crontabs too well, and we're managing all these in root's crontab anyway. Meh... deleted Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-02-21Add a script to simplify the integ check callAaron Griffin1-0/+14
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-02-17sourceballs: copy previous errors.txt output fileAaron Griffin1-0/+1
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-02-13Keep the last failed.txt too for comparisonAaron Griffin1-0/+1
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-02-13Fix pkgname parsing for files without ARCHAaron Griffin1-1/+2
Split the srcpkg parsing into two separate steps, one to swap the extensions, and another to remove the architecture Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-02-13Allow skipping of sourceball license checkAaron Griffin2-1/+9
Also add a whitelist of files to skip (empty right now) Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-02-11Output stderr to an error file for each runAaron Griffin1-6/+6
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-02-09Write out failed packages to a txt fileAaron Griffin1-1/+3
Located at /srv/ftp/sources/failed.txt Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-02-04Remove 'skipping' output. Not neededAaron Griffin1-1/+1
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-02-01check_packages: fix stupid assumption on script location.Xavier Chantry1-4/+2
The parse_pkgbuilds.sh script was assumed to be in the current working directory, which is quite stupid since check_packages.py can be called from anywhere. Now it only assumes that check_packages.py and parse_pkgbuilds.sh are in the same directory. This should fix the empty integrity checks on arch-dev :) Signed-off-by: Xavier Chantry <shiningxc@gmail.com> Signed-off-by: Dan McGee <dan@archlinux.org>
2009-01-14Remove HH:MM from devlist-mailer subject linesAaron Griffin1-2/+2
This was extraneous info. Not needed as higher granularity can be gleaned from the mail's date Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-01-09check_packages : add --arch option.Xavier Chantry2-10/+22
The parsing script didn't set CARCH previously, and the flashplugin PKGBUILD exited in this case. First override the exit function to prevent the whole script to exit, and add a --arch option to be able to set CARCH correctly. To be used like this : For core and extra : ./check_packages.py --abs-tree=/home/abs/rsync/i686 --repos=core,extra --arch=i686 ./check_packages.py --abs-tree=/home/abs/rsync/x86_64 --repos=core,extra --arch=x86_64 For community : ./check_packages.py --abs-tree=/home/abs/rsync/i686 --repos=community --arch=i686 ./check_packages.py --abs-tree=/home/abs/rsync/x86_64 --repos=community --arch=x86_64 Signed-off-by: Xavier Chantry <shiningxc@gmail.com> Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2008-12-29Allow devlist-mailer to send to alternate addressesAaron Griffin1-2/+6
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2008-11-21Drop unstable from processing in scriptsDan McGee2-2/+2
Signed-off-by: Dan McGee <dan@archlinux.org> Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2008-11-21Move cron-jobs to /srv from /homeAaron Griffin3-5/+5
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2008-11-21Remove unused cron-job 'genpkglist'Aaron Griffin1-28/+0
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2008-11-10cron-jobs: use renice to lower job priorityDan McGee3-0/+9
Lower the job priority of our cron jobs so they don't interfere with other more important things on the server. None of these are very CPU intensive, but priority for I/O operations should go elsewhere. Signed-off-by: Dan McGee <dan@archlinux.org> Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2008-11-10Remove chmod on /home/aur/*Dan McGee1-2/+0
This one portion of the adjust-permissions script takes over a minute of wall clock time to run on gerolde when no other cron jobs are running. It takes three minutes when we hit the hour mark on the clock due to everything else going at the same time. A find on /home/aur/unsupported reveals this command will need to touch ~77000 files. Signed-off-by: Dan McGee <dan@archlinux.org> Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
generated by cgit v1.2.3-24-g4f1b (git 2.32.0) at 2024-11-29 22:20:02 +0100