summaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2009-09-18parse_pkgbuilds : simple performance tweakXavier Chantry1-1/+1
this simple tweak gives a nice perf boost : from 10s to 7s to parse extra repo. indeed calling basename caused a fork to happen for the thousand of files being considered Now the major bottleneck is parsing split pkgbuilds, but I am afraid there is no magical solution for that :( Signed-off-by: Xavier Chantry <shiningxc@gmail.com> Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-09-18improve compute_dep algorithmXavier Chantry1-19/+16
The compute_dep function I wrote for the more informative hierarchy output was very inefficient. It's much better now (10s -> 0.5s) on my box, and I get exactly the same results :) Now the big majority of the time is again spent on parsing pkgbuilds. Signed-off-by: Xavier Chantry <shiningxc@gmail.com> Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-09-18add the repo/ info to most results, and sort themXavier Chantry1-7/+6
Add repo information to most results by using the repo/pkgname syntax (instead of only pkgname) Sort all results list (with the point above, this sorts the results by repo :)) Signed-off-by: Xavier Chantry <shiningxc@gmail.com> Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-09-18Add db comparison to integrity checkHenning Garus1-2/+53
Compare the abs tree with the repo dbs to check if we have a PKGBUILD for each package in the dbs and vice versa. Signed-off-by: Henning Garus <henning.garus@gmail.com> Signed-off-by: Xavier Chantry <shiningxc@gmail.com> Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-09-18check_packages.py: Allow multiple abs-treesHenning Garus2-16/+18
By parsing multiple abs trees we can add any when parsing the other trees, checking any standalone doesn't make much sense. Signed-off-by: Henning Garus <henning.garus@gmail.com> Signed-off-by: Xavier Chantry <shiningxc@gmail.com> Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-09-18Add "testing to repo" for any pkgs in communityDaniel J Griffiths1-0/+11
Whoops, missed this in the last commit Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-09-18Add "testing to repo" scripts for communityDaniel J Griffiths2-0/+22
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-09-18Add db-community-testingDaniel J Griffiths1-0/+3
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-09-18ftpdir-cleanup: Additional getpkgname cleanupAaron Griffin1-2/+4
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-09-18ftpdir-cleanup: get rid of local getpkgnameAaron Griffin1-19/+5
This is in the db-functions file, and does a better job. In order to do this, we had to change some path related code Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-09-18Collapse duplicate loops for staging removalAaron Griffin1-11/+1
Add 'any' to the items looped over in the ${ARCHES[@]} loop Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-09-18Remove pkg from $stagedir if already in FTP repoFrancois Charette1-0/+23
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-09-18added testing2...-any scriptsFrancois Charette2-0/+22
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-09-18Remove '$arch' from file loopAaron Griffin1-1/+1
This allows us to still remove older, non architecture prefixed packages Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-09-18Minor: remove unused variableAaron Griffin1-1/+0
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-09-14Maybe I should make the script really adjust permissionsDan McGee1-4/+2
Signed-off-by: Dan McGee <dan@archlinux.org>
2009-09-14Ensure you don't update DBs on the wrong serverDan McGee1-1/+12
Signed-off-by: Dan McGee <dan@archlinux.org>
2009-09-14Add new get_repos_for_host() functionDan McGee3-27/+38
And use it. This allows us to have server-specific behavior in our scripts without further patching, and it also allows us to simplify some of our scripts a fair amount. Signed-off-by: Dan McGee <dan@archlinux.org>
2009-09-14Be more careful with config file inclusionDan McGee10-8/+9
We can't really do the basedir magic from db-functions as it is just being sourced and is not the currently executing script. Although a bit repetitive, it is a lot safer to just include the config file everywhere. Noticed this when trying to run the latest available scripts on sigurd. Signed-off-by: Dan McGee <dan@archlinux.org>
2009-09-08Added sourceballs.force entriesAaron Griffin1-0/+4
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-09-01sourceballs: explicitly add the 'any' archAaron Griffin1-1/+1
Loop over all arches AND the 'any' arch. Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-08-28add deplist to hierarchy problemsXavier Chantry1-3/+47
This should help a lot figuring out whether a given hierarchy problem is fixable (if it doesn't require moving too many deps). example output core/crda depends on extra/python-m2crypto (27 extra (make)deps to pull) core/iputils depends on extra/opensp (29 extra (make)deps to pull) core/iputils depends on extra/libxslt (25 extra (make)deps to pull) core/iputils depends on extra/docbook-xsl (27 extra (make)deps to pull) core/udev depends on extra/gperf (0 extra (make)deps to pull) core/udev depends on extra/libxslt (25 extra (make)deps to pull) core/e2fsprogs depends on extra/bc (0 extra (make)deps to pull) core/sqlite3 depends on extra/tcl (0 extra (make)deps to pull) core/ca-certificates depends on extra/ruby (25 extra (make)deps to pull) the actual deps are only displayed when there are less than 10. Signed-off-by: Xavier Chantry <shiningxc@gmail.com> Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-08-28check_packages : add support for split packages.Xavier Chantry2-14/+73
I just found a way to support split packages, by using $(type package_${pkg}), parsing that output and running eval on the relevant lines. This is a bit ugly, and while it works fine on my machine and my current abs tree, I cannot guarantee this code is bug free :) Signed-off-by: Xavier Chantry <shiningxc@gmail.com> Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-08-25Quiet sourceball output when license is skippedAaron Griffin1-1/+2
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-08-25Add SRCEXT to configAaron Griffin1-0/+1
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-08-19Fix arch parameter handling in db-removeEric Bélanger1-6/+6
db-remove use the arch variable to handle the arch parameter passed to the script. As the arch variable is already used in PKGBUILD, this variable conflict cause unwanted behaviour. Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-08-19Replace pkgname with pkgbase, for split packagesAaron Griffin1-4/+4
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-08-19Use db-functions file everywhereAaron Griffin4-27/+3
This source the config file and gets us functions such as getpkgname which were duplicated elsewhere Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-08-19More removal of DB_COMPRESSION from cron jobsAaron Griffin2-19/+14
Remove dependance on makepkg.conf Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-08-19More makepkg.conf removal - prefer toplevel configAaron Griffin4-24/+2
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-08-19Remove find-dupes script (unused)Aaron Griffin1-77/+0
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-08-19Variable rename fix: SVN_PATH -> SVNREPOEric Bélanger1-1/+1
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-08-18Replace a string compare with a -f checkAaron Griffin1-1/+1
No real reason, this is just easier to understand, and checks like this should be the norm. If file does not exist, continue Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-08-18Fix an error in db-move due to DBEXT commitAaron Griffin1-1/+1
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-08-18Remove dependence on makepkg.confAaron Griffin7-27/+2
Removed the need for makepkg.conf * Killed off CARCH * Added PKGEXT to the config file * Remove source_makepkg function * Source config file where makepkg.conf was needed Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-08-18Uncomment BUILDSCRIPT in the config fileAaron Griffin1-2/+1
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-08-18Replace DB_COMPRESSION with DBEXT in the configAaron Griffin4-21/+19
DBEXT contains the full extension for the db files (.db.tar.gz) and is recorded in the config file Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-08-16Add DB_COMPRESSION var to all scripts that need itDan McGee4-0/+4
Signed-off-by: Dan McGee <dan@archlinux.org>
2009-08-16Add DB_COMPRESSION='gz', as this has been removed from makepkg.confThomas Bächler1-0/+1
2009-08-16Make ftpdir-cleanup NOT delete all packages if databas extraction failsThomas Bächler1-1/+12
2009-08-16Avoid confusing messages and potential problems when no packages are presentThomas Bächler1-0/+3
If no packages are present in the repository, a message like this will be generated, and the corresponding mv command will be issued. Prevent this by checking if *$arch$PKGEXT equals "*$arch$PKGEXT": Scan complete for core (i686) at /srv/ftp/core/os/i686 The following files are in the repo but not the db They will be moved to '/srv/package-cleanup' *i686.pkg.tar.gz
2009-08-04Add db-communityAaron Griffin1-0/+3
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-08-03Remove community from stock ftpdir-cleanupAaron Griffin1-1/+1
community repo is cleaned up on a different machine Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-07-23ftpdir-cleanup: Loop over arches for 'any' linksAaron Griffin1-8/+10
Remove the hardcoded i686/x86_64 and loop over the ARCHES array in the config file, checking for valid symlinks. If none are found, remove the 'any' package Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-07-23ftpdir-cleanup: Minimize outputAaron Griffin1-4/+2
Clean up some output so when we do nothing, we get no output This is preferred as the mailer will simply not send a mail in this case. Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-07-23Use the top level config file for cron-jobsAaron Griffin2-5/+7
Source our config file, and use ARCHES from it Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-07-22remove support for different svn reposPierre Schmitz6-32/+6
Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-07-22db-update: Move some steps inside an 'if'Francois Charette1-6/+8
[Aaron: keep WORKDIR creation outside the loop, as its removed at the end] Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
2009-07-22Merge branch 'master' of /srv/projects/git/dbscriptsAaron Griffin2-35/+48
2009-07-22db-update: Fix final repo_unlockAaron Griffin1-2/+2
Because we lock/unlock in a loop, simply remove the cleanup trap at the end of the process, and manually clean up the work dir Signed-off-by: Aaron Griffin <aaronmgriffin@gmail.com>
generated by cgit v1.2.3-24-g4f1b (git 2.32.0) at 2024-11-09 09:43:28 +0100