summaryrefslogtreecommitdiffstats
path: root/devel
AgeCommit message (Collapse)AuthorFilesLines
2011-06-15reporead: small memory/perf improvementsDan McGee1-3/+5
Signed-off-by: Dan McGee <dan@archlinux.org>
2011-06-15reporead: two small cleanupsDan McGee1-15/+17
* Parse builddate when reading from repo database file * Use defaultdict where it comes in handy Signed-off-by: Dan McGee <dan@archlinux.org>
2011-06-13Add a long out-of-date developer reportDan McGee1-1/+6
This shows packages that have been marked out of date for more than 90 days in the repos. Signed-off-by: Dan McGee <dan@archlinux.org>
2011-06-10Fix busted batch score on package removalDan McGee1-1/+1
Signed-off-by: Dan McGee <dan@archlinux.org>
2011-06-10reporead: allow batching of package updatesDan McGee1-9/+49
The real reason I originally added transactions to this code was to prevent half-updates; e.g. a package gets in without the matching depends values. We can safely commit between packages and resume processing the database at a later time. Take advantage of this fact and commit every so often in batch fashion if we have a lot of updates piling up. In the case of updating the files DB, this can really cut down on the need to hold open a long-running, statement heavy transaction and get the information public faster. Signed-off-by: Dan McGee <dan@archlinux.org>
2011-06-09Management command cleanupDan McGee1-22/+5
Now that we aren't seeing odd segfaults and hung tasks, we can remove the traceback stuff from the scripts. Also use the 'io' module only, it has been long enough. Signed-off-by: Dan McGee <dan@archlinux.org>
2011-06-02Add a PGP key field on the dev profileDan McGee1-0/+7
Signed-off-by: Dan McGee <dan@archlinux.org>
2011-05-27Remove now uneeded pytz bug workaroundDan McGee1-3/+1
2011-05-15Allow screening developer reports by maintainerDan McGee2-4/+19
A simple link is added for each user, but the URLs are flexible enough to screen by any maintainer if you know how they are constructed. Signed-off-by: Dan McGee <dan@archlinux.org>
2011-05-04Make uncompressed info query slightly easier on the databaseDan McGee1-1/+3
Signed-off-by: Dan McGee <dan@archlinux.org>
2011-05-02Add filesizeformat filter to sizes in reports/bigEvangelos Foutras1-1/+8
We also add a new 'filesize' tablesorter parser that handles all the suffixes found in django's filesizeformat filter. Signed-off-by: Dan McGee <dan@archlinux.org>
2011-04-30Add unneeded orphans reportDan McGee1-1/+8
Signed-off-by: Dan McGee <dan@archlinux.org>
2011-04-30Change big packages reportDan McGee1-2/+3
Signed-off-by: Dan McGee <dan@archlinux.org>
2011-04-30Use single quotes only in dev report viewDan McGee1-9/+9
2011-04-26Developer reportsDan McGee2-9/+54
This commit adds four initial developer reports that are hopefully useful to developers and packages in checking up on the state of things. They include: * big : the 100 biggest packages in the repos * old : packages built > 2 years ago * uncompressed-man : self-explanatory * uncompressed-info : self-explanatory There should obviously be some sort of index page to access all of these, so that will be coming soon. Signed-off-by: Dan McGee <dan@archlinux.org>
2011-04-09Show more info about todolists on developer dashboardDan McGee1-2/+6
Signed-off-by: Dan McGee <dan@archlinux.org>
2011-04-09Rename local variables for clarityDan McGee1-3/+3
Signed-off-by: Dan McGee <dan@archlinux.org>
2011-04-08Use UTC datetime objects everywhereDan McGee1-3/+3
Rather than the twisted mix of local times and UTC times we currently have. Signed-off-by: Dan McGee <dan@archlinux.org>
2011-03-29Work out kinks in create new user viewDan McGee1-6/+17
We allowed repo selection before, but never actually called save_m2m() so selections would have to be repeated on the next page. Add in group selection as well to the form, and ensure we do all of our database operations in one transaction so it is a lot easier to test and roll back if things go wrong. Signed-off-by: Dan McGee <dan@archlinux.org>
2011-03-29Log user additions via new user formDan McGee1-0/+15
Signed-off-by: Dan McGee <dan@archlinux.org>
2011-03-29Show important fields first on new user formDan McGee1-5/+16
Signed-off-by: Dan McGee <dan@archlinux.org>
2011-03-24Add provides to collections listDan McGee1-1/+1
Signed-off-by: Dan McGee <dan@archlinux.org>
2011-03-24reporead: remove the need for hasattr() checksDan McGee1-24/+27
Ensure all our multivalued attributes already exist on the object beforehand, and add some special sauce to handle the difference between a package without files and a database without files entries. Signed-off-by: Dan McGee <dan@archlinux.org>
2011-03-24Clear out package relation sets before adding new valuesDan McGee1-0/+3
Signed-off-by: Dan McGee <dan@archlinux.org>
2011-03-23reporead: read in provisions, conflicts, and replacementsDan McGee1-3/+42
Signed-off-by: Dan McGee <dan@archlinux.org>
2011-03-23Remove need to import each individual logger constantDan McGee1-6/+4
Signed-off-by: Dan McGee <dan@archlinux.org>
2011-03-23reporead: refactor multivalued attribute creationDan McGee1-9/+13
This will come in more handy with our new models, but we can adapt groups and licenses to use it first. Signed-off-by: Dan McGee <dan@archlinux.org>
2011-03-23Don't bail on staging repo being short on packagesDan McGee1-1/+1
Signed-off-by: Dan McGee <dan@archlinux.org>
2011-03-16Various reporead small cleanupsDan McGee1-24/+29
Signed-off-by: Dan McGee <dan@archlinux.org>
2011-03-14Show orphan package counts in maintainer dashboard tableDan McGee1-0/+11
Signed-off-by: Dan McGee <dan@archlinux.org>
2011-03-13Add package epoch supportDan McGee1-8/+16
This comes with pacman 3.5, replacing the old "force" PKGBUILD option. We parse it and store it for now, but don't display it anywhere just yet. Also update a few queries relying on version differences in any of the multiple parts. Signed-off-by: Dan McGee <dan@archlinux.org>
2011-03-10Add Admin log overview pageDan McGee2-1/+17
This puts the admin log functionality to a bit more use and allows seeing the last 100 overall entries. You can also drill down to see actions on a per-user basis. Signed-off-by: Dan McGee <dan@archlinux.org>
2011-03-08Work around unicode/str issue in pytzDan McGee1-1/+3
Signed-off-by: Dan McGee <dan@archlinux.org>
2011-03-04Move new user email contents to templateDan McGee1-10/+20
Signed-off-by: Dan McGee <dan@archlinux.org>
2011-03-03Remove devel notify viewDan McGee3-17/+0
All of this can just be set on the main profile page. Signed-off-by: Dan McGee <dan@archlinux.org>
2011-02-27reporead: small cleanupsDan McGee1-6/+2
2011-02-23reporead performance improvementsDan McGee1-3/+18
When importing over a million files, it makes sense to take the slightly faster route and call the PackageFile() constructor directly rather than going through the related manager's create method. We can also get huge performance improvements, especially with files databases, by using the 'io' rather than 'codecs' module. The former is now implemented in C in 2.7 and results in a no-work import (so measuring only the DB read speed) of extra.files.tar.gz from ~30 seconds to ~5 seconds. Signed-off-by: Dan McGee <dan@archlinux.org>
2011-02-22Use new split package file fields everywhereDan McGee1-2/+8
Signed-off-by: Dan McGee <dan@archlinux.org>
2011-02-17Read in optional deps and show in web interfaceDan McGee1-13/+23
Signed-off-by: Dan McGee <dan@archlinux.org>
2011-02-15Move license to a related modelDan McGee1-5/+6
This allows us to store multiple licenses per package in a more elegant fashion, and will later allow us to search and filter on this information. Signed-off-by: Dan McGee <dan@archlinux.org>
2011-02-15Clean up Package related objects codeDan McGee1-2/+2
Main change is just to move groups from the default packagegroup_set location to a related_name of groups. Also refer to the Package class directly rather than by text string if we have it available. Signed-off-by: Dan McGee <dan@archlinux.org>
2011-01-31Defer format string substitution to loggerDan McGee1-21/+20
Don't use 'fmtstr % (arg1, arg2)' type format; logger can be passed a format string and the arguments to populate it. Saves a bit of work for strings that never end up getting displayed anyway. Signed-off-by: Dan McGee <dan@archlinux.org>
2011-01-08Add developer world clocks pageDan McGee2-1/+25
This should make it easier for everyone to figure out whether someone is awake, sleeping, and all that fun stuff. It does require everyone to update their profile and fill in the field, but that shouldn't be too hard of a task. Don't suggest jokes to me Saturday morning on IRC unless you really want to see them implemented. Thanks, Pierre! Signed-off-by: Dan McGee <dan@archlinux.org>
2010-12-29Commit during reporead on a per-arch basisDan McGee1-1/+1
Signed-off-by: Dan McGee <dan@archlinux.org>
2010-12-13Move more URLs out of root urlconfDan McGee1-0/+10
Things are a bit cleaner now. Signed-off-by: Dan McGee <dan@archlinux.org>
2010-11-27Remove print statementDan McGee1-1/+0
Signed-off-by: Dan McGee <dan@archlinux.org>
2010-11-05reporead: fix small issues when loading files databasesDan McGee1-4/+14
We didn't verify that the version in the files database was the same as in the SQL side of things, so we could load old files for a new package and lose track of this fact. When loading files, ensure the database version matches the version in the package before continuing with the file load operation. There are also a few other small updates in here, like skipping the sanity check for filesonly as we never delete packages, and removing some unnecessary string concatenation operations. Signed-off-by: Dan McGee <dan@archlinux.org>
2010-11-05reporead: Use transparent compression on openDan McGee1-2/+2
And make filename check more lenient. Signed-off-by: Dan McGee <dan@archlinux.org>
2010-11-04reporead: orphaning code cleanup and debug removalDan McGee1-18/+12
Cleanup to some of the orphan code cleanup, especially so we are never lying in the percentage we print, and remove a bunch of debug prints that aren't all that useful. Signed-off-by: Dan McGee <dan@archlinux.org>
2010-10-19Unify hyphenation of out-of-date textDan McGee1-1/+1
Signed-off-by: Dan McGee <dan@archlinux.org>