summaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2010-09-29Fix migration dependencies exposed after moving modelsDan McGee2-0/+8
When we moved some models from one app to another, we didn't do anything to ensure the tables were created at all initially. Enforce this by adding the minimal required dependencies- those migrations in the 'main' model that last touched the involved models moving between apps. Noticed-by: Angel Velasquez <angvp@archlinux.org> Signed-off-by: Dan McGee <dan@archlinux.org>
2010-09-25Add a basic mirror details pageDan McGee5-1/+78
Still some work to do here, but this covers the basics of the public view we can show for mirrors and their associated data. The upstream and downstream links should be working OK to aid navigation, but right now we have some potential dead links for non-authenticated users if they click a link to a "private" mirror. Signed-off-by: Dan McGee <dan@archlinux.org>
2010-09-25Make general mirror list view publicDan McGee5-28/+30
Hide some columns when not logged in because they aren't relevant for the general public, but this will work nicely as a base page for all of our known mirrors. Signed-off-by: Dan McGee <dan@archlinux.org>
2010-09-25Add note about mean syncing delayDan McGee1-1/+2
Signed-off-by: Dan McGee <dan@archlinux.org>
2010-09-25Give more information about mirror check runs and frequencyDan McGee3-19/+38
Show how many times the check has ran in the last 24 hours, as well as the average interval between checks. Signed-off-by: Dan McGee <dan@archlinux.org>
2010-09-24Mirror status query refinementsDan McGee1-4/+4
Only show errors for active and public mirrors, and collapse two filter calls into just one for our normal status query. Signed-off-by: Dan McGee <dan@archlinux.org>
2010-09-24Fix news permission checking in templatesDan McGee2-6/+6
We were still looking at the permissions on the main application; these need to be updated to point at the news application instead. Signed-off-by: Dan McGee <dan@archlinux.org>
2010-09-23Update BBS and bugs links to use HTTPSDan McGee7-28/+28
Since we only do HTTPS now on these services, no point in sending someone through a useless redirect. Signed-off-by: Dan McGee <dan@archlinux.org>
2010-09-23Get secure/unsecure checking actually workingDan McGee3-5/+19
We need a bit more, like actually having something relevant in the RequestContext object, in order for this to all work. Instead of putting the full request in just populate a 'secure' key with a boolean value indicating whether the request is secure. Signed-off-by: Dan McGee <dan@archlinux.org>
2010-09-23Update newsletter/magazine linkDan McGee1-2/+2
Signed-off-by: Dan McGee <dan@archlinux.org>
2010-09-22Switch mirror status delay display to average delayDan McGee3-11/+27
This takes a bit more work to compute, but since we cache all of this anyway it isn't too big of deal. Using average delay instead of last delay will be a bit more fair on mirrors that have odd syncing schedules, as well as exposing those that only sync once a day. Also fix an issue that will arise with cutoff_time being calculated once, and adjust mirror score to treat hours delay as a float rather than an integer. Signed-off-by: Dan McGee <dan@archlinux.org>
2010-09-22Allow generated mirrorlist to take status info into accountDan McGee4-11/+42
By using the mirror score we calculate, we can sort the mirrors in the generated mirrorlist for people. Signed-off-by: Dan McGee <dan@archlinux.org>
2010-09-22Allow caching of mirror status infoDan McGee2-30/+48
Signed-off-by: Dan McGee <dan@archlinux.org>
2010-09-22Fix self-closing anchor links for ChromeDan McGee1-3/+3
Apparently it can't parse a very normal looking <a/> because they forgot one of their original purposes doesn't require a body. Awesome. Signed-off-by: Dan McGee <dan@archlinux.org>
2010-09-22Prevent 500 if no mirror checks have ranDan McGee1-1/+4
Signed-off-by: Dan McGee <dan@archlinux.org>
2010-09-22Merge branch 'mirror-check'Dan McGee12-5/+452
2010-09-22Add link to mirror status toolDan McGee2-4/+11
Signed-off-by: Dan McGee <dan@archlinux.org>
2010-09-22Add ordering, sorting, and a lot more info to mirror status pageDan McGee3-7/+60
This should get this to the point where it is releasable to the general public for their use and pleasure. Still not sure on how often the check should be run, and we probably want to incorporate this mined data into some other things like the mirror list generator. Signed-off-by: Dan McGee <dan@archlinux.org>
2010-09-22Small updates to mirrorcheck commandDan McGee1-3/+5
Signed-off-by: Dan McGee <dan@archlinux.org>
2010-09-21Allow serving jQuery via HTTPS if secure request detectedDan McGee1-1/+6
Handles the concerns in FS#19045. Signed-off-by: Dan McGee <dan@archlinux.org>
2010-09-21Add debugger when having to parse lastsync fileDan McGee1-0/+2
Signed-off-by: Dan McGee <dan@archlinux.org>
2010-09-21Add mirror status viewDan McGee6-0/+148
Signed-off-by: Dan McGee <dan@archlinux.org>
2010-09-21Add 'mirrorcheck' commandDan McGee3-0/+149
This does the actual work of going out and checking the mirror status. In short, it polls every active mirror URL for the 'lastsync' file and then records the appropriate details. These include the contents of that file, how long the total time to retrieve took, and any errors encountered. In order to finish up a bit faster, we spawn several threads to do the actual work. This parallelization allows the whole check process to take around 30 seconds rather than several minutes. Signed-off-by: Dan McGee <dan@archlinux.org>
2010-09-21Rename generate mirrorlist viewDan McGee2-2/+2
Signed-off-by: Dan McGee <dan@archlinux.org>
2010-09-21Add new MirrorLog model and associated migrationDan McGee2-0/+86
Signed-off-by: Dan McGee <dan@archlinux.org>
2010-09-21Auto-populate slug on news item creationDan McGee2-3/+17
And make sure it is unique through a few queries and some magic. Signed-off-by: Dan McGee <dan@archlinux.org>
2010-09-21Update news views to use slug instead of IDDan McGee5-18/+25
Signed-off-by: Dan McGee <dan@archlinux.org>
2010-09-21Add migrations to populate the news slug and make it non-nullDan McGee3-1/+145
These should get us all set to have more useful URLs for the news items. Signed-off-by: Dan McGee <dan@archlinux.org>
2010-09-21Add news slug fieldDan McGee2-0/+67
Initially, this needs to allow null so that we can add in slugs for all of our old news items. Signed-off-by: Dan McGee <dan@archlinux.org>
2010-09-20Update news permission required stringDan McGee1-4/+4
When moving the news model and updating the content type, I forgot to update these strings to reflect the new permission name. Whoops. Signed-off-by: Dan McGee <dan@archlinux.org>
2010-09-20Fix package differences pkgrel comparisonDan McGee1-3/+4
Using the right index in the array might help; we were comparing pkgver again and not pkgrel at all. Signed-off-by: Dan McGee <dan@archlinux.org>
2010-09-17Remove some leftover print statementsDan McGee2-3/+0
Signed-off-by: Dan McGee <dan@archlinux.org>
2010-09-15Spruce up news admin viewDan McGee2-4/+4
Add last modified date as a column, and fix up some other small display, sorting, and ordering issues. Signed-off-by: Dan McGee <dan@archlinux.org>
2010-09-15Ensure consistent date formatting everywhereDan McGee8-7/+10
Set up a default DATE_FORMAT in settings.py and use it everywhere we do the '|date' template filter rather than hardcoding the value in the template. This also fixes a regression with news date/time now that we changed the field to store both date and time. Signed-off-by: Dan McGee <dan@archlinux.org>
2010-09-15Re-enable etagsDan McGee1-2/+0
Signed-off-by: Dan McGee <dan@archlinux.org>
2010-09-15Improve request handling for feeds that haven't changedDan McGee1-0/+37
By using the condition decorator (in a slightly odd way because these are class-based views), we can cut down a lot on the response time for returning 304 status code for feeds that haven't changed. The decorator means we no longer have to completely render the view to see if we can return a 304 status code. Signed-off-by: Dan McGee <dan@archlinux.org>
2010-09-15Reorder middleware to be more inline with Django defaultsDan McGee1-2/+2
Signed-off-by: Dan McGee <dan@archlinux.org>
2010-09-15Add last modified date to newsDan McGee2-1/+76
This will come in handy when determining whether resources are out of date, such as our news RSS feed. Also bump the Date fields to DateTime fields for sake of sorting and if we have more than one news item on the same date. Signed-off-by: Dan McGee <dan@archlinux.org>
2010-09-13Bump requirements for Django security releaseDan McGee2-2/+2
Signed-off-by: Dan McGee <dan@archlinux.org>
2010-09-12reporead: revamp database parsing codeDan McGee1-93/+64
This needed a little sprucing up as it has grown quite organically over the life of this script. Make things a bit more pythonic through the use of iterators rather than collection indexing, and try to generalize the special cases of things a bit. Also catch encoding problems early and fail gracefully rather than blow up the entire package parser. A failed decode of a file should cause us to just skip it rather than stop the entire parser. Worst case, this leaves that package out of the web interface. Signed-off-by: Dan McGee <dan@archlinux.org>
2010-09-12Check for correct permission when creating usersDan McGee1-2/+2
Signed-off-by: Dan McGee <dan@archlinux.org>
2010-09-11Restore flagged package count by maintainer in dashboardDan McGee3-12/+44
We need to do a little dropping into SQL to accomplish this, but it isn't all that bad to actually do and we can do the whole thing in one query. Signed-off-by: Dan McGee <dan@archlinux.org>
2010-09-10reporead: allow traceback on USR1 signal as wellDan McGee1-2/+3
When I have caught reporead behaving badly on the production box, I haven't been able to successfully get a traceback without killing the process. Hopefully using a different signal will allow me to actually capture some data. Signed-off-by: Dan McGee <dan@archlinux.org>
2010-09-10Remove SomethingFishyExceptionDan McGee1-7/+2
Just use a plain Exception instead since we don't get any added value by subclassing. Signed-off-by: Dan McGee <dan@archlinux.org>
2010-09-09Improve todo list view pageDan McGee2-6/+22
Add total package count and incomplete package count columns. Also reduce the number of total queries by killing the query per row that was happening before. Signed-off-by: Dan McGee <dan@archlinux.org>
2010-09-09Remove redundant text from groups package count columnDan McGee1-12/+2
Signed-off-by: Dan McGee <dan@archlinux.org>
2010-09-09After moving models, update content type tableDan McGee1-0/+169
The one thing that people forget to mention when moving models from one Django app to another. I was fooled here. Signed-off-by: Dan McGee <dan@archlinux.org>
2010-09-09Hide multilib by defaultDan McGee1-2/+2
Signed-off-by: Dan McGee <dan@archlinux.org>
2010-09-08Update arch fixture with new columnDan McGee1-0/+3
Signed-off-by: Dan McGee <dan@archlinux.org>
2010-09-08Use arch.agnostic flag everywhereDan McGee3-10/+17
Signed-off-by: Dan McGee <dan@archlinux.org>