diff options
| author | Dan McGee <dan@archlinux.org> | 2013-12-17 15:24:41 +0100 |
|---|---|---|
| committer | Dan McGee <dan@archlinux.org> | 2013-12-18 07:01:50 +0100 |
| commit | 8e8e3d7aa7ac843a5523f971cb2c5426e9f05379 (patch) | |
| tree | a14e59083e8d1e02fbade04dc50e3511c3943daf /mirrors/fixtures | |
| parent | 77a45dc7bc6f0badb45ec043e85f1b542c52792e (diff) | |
| download | archweb-8e8e3d7aa7ac843a5523f971cb2c5426e9f05379.tar.gz archweb-8e8e3d7aa7ac843a5523f971cb2c5426e9f05379.tar.xz | |
reporead: bring back batched_bulk_create()
For packages with filelists with > 80,000 items, we were starting to see
some serious memory issues in reporead. This was both on the statement
generation side in Python as well as on the database side. Break the
updates into chunks of 10,000 when we encounter packages with tons of
files to control things in a bit.
Signed-off-by: Dan McGee <dan@archlinux.org>
Diffstat (limited to 'mirrors/fixtures')
0 files changed, 0 insertions, 0 deletions