Commits

Author Commit Message Labels Comments Date
rgrp
[branch]: create mongodb branch.
Branches
mongodb
AnnaPS
[wdmmg][s] moving departmental loader into two separate files, in an attempt to deal with memory issues
AnnaPS
[wdmmg][xs] switching from sqlalchemy commit() to flush() in an attempt to reduce memory usage
AnnaPS
[wdmmg][xs] check if filename already loaded
AnnaPS
[wdmmg][s] fix bug in transaction number column: also don't create classification items for empty columns
AnnaPS
[wdmmg][s] various fixes to departmental loader
AnnaPS
[wdmmg][xs] really don't need that print statement
AnnaPS
[wdmmg][xs] add load point for departmental spending loader
AnnaPS
[wdmmg][xs] just tidying up docstrings/comments
AnnaPS
[wdmmg][xs] various improvements for departmental data loading
AnnaPS
[wdmmg][m] First pass at script to load 25k departmental spending data. Does not run over all 150 spreadsheets yet.
AnnaPS
[wdmmg][xs] tidy up: remove unneeded print statement
AnnaPS
[wdmmg][xs] change to use filenames, rather than fileobjs, in order to avoid universal-newline problem
AnnaPS
[wdmmg][xs] add Wales to the list of keys that we correct for
AnnaPS
[wdmmg][xs] fixes to get tests to run: need to commit more often than previously
AnnaPS
[wdmmg][xs] updates for model name changes
AnnaPS
[wdmmg][xs] fix: should use society.code, not society.id, otherwise transaction uses numeric ID in key_to
AnnaPS
[wdmmg][s] load single years in time values, e.g. 2008 rather than 2008-9, as recommended by Steve
AnnaPS
[wdmmg][xs] readding loader point for GLA
AnnaPS
[wdmmg][xs] update for datastore name change and repo move
AnnaPS
[wdmmg][xs] changes for new datastore names (slice/dataset etc)
AnnaPS
[wdmmg][xs] changes for new database names (slice/dataset etc)
AnnaPS
[wdmmg][xs] do not load 2010-2011 data, as the ENG_LA entries are missing
AnnaPS
[wdmmg][s] changes associated with switch from UUIDs to integer IDs
AnnaPS
[wdmmg][s] changes associated with switch from UUIDs to integer IDs
AnnaPS
[wdmmg][xs] slice name should be cra, not cra2010
AnnaPS
[wdmmg][xs] include dejargonise and promote_notes functions in main COFOG load function
AnnaPS
[wdmmg][m] The script that cleans up CRA2010. Source files are in CKAN's ukgov-finances-cra
AnnaPS
[wdmmg][s] add load point for CRA2010
AnnaPS
[wdmmg][s] minor changes for CRA2010
  1. Prev
  2. Next