Commits

Show all
Author Commit Message Labels Comments Date
Mark Roddy
Adding list of work to be completed.
Tags
v0.1.0
Mark Roddy
Modifed the test program to turn off logging (if not in verbose mode) before collecting tests. Changes from 0.5->0.8 introduced logging messages that are called when creating the neccessary components for instantiating a pig test. Previously logging was only occuring during runtime.
Mark Roddy
Note that now testing against pig 0.8.
Mark Roddy
Updates to support running in Pig 0.8
Mark Roddy
Reworded awkward phrasing on potential non-deterministic test failings.
Mark Roddy
Added note that string compare also requires you to know the ordering of the records in the result set.
Mark Roddy
Reworded some akward phrasing on logs/debugging.
Mark Roddy
Added test fixture explaing how to deal with ordering via the ignore_ordering argument.
Mark Roddy
Renamed order_matters to ignore_ordering as this new name better implies the default value (that ordering will not be checked).
Mark Roddy
Added support for specifying whether or not the ordering of records in the relation matters.
Mark Roddy
Added example and explination of doing floating point approximation for equality.
Mark Roddy
Renamed the optional 'Args' attribute to 'Parameters' as this is what should be specified by the test author. n and reducers are just parameters in the example test script so they are not required.
Mark Roddy
Added assertRelationAlmostEquals() for comparing relations containing floating point values.
Mark Roddy
Removed the assertLastStoreEqualsFile() method from the PigTest class. Parsing an input file and figuring out what types to convert everything to is a big rabbit hole that isn't really worth pursueing. Users can pretty easily implement this themselves for simple outputs, and it's not worth the trouble of supporting complex types in output.
Mark Roddy
Added test fixture illustrating how to override a query.
Mark Roddy
Added example test fixture illustrating the use of overriding a relation with specified records.
Mark Roddy
Modified the override_data() method so that tuples of python objects are passed in instead of a list of strings with hardcoded separators. I don't even want to think about what debugging that is like.
Mark Roddy
Added in depth code comments explaining how to define a test case, and comments explaining what the given test fixture is doing and why.
Mark Roddy
Wrote out the section on debugging which I missed earlier.
Mark Roddy
No longer requiring the 'n' and 'reducers' keys in the PigTest.Args attribute. These will be set to defaults if unspecified. If a user specifies them, those values will be used.
Mark Roddy
Finally wrote out the readme.
Mark Roddy
I like this directory structure a lot better. Putting all the testing stuff into the tests directory.
Mark Roddy
Adding a suite script to make it easier to run all the tests at once.
Mark Roddy
Override the dumpSchema() method on the base class as it for some reason thinks it needs to print to stdout which is making test output all kinds of ugly.
Mark Roddy
Removing setting of variable that is immediately undone.
Mark Roddy
Added disabling of log messages from pig unless the verbose option is specified.
Mark Roddy
Added customized version of unittest program and test result so that the path to the script that was ran after variable substitution and overriding was performed is displayed. This makes it much easier to debug failed tests.
Mark Roddy
Renamed the overrideToData to override_to_data to make it more in line with the names of other methods on the class.
Mark Roddy
Simplied logic in the constructor.
Mark Roddy
Removed the 'getCluster()' method which was doing two things: creating the 'cluster' object and the pig run time object. The cluster is only ever used by the overrideToData() method (which probably won't be used very much), so just create it in that method locally. The pig object is necessary to do anything with this class so now being created in the constructor. Needed to do this anyway in the future to allow for the mode (local vs hadoop) to be specified as an argument.
  1. Prev
  2. Next