Commits

Show all
Author Commit Message Labels Comments Date
Russell Power
Return results...
Russell Power
Stub in support for remote stack trace dumps. Allow specification of blocksize option for tables.
Russell Power
Update documentation.
Russell Power
Merge.
Russell Power
Better handling of status updates and remote logging; Playing around with curses/tkinter interface for worker status.
Russell Power
Better logging; rather then sucking down stderr and stdout, workers now send log messages via UDP to the controller and also log to local temp files. Worker watchdog now runs in a separate thread; this allows workers to be shutdown in in the middle of long running map tasks.
Russell Power
Better logging; rather then sucking down stderr and stdout, workers now send log messages via UDP to the controller and also log to local temp files. Worker watchdog now runs in a separate thread; this allows workers to be shutdown in in the middle of long running map tasks.
Russell Power
Up version.
Russell Power
Have reducers start a separate server for handling map input data; return a client proxy object to pass around. Add test for running with multiple output shards.
Russell Power
Updates...
Russell Power
typo.
Russell Power
Version tick.
Russell Power
Reducers now open a listening port and accept incoming map data, rather then requiring communication via the filesystem. Switch to using eventlet, as native threading was behaving erratically.
Russell Power
Log should take multiple arguments. Open stdout for write!
Russell Power
Update version.
Russell Power
Capture stdin and stdout prior to executing user code, to avoid confusing breakages in pickling. Some documentation cleanup.
Russell Power
Better logging; capture stderr messages from remote workers and log them all at once in the case of exceptions.
Russell Power
Add some simple default mapper and reducers. Allow a class to be specified for mappers and reducers; an instance of the class will be generated for each task as needed.
Russell Power
Get rid of distribute_setup.
Russell Power
Add distribute requirement.
Russell Power
Update dist URL.
Russell Power
Fix description.
Russell Power
Fix web url.
Russell Power
Move connections to a module. Add test cases for resources, README file, cleanup setup.
Russell Power
Initial commit.