Files changed (1)
-We focus on what is usually known as [[http://en.wikipedia.org/wiki/Embarrassingly_parallel|embarassingly parallel]] problems, where there is no communication between the different tasks. These problems are particularly suited to cluster computing, since there is essentially no overhead for parallelisation. We provide a python interface for submitting and collecting cluster jobs via the [[http://www.drmaa.org/|DRMAA]] framework, instead of using the standard command line interface (e.g. qsub or bsub). This means that the user can write all the control flow in python.
-This project uses [[http://code.google.com/p/drmaa-python/|drmaa-python]] to communicate with the queue master and depends on the file system (via cPickle) to transmit variables between the master node and the compute nodes.