1. Cheng Soon Ong
  2. pythongrid

Commits

ckwidmer  committed e4ca31a

Edited online

  • Participants
  • Parent commits b93f8be
  • Branches default

Comments (0)

Files changed (1)

File Home.wiki

View file
-== Why ==
-
-We focus on what is usually known as [[http://en.wikipedia.org/wiki/Embarrassingly_parallel|embarassingly parallel]] problems, where there is no communication between the different tasks. These problems are particularly suited to cluster computing, since there is essentially no overhead for parallelisation. We provide a python interface for submitting and collecting cluster jobs via the [[http://www.drmaa.org/|DRMAA]] framework, instead of using the standard command line interface (e.g. qsub or bsub). This means that the user can write all the control flow in python.
-
-== Implementation notes ==
-
-This project uses [[http://code.google.com/p/drmaa-python/|drmaa-python]] to communicate with the queue master and depends on the file system (via cPickle) to transmit variables between the master node and the compute nodes.
-
-== Quick start example ==
-
-{{{
-#!python
-
-def computeFactorial(n):
-    """
-    computes factorial of n
-    """
-    ret=1
-    for ix in range(n):
-        ret=ret*(ix+1)
-    return ret
-
-inputvec = [[3], [5], [10], [15]]
-print 'Computing the factorials of %s' % str(inputvec)
-jobs=[]
-
-for input in inputvec:
-    job = Job(computeFactorial, input)
-    job.h_vmem="300M"
-    jobs.append(job)
-
-# All the work is done here
-processed = process_jobs(jobs)
-
-for (ix, job) in enumerate(processed):
-    print "Job #", ix, "- ret: ", str(job.ret)[0:10]
-
-}}}
-
+== We have moved to Google Code, please visit: ==
+[[http://code.google.com/p/pythongrid/|our new home]]