Tuesday, November 9, 2010

Using Multiprocessing in Python

For a newbie to multi CPU processing, I have to say that the python 2.7 documentation is difficult to understand at best and incomplete at worst.  Searching the web I came across two tutorials that I found to be very helpful.

The first is by Doug Hellmann in his Python Module of the Week series (PyMOTW), he gave much clearer examples of how the multiprocessing module worked.

However, I still needed more information.  I found enough to get me over the hump in solving my problem from Norman Matloff's (pdf link) tutorial from UC Davis, called "Programming on Parallel Machines".  Chapter 3 is called "The Python Threads and Multiprocessing Modules".  Not exhaustive, but very helpful.  I will probably be referring to it again as I move the code from a single multiprocessor machine to a cluster.

Other information on other types of Parallel Processing (Cluster, Cloud, Grid) and the related python libraries can be found here at the PythonWiki

No comments:

Post a Comment