New!
The TAU Performance Analysis and Debugging in PToolsRTE tutorial is now available.
The Parallel Tools Runtime Environment (PToolsRTE) provides a consistent environment for development and deployment of Python-based parallel applications. It is a Python distribution that can be installed easily on a variety of HPC and desktop platforms. pyMPI, mpi4py, numpy, scipy, swig, f2py, and matplotlib are all fully supported (see here for a complete list). It is available for free download.
ParaTools supports PToolsRTE on all DoD Supercomputing Resource Centers (DSRCs) as part of the DoD HPC Baseline Configuration for Common Open Source High Productivity Programming Languages (BC Policy FY10-02). The CREATE-AV projects Kestrel and Helios use PToolsRTE as their primary runtime environment.
| Site | System | PToolsRTE | Required Modules |
|---|---|---|---|
| AFRL | Spirit | 0.7 | intel-compilers/13.0.1, intelmpi/4.0.3.008 |
| Utility Server | 0.7 | TBD | |
| ARL | Harold | 0.7 | compiler/gcc/4.4.1, mpi/openmpi/1.4.1 |
| Pershing | 0.7 | compiler/intel/13.1.0, mpi/intelmpi/4.1.0 | |
| Utility Server | 0.7 | compiler/intel/13.0, mpi/intel/openmpi/1.6.3 | |
| ERDC | Garnet | 0.7 | PrgEnv-gnu/4.0.46, fftw/3.3.0.3 |
| Diamond | 0.7 | compiler/intel12.1.003, mpi/intelmpi-4.0.3 | |
| Utility Server | 0.7 | compiler/intel/13.0, mpi/intel/openmpi/1.4.3 | |
| NAVO | Haise | 0.7 | compiler/intel/13.0, mpi/intel/impi/4.1.0 |
| Kilrain | 0.7 | compiler/intel/13.0, mpi/intel/impi/4.1.0 | |
| Utility Server | 0.7 | compiler/intel/13.0, mpi/intel/openmpi/1.6.3 | |
| MHPCC | Riptide | 0.7 | intel/13.0, impi/4.1 |
| Utility Server | 0.7 | compiler/intel/12.1, mpi/intel/openmpi/1.4.3 |
PToolsRTE 0.7
PToolsRTE 0.7 is based on Python 2.7.3 and includes the following packages:
| Name | Version | Name | Version | Name | Version | Name | Version |
|---|---|---|---|---|---|---|---|
| Cheetah | 2.4.4 | db | 5.3.21 | libpng | 1.6.2 | pyzmq | 2.2.0.1 |
| FormEncode | 1.2.6 | doxygen | 1.8.4 | matplotlib | 1.2.1 | readline | 6.2 |
| Imaging | 1.1.7 | expat | 2.1.0 | mpi4py | 1.3 | scipy | 0.12.0 |
| Markdown | 2.3.1 | fontconfig | 2.10.0 | ncurses | 5.9 | setuptools | 0.9.8 |
| PyOpenGL | 3.0.2 | fpconst | 0.7.2 | nose | 1.3.0 | swig | 2.0.9 |
| PyOpenGL-accelerate | 3.0.2 | gdbm | 1.10 | numpy | 1.7.1 | sympy | 0.7.2 |
| Python | 2.7.3 | gettext | 0.18.2 | openssl | 1.0.1e | SOAPpy | 0.12.5 |
| graphviz | 2.30.1 | paramiko | 1.10.1 | SQLObject | 1.4.0 | gtest | 1.6.0 |
| pcre | 8.32 | szip | 2.1 | SQLite | 3.7.17 | h5py | 1.3.1 |
| pexpect | 2.3 | tornado | 3.0.1 | Twisted | 13.0.0 | pip | 1.3.1 |
| virtualenv | 1.9.1 | basemap | 1.0.6 | hdf5 | 1.6.6 | pixman | 0.30.0 |
| wstools | 0.4.3 | blas | netlib | py2cairo | 1.10.0 | wxPython | 2.9.4.0 |
| boost | 1.53.0 | ipython | 0.13.2 | pyMPI | 2.5b0 | zlib | 1.2.8 |
| bzip2 | 1.0.6 | lapack | 3.4.2 | pyOpenSSL | 0.13 | zope.interface | 4.0.5 |
| cairo | 1.10.2 | lcms2 | 2.4 | pycrypto | 2.6 | cmake | 2.8.11 |
| libiconv | 1.14 | pygments | 1.6 |
Download
- All-in-one installation package.
- Size: 581665827 bytes (555M)
- MD5: 9f11e25930aacffde90ded41280652c1
Installation
- Extract the compressed tar file.
- Run configure.sh install from the command line.
- Follow the on-screen instructions.
Usage
You will need to add PToolsRTE to your shell environment before you can use it. You can do this by loading the module file, or by sourcing the appropriate initialization script:
- Module file (any shell):
module use /path/to/ptoolsrte/etc module load ptoolsrte
- Bash:
source /path/to/ptoolsrte/etc/ptoolsrte.bashrc
- C-Shell:
source /path/to/ptoolsrte/etc/ptoolsrte.cshrc
PToolsRTE 0.6
PToolsRTE 0.6 improves performance and includes new packages. It has not been tested on all platforms.
Download the all-in-one package.
Installation and usage are the same as 0.55.
PToolsRTE 0.55
PToolsRTE 0.55 is based on Python 2.7.2. Core packages are guaranteed to be installed and fully functional. Support packages are only installed when required. Optional packages may or may not be installed.
| Core | |||||||||
|---|---|---|---|---|---|---|---|---|---|
| Name | Version | Name | Version | Name | Version | Name | Version | ||
| boost | 1.47.0 | hdf5 | 1.8.8 | pycairo | 1.8.10 | setuptools | 0.6c11 | ||
| cairo | 1.8.10 | Markdown | 2.0.3 | pycrypto | 2.3 | SOAPpy | 0.12.5 | ||
| Cheetah | 2.4.4 | matplotlib | 1.1.0 | pyMPI | 2.5b0 | SQLObject | 1.1.3 | ||
| cmake | 2.8.6 | mpi4py | 1.2.2 | PyOpenGL | 3.0.1 | swig | 2.0.4 | ||
| FormEncode | 1.2.4 | nose | 1.0.0 | PyOpenGL-accelerate | 3.0.1 | tau | 2.21.2 | ||
| fpconst | 0.7.2 | numpy | 1.6.1 | pyOpenSSL | 0.11 | Twisted | 11.0.0 | ||
| gtest | 1.6.0 | paramiko | 1.7.7.1 | Python | 2.7.2 | wstools | 0.3 | ||
| h5py | 2.0.1 | pixman | 0.20.2 | scipy | 0.10.0 | wxPython | 2.9.2.4 | ||
| Support | |||||||||
|---|---|---|---|---|---|---|---|---|---|
| Name | Version | Name | Version | Name | Version | Name | Version | ||
| atlas | 3.8.3 | gettext | 0.18.1.1 | libiconv | 1.14 | pkg-config | 0.26 | ||
| binutils | 2.20 | glib | 2.30.2 | libpng | 1.5.5 | readline | 6.2 | ||
| blas | 20.01.2011 | graphviz | 2.28.0 | ncurses | 5.9 | scons | 2.1.0 | ||
| bzip2 | 1.0.6 | gtk2 | 2.18.9 | numscons | 0.12.0 | szip | 2.1 | ||
| doxygen | 1.7.5.1 | Imaging | 1.1.7 | openssl | 1.0.0g | zlib | 1.2.6 | ||
| expat | 2.0.1 | lapack | 3.4.0 | pango | 1.24.5 | zope.interface | 3.8.0 | ||
| fontconfig | 2.8.0 | lcms | 1.19 | pcre | 8.13 | ||||
| freetype | 2.4.6 | libffi | 3.0.10 | pdtoolkit | 3.17 | ||||
| Optional | |||||||||
|---|---|---|---|---|---|---|---|---|---|
| Name | Version | Name | Version | Name | Version | ||||
| mpich2 | 1.4.1p1 | openmpi | 1.4.4 | openmpi | 1.5.4 | ||||
Download
The following target configurations have been tested and are officially supported. If you have a similar or unsupported configuration, download the distribution that most closely matches your configuration. The all-in-one distribution is most likely to succeed.
| Operating System | Distribution | Compiler | CPU Arch. | |
|---|---|---|---|---|
| Linux | Red Hat Enterprise Linux 5.x | GNU | x86_64 | Download |
| SuSE Linux Enterprise Server 11 | Download | |||
| SuSE Linux Enterprise Server 10 | Download | |||
| Cray CLE 3.x | Download | |||
| Cray CLE 2.x | Download | |||
| Fedora 16 | Download | |||
| Fedora 14 | Download | |||
| AIX | 5.3 | IBM XL | powerpc64 | Download |
| OS X (Darwin) | Lion (10.7) | GNU | x86_64 | Download |
| Snow Leopard (10.6) | i386 | Download | ||
| All-in-one download for all platforms | ||||
Installation
- Extract the compressed tar file.
-
Run configure.sh install from the command line.
- Follow the on-screen instructions.
Usage
You will need to add PToolsRTE to your shell environment before you can use it. You can do this by loading the module file, or by sourcing the appropriate initialization script:
- Module file (any shell):
module use /path/to/ptoolsrte/etc module load ptoolsrte
- Bash:
source /path/to/ptoolsrte/etc/ptoolsrte.bashrc
- C-Shell:
source /path/to/ptoolsrte/etc/ptoolsrte.cshrc
Legacy Versions
These older versions of PToolsRTE are available for download. To install a legacy version, please untar and configure the package. It will prompt you for additional packages (such as pyMPI or openmpi) that you may build on the target platform. Once it completes, simply source the cshrc or bashrc file from the ptoolsrte/etc directory to add all the packages to your PATH.
To verify that the packages are loaded correctly, please follow the following steps:
./configure
source etc/ptoolsrte.bashrc [or .cshrc]
Check to see the output:
python
>>> import numpy
>>>
%
0.5
- ptoolsrte-0.5_OSX10.5.tar.gz
- ptoolsrte-0.5_OSX10.6.tar.gz
- ptoolsrte-0.5a_OSX10.6.tar.gz
- ptoolsrte-0.5b_OSX10.6.tar.gz
- ptoolsrte-0.5c_OSX10.6.tar.gz
0.4
- ptoolsrte-0.4_rhel4_x86_64.tar.gz
- ptoolsrte-0.4_rhel5_i386.tar.gz
- ptoolsrte-0.4_rhel5_x86_64.tar.gz
- ptoolsrte-0.4_rhel6_x86_64.tar.gz
- ptoolsrte-0.4_sles10_x86_64.tar.gz
- ptoolsrte-0.4_ubuntulucid.tar.gz
0.3
- ptoolsrte-0.32-rhel5-cheetah.tar.gz: Red Hat EL 5 (Cheetah) Linux x86_64 v0.32 (w/ Octave, mpi4py, ipython)
- ptoolsrte-0.31.1-centos5.2-tar.gz
- ptoolsrte-0.31-centos5.2-mist.tar.gz: Centos 5.2 Linux x86_64 (mist) v0.31 (w/ mpi4py, iPython)
- ptoolsrte-0.31-RHEL4-HP.tar.gz: Red Hat EL 4 HP-XC cluster x86_64 v0.31
- ptoolsrte-0.31-einstein.tar.gz: Cray XT5 Front-end only (with mpl_toolkits.basemap, Einstein/pingo) v0.31
- ptoolsrte-0.31-fc11-i386.tar.gz: Fedora Core 11 Linux i386 (32 bit, pt01) v0.31
- ptoolsrte-0.31-ia64-hawk.tar.gz: SGI Altix IA64 Linux (Hawk, Columbia) v0.31
- ptoolsrte-0.31-mandriva.tar.gz: Mandriva Desktops (v2008-0, 2009) Linux x86_64 v0.31
- ptoolsrte-0.31-rhel5-strider.tar.gz: Red Hat EL 5 (Strider) Linux x86_64 v0.31
- ptoolsrte-0.31-rhel5-so-tar.gz: Red Hat EL 5 (Strider SO cluster)
- ptoolsrte-0.31-rhel4-falcon-tar.gz
- ptoolsrte-0.31-suse-harold.tar.gz: SGI x86_64 Suse Linux ProPack 6 (diamond, harold) v0.31
- ptoolsrte-0.31-suse-mjm.tar.gz: Suse SLES10 x86_64 (mjm) v0.31
- ptoolsrte-0.3-mandriva.tar.gz
- ptoolsrte-0.3-redhat-strider.tar.gz
- ptoolsrte-0.3-rhel5-strider.tar.gz
0.2
- ptoolsrte-0.22-davinci.tar.gz: IBM Power6 AIX 5.3 (DaVinci) v0.22 (w/ matplotlib 1.0)
- ptoolsrte-0.21-davinci.tar.gz
- ptoolsrte-0.21-suse-mjm.tar.gz
- ptoolsrte-0.2-centos.tar.gz
- ptoolsrte-0.2-centos4.7.tar.gz
- ptoolsrte-0.2-mpl-einstein.tar.gz
- ptoolsrte-0.2-strider.tar.gz
- ptoolsrte-0.2-suse.tar.gz
- ptoolsrte-0.2-thought-i386.tar.gz
- ptoolsrte-einstein-0.2.tgz
0.1
- ptoolsrte-0.19-macosx-local.tar.gz
- ptoolsrte-0.17-macosx-local.tar.gz
- ptoolsrte-0.15-macosx.tar.gz
- ptoolsrte-0.1-centos4.7.tar.gz
- ptoolsrte-0.1-columbia.tar.gz
- ptoolsrte-0.1-ia64.tar.gz
- ptoolsrte-0.1-ipython.tar.gz
- ptoolsrte-0.1-m2008-0.tar.gz
- ptoolsrte-0.1-macosx.tar.gz
Support
Please contact us with questions or for support. We also encourage you to submit a ticket to help@ccac.hpc.mil.