PToolsRTE Logo

PToolsRTE - Parallel Tools Runtime Environment

The Parallel Tools Runtime Environment (PToolsRTE) provides a consistent environment for development and deployment of Python-based parallel applications. It is a Python distribution that can be installed easily on a variety of HPC and desktop platforms. pyMPI, mpi4py, numpy, scipy, swig, f2py, and matplotlib are all fully supported (see here for a complete list). It is available for free download.

ParaTools supports PToolsRTE on all DoD Supercomputing Resource Centers (DSRCs) as part of the DoD HPC Baseline Configuration for Common Open Source High Productivity Programming Languages (BC Policy FY10-02). The CREATE-AV projects Kestrel and Helios use PToolsRTE as their primary runtime environment.

Site

System

PToolsRTE

Required Modules

AFRL

Spirit

0.7

intel-compilers/13.0.1, intelmpi/4.0.3.008

Utility Server

0.7

TBD

ARL

Harold

0.7

compiler/gcc/4.4.1, mpi/openmpi/1.4.1

Pershing

0.7

compiler/intel/13.1.0, mpi/intelmpi/4.1.0

Utility Server

0.7

compiler/intel/13.0, mpi/intel/openmpi/1.6.3

ERDC

Garnet

0.7

PrgEnv-gnu/4.0.46, fftw/3.3.0.3

Diamond

0.7

compiler/intel12.1.003, mpi/intelmpi-4.0.3

Utility Server

0.7

compiler/intel/13.0, mpi/intel/openmpi/1.4.3

NAVO

Haise

0.7

compiler/intel/13.0, mpi/intel/impi/4.1.0

Kilrain

0.7

compiler/intel/13.0, mpi/intel/impi/4.1.0

Utility Server

0.7

compiler/intel/13.0, mpi/intel/openmpi/1.6.3

MHPCC

Riptide

0.7

intel/13.0, impi/4.1

Utility Server

0.7

compiler/intel/12.1, mpi/intel/openmpi/1.4.3

PToolsRTE 0.7

PToolsRTE 0.7 is based on Python 2.7.3 and includes the following packages:

Name

Version

Name

Version

Name

Version

Name

Version

Cheetah

2.4.4

db

5.3.21

libpng

1.6.2

pyzmq

2.2.0.1

FormEncode

1.2.6

doxygen

1.8.4

matplotlib

1.2.1

readline

6.2

Imaging

1.1.7

expat

2.1.0

mpi4py

1.3

scipy

0.12.0

Markdown

2.3.1

fontconfig

2.10.0

ncurses

5.9

setuptools

0.9.8

PyOpenGL

3.0.2

fpconst

0.7.2

nose

1.3.0

swig

2.0.9

PyOpenGL-accelerate

3.0.2

gdbm

1.10

numpy

1.7.1

sympy

0.7.2

Python

2.7.3

gettext

0.18.2

openssl

1.0.1e

SOAPpy

0.12.5

graphviz

2.30.1

paramiko

1.10.1

SQLObject

1.4.0

gtest

1.6.0

pcre

8.32

szip

2.1

SQLite

3.7.17

h5py

1.3.1

pexpect

2.3

tornado

3.0.1

Twisted

13.0.0

pip

1.3.1

virtualenv

1.9.1

basemap

1.0.6

hdf5

1.6.6

pixman

0.30.0

wstools

0.4.3

blas

netlib

py2cairo

1.10.0

wxPython

2.9.4.0

boost

1.53.0

ipython

0.13.2

pyMPI

2.5b0

zlib

1.2.8

bzip2

1.0.6

lapack

3.4.2

pyOpenSSL

0.13

zope.interface

4.0.5

cairo

1.10.2

lcms2

2.4

pycrypto

2.6

cmake

2.8.11

libiconv

1.14

pygments

1.6

Download

Installation

  1. Extract the compressed tar file.
  2. Run configure.sh install from the command line.

  3. Follow the on-screen instructions.

Usage

You will need to add PToolsRTE to your shell environment before you can use it. You can do this by loading the module file, or by sourcing the appropriate initialization script:

  • Module file (any shell):
    module use /path/to/ptoolsrte/etc 
    module load ptoolsrte
    
  • Bash:
    source /path/to/ptoolsrte/etc/ptoolsrte.bashrc
    
  • C-Shell:
    source /path/to/ptoolsrte/etc/ptoolsrte.cshrc
    

PToolsRTE 0.6

PToolsRTE 0.6 improves performance and includes new packages. It has not been tested on all platforms.

Download the all-in-one package.

Installation and usage are the same as 0.55.

PToolsRTE 0.55

PToolsRTE 0.55 is based on Python 2.7.2. Core packages are guaranteed to be installed and fully functional. Support packages are only installed when required. Optional packages may or may not be installed.

Core

Name

Version

Name

Version

Name

Version

Name

Version

boost

1.47.0

hdf5

1.8.8

pycairo

1.8.10

setuptools

0.6c11

cairo

1.8.10

Markdown

2.0.3

pycrypto

2.3

SOAPpy

0.12.5

Cheetah

2.4.4

matplotlib

1.1.0

pyMPI

2.5b0

SQLObject

1.1.3

cmake

2.8.6

mpi4py

1.2.2

PyOpenGL

3.0.1

swig

2.0.4

FormEncode

1.2.4

nose

1.0.0

PyOpenGL-accelerate

3.0.1

tau

2.21.2

fpconst

0.7.2

numpy

1.6.1

pyOpenSSL

0.11

Twisted

11.0.0

gtest

1.6.0

paramiko

1.7.7.1

Python

2.7.2

wstools

0.3

h5py

2.0.1

pixman

0.20.2

scipy

0.10.0

wxPython

2.9.2.4

Support

Name

Version

Name

Version

Name

Version

Name

Version

atlas

3.8.3

gettext

0.18.1.1

libiconv

1.14

pkg-config

0.26

binutils

2.20

glib

2.30.2

libpng

1.5.5

readline

6.2

blas

20.01.2011

graphviz

2.28.0

ncurses

5.9

scons

2.1.0

bzip2

1.0.6

gtk2

2.18.9

numscons

0.12.0

szip

2.1

doxygen

1.7.5.1

Imaging

1.1.7

openssl

1.0.0g

zlib

1.2.6

expat

2.0.1

lapack

3.4.0

pango

1.24.5

zope.interface

3.8.0

fontconfig

2.8.0

lcms

1.19

pcre

8.13

freetype

2.4.6

libffi

3.0.10

pdtoolkit

3.17

Optional

Name

Version

Name

Version

Name

Version

mpich2

1.4.1p1

openmpi

1.4.4

openmpi

1.5.4

Download

The following target configurations have been tested and are officially supported. If you have a similar or unsupported configuration, download the distribution that most closely matches your configuration. The all-in-one distribution is most likely to succeed.

Operating System

Distribution

Compiler

CPU Arch.

Linux

Red Hat Enterprise Linux 5.x

GNU

x86_64

Download

SuSE Linux Enterprise Server 11

Download

SuSE Linux Enterprise Server 10

Download

Cray CLE 3.x

Download

Cray CLE 2.x

Download

Fedora 16

Download

Fedora 14

Download

AIX

5.3

IBM XL

powerpc64

Download

OS X (Darwin)

Lion (10.7)

GNU

x86_64

Download

Snow Leopard (10.6)

i386

Download

All-in-one download for all platforms

Installation

  1. Extract the compressed tar file.
  2. Run configure.sh install from the command line.

  3. Follow the on-screen instructions.

Usage

You will need to add PToolsRTE to your shell environment before you can use it. You can do this by loading the module file, or by sourcing the appropriate initialization script:

  • Module file (any shell):
    module use /path/to/ptoolsrte/etc 
    module load ptoolsrte
    
  • Bash:
    source /path/to/ptoolsrte/etc/ptoolsrte.bashrc
    
  • C-Shell:
    source /path/to/ptoolsrte/etc/ptoolsrte.cshrc
    

Legacy Versions

These older versions of PToolsRTE are available for download. To install a legacy version, please untar and configure the package. It will prompt you for additional packages (such as pyMPI or openmpi) that you may build on the target platform. Once it completes, simply source the cshrc or bashrc file from the ptoolsrte/etc directory to add all the packages to your PATH.

To verify that the packages are loaded correctly, please follow the following steps:

./configure
make
source etc/ptoolsrte.bashrc [or .cshrc]

Check to see the output:

python
>>> import numpy
>>>
%

0.5

0.4

0.3

0.2

0.1

Support

Please contact us with questions or for support. We also encourage you to submit a ticket to help@ccac.hpc.mil.