Parallel Programming with MPI Programming teaches parellel programming using the MPI library of extensions to C and Fortran. The Message-Passing Interface or MPI is the most widely used standards for parallel programming.