Heterogeneous computing with MPI

MPI on Heterogeneous Networks

• MPI provides some support for distributed computing on hetergeneous networks.
  • Data type is supplied in all communication routines, permitting conversion between different internal data representations.
  • Support for process groups allows different machine clusters to work on distinct tasks.

BUT

• MPI provides no means of specifying the physical resources to be used.
• Provides limited support for assigning processes to processors.