Collective data movement

Collective Data Movement

• Three types of collective data movement,
  • Broadcast
  • Gather
  • Scatter
• In the ``all gather'' routine all processes receive the result. This concatenates data from each process.
• The ``all-to-all'' routine each process sends to, and receives from, all other processes