Design and Implementation of SDN-enhanced MPI Broadcast Targeting a Fat-Tree Interconnect

Hiroaki Morimoto
Khureltulga Dashdavaa
Keichi Takahashi
Yoshiyuki Kido
Susumu Date
Shinji Shimojo

© 2017 IEEE. To meet the rising demands on high-performance computing, the number of computing nodes composing a high- performance computing system has been continuously growing. Simultaneously, the complexity of networks linking such computing nodes, or the interconnect, has also been increasing. Taking the scale-out of computing nodes in future high-performance computing systems into consideration, it is unrealistic to build more nodes with the strategy of building a network capacity sufficient enough to accommodate maximum traffic. We have worked on SDN-enhanced MPI based on the challenging idea that network traffic should be controlled based on the time-variant requirements of applications running on the high-performance computing systems. In particular, this paper aims to accelerate MPI-Bcast execution through the use of Software Defined Net-working (SDN), targeting a high-performance computing system with a Fat-tree interconnect. The MPI-Bcast proposed in this paper has the functionality of making a delivery tree of data based on traffic information obtained from SDN switches that compose the deployed interconnect. Our evaluation observed our proposed MPI-Bcast was executed up to 8.6 times faster than our previous MPI-Bcast implementation when a 700 Mbps pseudo traffic was flowed on the Fat-tree interconnect.

2017 International Conference on High Performance Computing & Simulation (HPCS)

IEEE

252

258

10.1109/hpcs.2017.46

https://doi.org/10.1109/hpcs.2017.46
http://xplorestaging.ieee.org/ielx7/8030510/8035032/08035085.pdf?arnumber=8035085