ewsdn2015 lt

4
Concept and Design of SDN-enhanced MPI Framework Keichi Takahashi 1 , Dashdavaa Khureltulga 1 , Baatarsuren Munkhdorj 1 , Yoshiyuki Kido 1 , Susumu Date 1 , Hiroaki Yamanaka 2 , Eiji Kawai 2 and Shinji Shimojo 2 Osaka University 1 , National Institute of Information Communications Technology 2

Upload: keichi-takahashi

Post on 16-Apr-2017

234 views

Category:

Technology


0 download

TRANSCRIPT

Page 1: EWSDN2015 LT

Concept and Design of SDN-enhanced MPI Framework

Keichi Takahashi1, Dashdavaa Khureltulga1, Baatarsuren Munkhdorj1, Yoshiyuki Kido1, Susumu Date1, Hiroaki Yamanaka2, Eiji Kawai2

and Shinji Shimojo2

Osaka University1, National Institute of Information Communications Technology2

Page 2: EWSDN2015 LT

• Modern HPC (High Performance Computing) systems are built on a computer cluster architecture.

• Due to the recent rapid scale-out in node number,the cost and complexity of HPC interconnects are getting increasingly high.

• MPI (Message Passing Interface) is the de facto standard library to develop parallel distributed applications on clusters.

Interconnect of HPC systems

2

Page 3: EWSDN2015 LT

Towards SDN-enhanced MPI

3

SDN$enabled+Interconnect�

Compu5ng+Nodes�

MPI+Applica5on�

MPI+Library�

MPI+Applica5on�

MPI+Library�

MPI+Applica5on�

MPI+Library�

Applica5on+Informa5on

MPI+Applica5on$aware+control+of+interconnect�

Netw

ork+Informa5on

Leverage SDN architecture to realize tight integration between MPI application and network interconnect; MPI application-aware dynamic interconnect control.

Several PoCs:

• Offloading MPI broadcast to the network

• Dynamic load balancing of traffic load using MPI-layer information

Page 4: EWSDN2015 LT

Proposed Architecture of the Framework

4

SDN$Controller�

SDN$Switch�

MPI$Applica6on�

MPI$Library�

Tagging$Module�

MPI$Packet�

Tagged

$MPI$Pa

cket�

(3)$Packet$control$based$on$tags�(1)$PreDinstall$rules�

Untagged$MPI$Packet�

(2)$Packets$are$tagged$with$applica6on$level$info�

MPI$Library�

Network$Stack�

User$MPI$Applica8on�

Tagging$Module�

MPI$Packet� MPI$Packet�

User$Space� Kernel$Space�

Socket$API�

System$Call�

MPI�To$NIC�M

PI$Packet�

Tagging Mechanism

Overall Architecture