symbiotic routing in future data center 工科三 陳泰穎. outline 1. camcube 1. traditional data...

SYMBIOTIC ROUTING IN FUTURE DATA CENTER

工科三 陳泰穎

Outline

1. CamCube1. Traditional data center2. The problems3. CamCube philosophy4. Feature5. What’s different?

2. Symbiotic Routing1. Service

1. TCP/IP2. VM distribution service3. Cache service4. Aggregation service

2. Properties3. Conclusion

1. CamCube – the Goal

Design a data center from the perspective of a distributed systems builder

1.1 Traditional Data Center

Distributed system philosophy vs. reality

1.2 The Problems ( of the traditional data

center)

Addressing Bandwidth Server has little or no control over

network

1.3 ComCube Philosophy

No Swiches Topology: 3D Torus

1.3 CamCube Philosophy – why? The CamCube API

(x,y,z) coordinate Coordinate easily remapped

in case of failure 1-hop API (send/recv from

1-hop neighbors)

1.4 feature

Two types of networks: Dierect-connect for intra-server traffic Switched network for inter-camcube traffic

Multiple independent network can be used

What’s different?

High Performance Computing CamCube make topology explicit Service can intercept(modify) packet on path Failure resilience Multiple independent service

Distributed System Key-space naturally mapped physically

Networking No switches/routers (symmetry of role) Not using TCP/IP

2. Symbiotic Routing

Symbiotic Routing is coupled with CamCube because: Each server link to other server closer Each server plays a role of switch/router too Each server share the resourse

(memory/FS)

2.1 TCP/IP Service

Required to implement TCP/IP for existing service

CamCube use its own method to enhance performance

2.2 VM distribution Service

Traditional: may create high number of interior server and edges (of tree of file system) than necessary.

New approach with CamCube: Use its topology feature. The custom routing protocol is

hierarchical, recursively dividing the coordinate space into 3D mini-cubes.

2.3 Cache service

Traditional remote cache Here Llcal cache

Not local cache

2.4 Aggregation

Don’t have to do traverse Use 3D topology feature (ex. X->y->z)

2.5 Properties

Key to server mapping Path specification (x,y,z) Fault-tolerance Multipath Packet buffers Prioritization

3. Conclusion

Symbiotic Routing is coupled with CamCube-like Infrastructure

This routing method provide flexible implement of service (protocol)

Support in-network packet processing CamCube + API(this routing method) =

easy-built data center

Comment

Challenge If service goes inner the CamCube, chances

may be multi-hop network. Beyond network efficiency, what’s else

can we benefit from CamCube ? High level switch/router is costly The energy saves by remove switch/router

Make better use of energy consumption in computation

Thank you