symbiotic routing in future data center 工科三 陳泰穎. outline 1. camcube 1. traditional data...

18
SYMBIOTIC ROUTING IN FUTURE DATA CENTER 工工工 工工工

Upload: branden-young

Post on 19-Jan-2016

231 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: SYMBIOTIC ROUTING IN FUTURE DATA CENTER 工科三 陳泰穎. Outline 1. CamCube 1. Traditional data center 2. The problems 3. CamCube philosophy 4. Feature 5. What’s

SYMBIOTIC ROUTING IN FUTURE DATA CENTER

工科三 陳泰穎

Page 2: SYMBIOTIC ROUTING IN FUTURE DATA CENTER 工科三 陳泰穎. Outline 1. CamCube 1. Traditional data center 2. The problems 3. CamCube philosophy 4. Feature 5. What’s

Outline

1. CamCube1. Traditional data center2. The problems3. CamCube philosophy4. Feature5. What’s different?

2. Symbiotic Routing1. Service

1. TCP/IP2. VM distribution service3. Cache service4. Aggregation service

2. Properties3. Conclusion

Page 3: SYMBIOTIC ROUTING IN FUTURE DATA CENTER 工科三 陳泰穎. Outline 1. CamCube 1. Traditional data center 2. The problems 3. CamCube philosophy 4. Feature 5. What’s

1. CamCube – the Goal

Design a data center from the perspective of a distributed systems builder

Page 4: SYMBIOTIC ROUTING IN FUTURE DATA CENTER 工科三 陳泰穎. Outline 1. CamCube 1. Traditional data center 2. The problems 3. CamCube philosophy 4. Feature 5. What’s

1.1 Traditional Data Center

Distributed system philosophy vs. reality

Page 5: SYMBIOTIC ROUTING IN FUTURE DATA CENTER 工科三 陳泰穎. Outline 1. CamCube 1. Traditional data center 2. The problems 3. CamCube philosophy 4. Feature 5. What’s

1.2 The Problems ( of the traditional data

center)

Addressing Bandwidth Server has little or no control over

network

Page 6: SYMBIOTIC ROUTING IN FUTURE DATA CENTER 工科三 陳泰穎. Outline 1. CamCube 1. Traditional data center 2. The problems 3. CamCube philosophy 4. Feature 5. What’s

1.3 ComCube Philosophy

No Swiches Topology: 3D Torus

Page 7: SYMBIOTIC ROUTING IN FUTURE DATA CENTER 工科三 陳泰穎. Outline 1. CamCube 1. Traditional data center 2. The problems 3. CamCube philosophy 4. Feature 5. What’s

1.3 CamCube Philosophy – why? The CamCube API

(x,y,z) coordinate Coordinate easily remapped

in case of failure 1-hop API (send/recv from

1-hop neighbors)

Page 8: SYMBIOTIC ROUTING IN FUTURE DATA CENTER 工科三 陳泰穎. Outline 1. CamCube 1. Traditional data center 2. The problems 3. CamCube philosophy 4. Feature 5. What’s

1.4 feature

Two types of networks: Dierect-connect for intra-server traffic Switched network for inter-camcube traffic

Multiple independent network can be used

Page 9: SYMBIOTIC ROUTING IN FUTURE DATA CENTER 工科三 陳泰穎. Outline 1. CamCube 1. Traditional data center 2. The problems 3. CamCube philosophy 4. Feature 5. What’s

What’s different?

High Performance Computing CamCube make topology explicit Service can intercept(modify) packet on path Failure resilience Multiple independent service

Distributed System Key-space naturally mapped physically

Networking No switches/routers (symmetry of role) Not using TCP/IP

Page 10: SYMBIOTIC ROUTING IN FUTURE DATA CENTER 工科三 陳泰穎. Outline 1. CamCube 1. Traditional data center 2. The problems 3. CamCube philosophy 4. Feature 5. What’s

2. Symbiotic Routing

Symbiotic Routing is coupled with CamCube because: Each server link to other server closer Each server plays a role of switch/router too Each server share the resourse

(memory/FS)

Page 11: SYMBIOTIC ROUTING IN FUTURE DATA CENTER 工科三 陳泰穎. Outline 1. CamCube 1. Traditional data center 2. The problems 3. CamCube philosophy 4. Feature 5. What’s

2.1 TCP/IP Service

Required to implement TCP/IP for existing service

CamCube use its own method to enhance performance

Page 12: SYMBIOTIC ROUTING IN FUTURE DATA CENTER 工科三 陳泰穎. Outline 1. CamCube 1. Traditional data center 2. The problems 3. CamCube philosophy 4. Feature 5. What’s

2.2 VM distribution Service

Traditional: may create high number of interior server and edges (of tree of file system) than necessary.

New approach with CamCube: Use its topology feature. The custom routing protocol is

hierarchical, recursively dividing the coordinate space into 3D mini-cubes.

Page 13: SYMBIOTIC ROUTING IN FUTURE DATA CENTER 工科三 陳泰穎. Outline 1. CamCube 1. Traditional data center 2. The problems 3. CamCube philosophy 4. Feature 5. What’s

2.3 Cache service

Traditional remote cache Here Llcal cache

Not local cache

Page 14: SYMBIOTIC ROUTING IN FUTURE DATA CENTER 工科三 陳泰穎. Outline 1. CamCube 1. Traditional data center 2. The problems 3. CamCube philosophy 4. Feature 5. What’s

2.4 Aggregation

Don’t have to do traverse Use 3D topology feature (ex. X->y->z)

Page 15: SYMBIOTIC ROUTING IN FUTURE DATA CENTER 工科三 陳泰穎. Outline 1. CamCube 1. Traditional data center 2. The problems 3. CamCube philosophy 4. Feature 5. What’s

2.5 Properties

Key to server mapping Path specification (x,y,z) Fault-tolerance Multipath Packet buffers Prioritization

Page 16: SYMBIOTIC ROUTING IN FUTURE DATA CENTER 工科三 陳泰穎. Outline 1. CamCube 1. Traditional data center 2. The problems 3. CamCube philosophy 4. Feature 5. What’s

3. Conclusion

Symbiotic Routing is coupled with CamCube-like Infrastructure

This routing method provide flexible implement of service (protocol)

Support in-network packet processing CamCube + API(this routing method) =

easy-built data center

Page 17: SYMBIOTIC ROUTING IN FUTURE DATA CENTER 工科三 陳泰穎. Outline 1. CamCube 1. Traditional data center 2. The problems 3. CamCube philosophy 4. Feature 5. What’s

Comment

Challenge If service goes inner the CamCube, chances

may be multi-hop network. Beyond network efficiency, what’s else

can we benefit from CamCube ? High level switch/router is costly The energy saves by remove switch/router

Make better use of energy consumption in computation

Page 18: SYMBIOTIC ROUTING IN FUTURE DATA CENTER 工科三 陳泰穎. Outline 1. CamCube 1. Traditional data center 2. The problems 3. CamCube philosophy 4. Feature 5. What’s

Thank you