liquid cooling - kek 測定器開発室rd.kek.jp/slides/20130702/thermal-4.pdfcold plate and heat...

33
Liquid Cooling 1

Upload: dangquynh

Post on 16-Mar-2018

216 views

Category:

Documents


2 download

TRANSCRIPT

Page 1: Liquid Cooling - KEK 測定器開発室rd.kek.jp/slides/20130702/Thermal-4.pdfCold Plate and Heat Pipe Cooler for a Super Computer Heat Pipe Heat Spreader for DIMM Hub Cold Plate Qcm

Liquid Cooling

1

Page 2: Liquid Cooling - KEK 測定器開発室rd.kek.jp/slides/20130702/Thermal-4.pdfCold Plate and Heat Pipe Cooler for a Super Computer Heat Pipe Heat Spreader for DIMM Hub Cold Plate Qcm

SB:12 boards

SB:12 boards

Super computer

Cold Plate for Super Computer

CPU 20kW/Rack x 848 racks

17MW/ a machine

IOSB : 6 boards

Thermal Resistance

0

0.01

0.02

0.03

0.04

0.05

0.06

20 40 60 80 100 120

Heat Input Q (W)

Therm

al R

esi

stan

ce (C

/W

)

R=dT/Q=(Tbase-Twi)/Q

specification :<0.05C/W

Measured data

Cold Plate

Calculation Speed:12 x 10 12 times /sec.

2

Page 3: Liquid Cooling - KEK 測定器開発室rd.kek.jp/slides/20130702/Thermal-4.pdfCold Plate and Heat Pipe Cooler for a Super Computer Heat Pipe Heat Spreader for DIMM Hub Cold Plate Qcm

Liquid Cooling Cold Plate

Brazed Sample Inspection by Ultrasonic Microscope

Brazed Cold Plate (Cross Section)

3

Page 4: Liquid Cooling - KEK 測定器開発室rd.kek.jp/slides/20130702/Thermal-4.pdfCold Plate and Heat Pipe Cooler for a Super Computer Heat Pipe Heat Spreader for DIMM Hub Cold Plate Qcm

Coupler

Manifold

Cold Plate (8 pcs)

Φ6.35 tube

Cold Plate Assembly

Coupler

4

Page 5: Liquid Cooling - KEK 測定器開発室rd.kek.jp/slides/20130702/Thermal-4.pdfCold Plate and Heat Pipe Cooler for a Super Computer Heat Pipe Heat Spreader for DIMM Hub Cold Plate Qcm

For super computer

Total 32 memory on the board

80W(60-100W) x 8 CPUs/Board Φ6.35mm Copper Tube

Cold Plate assembly on the Motherboard

Manifold

One tough Coupler to tube

5

Page 6: Liquid Cooling - KEK 測定器開発室rd.kek.jp/slides/20130702/Thermal-4.pdfCold Plate and Heat Pipe Cooler for a Super Computer Heat Pipe Heat Spreader for DIMM Hub Cold Plate Qcm

Cold Plate and Heat Pipe Cooler for a Super Computer

Heat Pipe Heat Spreader for DIMM

Hub Cold Plate

Qcm Cold Plate

6

Page 7: Liquid Cooling - KEK 測定器開発室rd.kek.jp/slides/20130702/Thermal-4.pdfCold Plate and Heat Pipe Cooler for a Super Computer Heat Pipe Heat Spreader for DIMM Hub Cold Plate Qcm

Heat spreader Plate(DMS1) with Heat pipe

Cooling method of DIMM : Liquid cooling + Heat spreader

Cold Rail

Cold Rail

DIMM (Dual Inline Memory Module) Cooling

7

Page 8: Liquid Cooling - KEK 測定器開発室rd.kek.jp/slides/20130702/Thermal-4.pdfCold Plate and Heat Pipe Cooler for a Super Computer Heat Pipe Heat Spreader for DIMM Hub Cold Plate Qcm

Mini Channel Cold Plate Assemblies: Different Types

8

Page 9: Liquid Cooling - KEK 測定器開発室rd.kek.jp/slides/20130702/Thermal-4.pdfCold Plate and Heat Pipe Cooler for a Super Computer Heat Pipe Heat Spreader for DIMM Hub Cold Plate Qcm

Modular Refrigerator

9

Page 10: Liquid Cooling - KEK 測定器開発室rd.kek.jp/slides/20130702/Thermal-4.pdfCold Plate and Heat Pipe Cooler for a Super Computer Heat Pipe Heat Spreader for DIMM Hub Cold Plate Qcm

Fujikura MRU Development

Prototype # 1 (Proof of Design) Prototype # 2 (Compact and high performance)

Condenser + Blower

Expansion Valve

Compressor

Evaporator/Heater

Can fit into 19 inch rack

10

Page 11: Liquid Cooling - KEK 測定器開発室rd.kek.jp/slides/20130702/Thermal-4.pdfCold Plate and Heat Pipe Cooler for a Super Computer Heat Pipe Heat Spreader for DIMM Hub Cold Plate Qcm

Fujikura Modular Refrigeration Unit

Cold Plate (Evaporator)

Cover On

Cover Off

Cover

Compressor

Condenser

To Evaporator

Total cooling solution designed & development by Fujikura Group using in-house technology Evaporator made by FETL with advanced cold Plate

manufacturing technology. Heat pipe application inside MRU unit to improve

COP. SUS flexible tube piping made by Fujikura-Numazu. Assembled & inspected by Fujikura Compo Sakura

with high reliability. Target system price: ~ 5000 USD 11

Page 12: Liquid Cooling - KEK 測定器開発室rd.kek.jp/slides/20130702/Thermal-4.pdfCold Plate and Heat Pipe Cooler for a Super Computer Heat Pipe Heat Spreader for DIMM Hub Cold Plate Qcm

Fujikura MRU: Test Results

Temparature-Time

0102030405060

00:0

0:0

000:0

0:3

500:0

1:1

000:0

1:4

500:0

2:2

000:0

2:5

500:0

3:3

000:0

4:0

500:0

4:4

000:0

5:1

500:0

5:5

000:0

6:2

500:0

7:0

000:0

7:3

500:0

8:1

000:0

8:4

500:0

9:2

000:0

9:5

500:1

0:3

000:1

1:0

500:1

1:4

000:1

2:1

500:1

2:5

000:1

3:2

500:1

4:0

000:1

4:3

500:1

5:1

000:1

5:4

500:1

6:2

000:1

6:5

500:1

7:3

000:1

8:0

500:1

8:4

000:1

9:1

500:1

9:5

0

Time (second)

Tem

p (C

)

Heater ON

Refrigerator ON

Evaporator

Evaporator-Inlet

Evaporator-Outlet

Temparature-Time

0102030405060

00:0

0:0

000:0

0:3

500:0

1:1

000:0

1:4

500:0

2:2

000:0

2:5

500:0

3:3

000:0

4:0

500:0

4:4

000:0

5:1

500:0

5:5

000:0

6:2

500:0

7:0

000:0

7:3

500:0

8:1

000:0

8:4

500:0

9:2

000:0

9:5

500:1

0:3

000:1

1:0

500:1

1:4

000:1

2:1

500:1

2:5

000:1

3:2

500:1

4:0

000:1

4:3

500:1

5:1

000:1

5:4

500:1

6:2

000:1

6:5

500:1

7:3

000:1

8:0

500:1

8:4

000:1

9:1

500:1

9:5

0

Time (second)

Tem

p (C

)

Heater ON

Refrigerator ON

Evaporator

Evaporator-Inlet

Evaporator-Outlet

Time, mm:ss

Tem

pe

ratu

re, °

C

12

Evaporator temperature controlled at around 25 – 26 °C

Heater Input 1.8 kW

Page 13: Liquid Cooling - KEK 測定器開発室rd.kek.jp/slides/20130702/Thermal-4.pdfCold Plate and Heat Pipe Cooler for a Super Computer Heat Pipe Heat Spreader for DIMM Hub Cold Plate Qcm

Technology comparison: Evaporator Heat Transfer Coefficient

Liquid Pumped Cooling

Thermal Control Technology

Evap

ora

tive

He

at T

ran

sfe

r C

oef

fici

en

t

10 k

20 k

30 k

40 k

50 k

5 – 10 k

8 – 15 k

10 – 20 k

15 – 35 k 20 – 50 k

Thin Heat Pipes Cylindrical Heat Pipes

Vapour Chambers

Loop Heat Pipes

Single phase cooling Pumped circulation

One dimensional heat flow Two phase passive cooling

Two dimensional heat flow

Two phase passive cooling

Heat spreading device

Highly developed evaporator

Two phase passive cooling High heat flux and long

distance capability

Evaporative heat transfer coefficient range for each technology is dependent on: Evaporator design & thickness Operation orientation Heat flux Heat transfer length

13

Page 14: Liquid Cooling - KEK 測定器開発室rd.kek.jp/slides/20130702/Thermal-4.pdfCold Plate and Heat Pipe Cooler for a Super Computer Heat Pipe Heat Spreader for DIMM Hub Cold Plate Qcm

Heat Spreader

14

Page 15: Liquid Cooling - KEK 測定器開発室rd.kek.jp/slides/20130702/Thermal-4.pdfCold Plate and Heat Pipe Cooler for a Super Computer Heat Pipe Heat Spreader for DIMM Hub Cold Plate Qcm

Heat Spreader of Chips A heat spreader is important part to be spreading heat and guard for silicon chips.

Cold forged Electro Ni plating Gold plating

CPU Package IHS with Ni plating and gold plating

Stiffener

15

Page 16: Liquid Cooling - KEK 測定器開発室rd.kek.jp/slides/20130702/Thermal-4.pdfCold Plate and Heat Pipe Cooler for a Super Computer Heat Pipe Heat Spreader for DIMM Hub Cold Plate Qcm

Micro-channel Vapor chamber

Micro skiving fin is available 0.1mm fin gap and 0.1 mm fin thickness.

Thermal Resistance of Micro Channel Vapor Chamber

16

Page 17: Liquid Cooling - KEK 測定器開発室rd.kek.jp/slides/20130702/Thermal-4.pdfCold Plate and Heat Pipe Cooler for a Super Computer Heat Pipe Heat Spreader for DIMM Hub Cold Plate Qcm

Piezo Fan

17

Page 18: Liquid Cooling - KEK 測定器開発室rd.kek.jp/slides/20130702/Thermal-4.pdfCold Plate and Heat Pipe Cooler for a Super Computer Heat Pipe Heat Spreader for DIMM Hub Cold Plate Qcm

Piezo Fan (Dual Cool Jet): Heat Dissipating Element

Thin, Robust, Simple Structure

18

Page 19: Liquid Cooling - KEK 測定器開発室rd.kek.jp/slides/20130702/Thermal-4.pdfCold Plate and Heat Pipe Cooler for a Super Computer Heat Pipe Heat Spreader for DIMM Hub Cold Plate Qcm

Features of DCJ

Thin DC fan for note-PC

◎Miniaturization of fan bearing has

limitation on the size due to reliability.

3mm thick is required at this moment.

◎High rotation speed is needed when

reducing the thickness, and it becomes a

high noise and high power consumption.

◎Failure is caused from dust.

Ultra thin DCJ

◎1mm thickness is possible.

◎Low acoustic noise (<35dBA).

◎Low power consumption (<350mW).

◎Simple structure.

19

Page 20: Liquid Cooling - KEK 測定器開発室rd.kek.jp/slides/20130702/Thermal-4.pdfCold Plate and Heat Pipe Cooler for a Super Computer Heat Pipe Heat Spreader for DIMM Hub Cold Plate Qcm

Sample of DCJ (40SQ)

Size (main body: W x L x T) 40x40x1 [mm]

Size with frame (Wo x Lo) 60x50 [mm]

Input Voltage DC 5 [V]

Driving Voltage* AC 25 [Vrms]

Driving Frequency* 155 ±2[Hz]

Max. Air Flow Rate* 15 [LPM]

Max. Static Pressure* 6 [Pa]

P-Q Performance(40SQ-25D-1T)

0.0

1.0

2.0

3.0

4.0

5.0

6.0

7.0

8.0

0 5 10 15 20

Air flow[L/min]

Sta

tic

pre

ss

ure

[Pa

]

20

Fan On

Fan Off

Page 21: Liquid Cooling - KEK 測定器開発室rd.kek.jp/slides/20130702/Thermal-4.pdfCold Plate and Heat Pipe Cooler for a Super Computer Heat Pipe Heat Spreader for DIMM Hub Cold Plate Qcm

Power Input (W)

He

ate

r Te

mp

era

ture

( º

C)

DCJ running at 125 HZ and 35 Vrms ※

With DCJ cooling, CPU power can be increased up to 5 W

0

10

20

30

40

50

60

70

80

90

100

0 1 2 3 4 5 6

DCJ on

DCJ off

Reference DCJ Testing Data for 5W Cooling

※Tested only one DCJ without any other thermal cooling parts

21

Page 22: Liquid Cooling - KEK 測定器開発室rd.kek.jp/slides/20130702/Thermal-4.pdfCold Plate and Heat Pipe Cooler for a Super Computer Heat Pipe Heat Spreader for DIMM Hub Cold Plate Qcm

22

4: EXPERIMENTAL STUDY _ Fabricated Module

Specification Heat Pipe : L 175.0mm W 8.5mm T 1.5mm Module Weight : 20gmm (Including Fan) Maximum Height : 4.5mm

Current module Qmax is 18W

Qmax 18W

Total Resistance Temperature Profile

電子電装事業部門 開発発表会 , 27th December ,2012

Th Target Line

Page 23: Liquid Cooling - KEK 測定器開発室rd.kek.jp/slides/20130702/Thermal-4.pdfCold Plate and Heat Pipe Cooler for a Super Computer Heat Pipe Heat Spreader for DIMM Hub Cold Plate Qcm

Direct Methanol Fuel Cell (DMFC)

23

Page 24: Liquid Cooling - KEK 測定器開発室rd.kek.jp/slides/20130702/Thermal-4.pdfCold Plate and Heat Pipe Cooler for a Super Computer Heat Pipe Heat Spreader for DIMM Hub Cold Plate Qcm

Energy Sources

Volumetric Energy

Density

(Watt*hours/Liter)

Specific Energy

Density

(Watt*hours/kg)

Li-ion Batteries 450 200

Hydrogen + Container

Compr (2000 psi) 520 248

Hydrogen/Metal Hydride 600 236

Methanol* 4,817 6,098

Formic Acid 2,050 1,724

*Methanol has the highest energy density.

Energy Density of Selected Fuels

24

Page 25: Liquid Cooling - KEK 測定器開発室rd.kek.jp/slides/20130702/Thermal-4.pdfCold Plate and Heat Pipe Cooler for a Super Computer Heat Pipe Heat Spreader for DIMM Hub Cold Plate Qcm

(1) Methanol permeable membrane (2) DMFC MEA (3) Air and water management layer

e-

Air

Water

Methanol

(1) (2) (3)

CO2 vent

Water Balance Operation:

• Water is produced at the cathode.

• About 1/3 generated water is reused at anode for electrochemical reaction.

• About 2/3 generated water is released from the system.

O2

H2O MeOH

Technical highlight - Passive water balance

operation

25

Page 26: Liquid Cooling - KEK 測定器開発室rd.kek.jp/slides/20130702/Thermal-4.pdfCold Plate and Heat Pipe Cooler for a Super Computer Heat Pipe Heat Spreader for DIMM Hub Cold Plate Qcm

Direct Methanol Fuel Cell (DMFC)

DMFC is investigated based on our thermal and liquid feeding technology.

Strong point - Unique fuel delivering system - Pocket size - High energy conversion efficiency using exhaust heat (1kW type)

2W output prototype 1kW output prototype

Output power [W] 2 1,000

Size [mm] 135 x 75 x 23 400 x 500 x 150

Supplying water temperature [oC]

- 50

Applications Portable electronics device (Smart phone, mobile PC)

Aviation, Passenger ship, etc.

26

Page 27: Liquid Cooling - KEK 測定器開発室rd.kek.jp/slides/20130702/Thermal-4.pdfCold Plate and Heat Pipe Cooler for a Super Computer Heat Pipe Heat Spreader for DIMM Hub Cold Plate Qcm

Package Internal structure

Fuel tank Stack DC-DC converter

1. Sequencing fuel bottle to charge fuel into the DMFC stack 2. Connecting DMFC to the portable electronic device. 3. DMFC will automatically start to charge the electronic device.

2W DMFC

27

1. H×L×t : 75×140×38 mm

2. Weight without fuel : 230g (With fuel : 260g)

3. Power output : 4-5W·h for 1 fuel pushing.

4. Working time: up to 8 hours (Automatically stop)

5. Orientation independent

6. Working temperature : 10 – 35oC (0 -40oC in future).

7. Ambient relative humidity : 10 – 100%

Page 28: Liquid Cooling - KEK 測定器開発室rd.kek.jp/slides/20130702/Thermal-4.pdfCold Plate and Heat Pipe Cooler for a Super Computer Heat Pipe Heat Spreader for DIMM Hub Cold Plate Qcm

Performance & Durability of passive DMFC system

• Working time: 6 hours with one fuel charging.

• Total power output: C#1 (4.60W·h); C#120(4.55W·h).

• Fuel utilization: 1.4 W·h/g of fuel.

• We tested this DMFC charger in last 6 months for total 120 operation cycles.

0.2

0.4

0.6

0.8

1.0

1.2

0 60 120 180 240 300 360

T im e (m ins)

Power output (W

)

C #1 C #12025oC and 50%RH

28

Page 29: Liquid Cooling - KEK 測定器開発室rd.kek.jp/slides/20130702/Thermal-4.pdfCold Plate and Heat Pipe Cooler for a Super Computer Heat Pipe Heat Spreader for DIMM Hub Cold Plate Qcm

Overall Dimensions: 600mm (W) x 400mm (D) x 330mm (H)

600 mm 400mm

300mm

29

1KW DMFC

Page 30: Liquid Cooling - KEK 測定器開発室rd.kek.jp/slides/20130702/Thermal-4.pdfCold Plate and Heat Pipe Cooler for a Super Computer Heat Pipe Heat Spreader for DIMM Hub Cold Plate Qcm

Liquid pump

Heat exchanger

stack

Liquid pump

Air blower

Methanol sensor

Water tank

Methanol solution tank

30

1KW DMFC

Page 31: Liquid Cooling - KEK 測定器開発室rd.kek.jp/slides/20130702/Thermal-4.pdfCold Plate and Heat Pipe Cooler for a Super Computer Heat Pipe Heat Spreader for DIMM Hub Cold Plate Qcm

Performance of large active area single cell (180cm2)

• The peak power output is 16.5W.

• Assume 61 cells in one stack, the stack power output is 1,000W.

• In order to increase the stack power output to 1,200W, 20% up of

performance is needed.

• Our target is to increase single cell power output 20 to 25W.

-2.00E+00

0.00E+00

2.00E+00

4.00E+00

6.00E+00

8.00E+00

1.00E+01

1.20E+01

1.40E+01

1.60E+01

1.80E+01

0.00E+00

1.00E-01

2.00E-01

3.00E-01

4.00E-01

5.00E-01

6.00E-01

7.00E-01

8.00E-01

0.00E+001.00E+012.00E+013.00E+014.00E+015.00E+016.00E+017.00E+01

Vo

lta

ge

(V

)

Current (A)

Power output, 75C, 1.75% MeOH at 0.4ml/A, dry air

E_Stack[V]-0710

E_Stack[V]-0625

Power[W]-0710

Power[W]-0625

31

Power (W)

Page 32: Liquid Cooling - KEK 測定器開発室rd.kek.jp/slides/20130702/Thermal-4.pdfCold Plate and Heat Pipe Cooler for a Super Computer Heat Pipe Heat Spreader for DIMM Hub Cold Plate Qcm

Energy balance diagram of 1.0 kW DMFC

4.0 kW of heat

1.0 kW of net electrical power

150 W for air blower

150 W for the other active components

1.3 kW of total electrical power

5.3 kW of

methanol

32

Page 33: Liquid Cooling - KEK 測定器開発室rd.kek.jp/slides/20130702/Thermal-4.pdfCold Plate and Heat Pipe Cooler for a Super Computer Heat Pipe Heat Spreader for DIMM Hub Cold Plate Qcm

Thanks

33