Upload File

hydra: high performance · 2018-08-17 · buffer: 8mb dram performance brief: ... increases with a...

  • Home
  • Documents
  • Hydra: High Performance · 2018-08-17 · Buffer: 8MB DRAM Performance brief: ... increases with a regular interval. Demo IV – Read/Write in a convergent manner 78,236,550 0
57
溫故之新: 하드디스크와 플래시메모리 민상렬 ([email protected]) (+ Mobile Embedded Systems Lab 연구원들) 서울대학교 공과대학 컴퓨터공학부

Upload: others

Post on 16-Jul-2020

0 views

Category:

Documents


0 download

Report

TRANSCRIPT

Page 1: Hydra: High Performance · 2018-08-17 · Buffer: 8MB DRAM Performance brief: ... increases with a regular interval. Demo IV – Read/Write in a convergent manner 78,236,550 0

溫故之新: 하드디스크와 플래시메모리

민상렬 ([email protected]) (+ Mobile Embedded Systems Lab 연구원들)

서울대학교 공과대학

컴퓨터공학부

Page 2: Hydra: High Performance · 2018-08-17 · Buffer: 8MB DRAM Performance brief: ... increases with a regular interval. Demo IV – Read/Write in a convergent manner 78,236,550 0

Outline

HDD Basics and Demo Flash Memory Basics and DemoStorage TrendsConclusions

Page 3: Hydra: High Performance · 2018-08-17 · Buffer: 8MB DRAM Performance brief: ... increases with a regular interval. Demo IV – Read/Write in a convergent manner 78,236,550 0

Outline

HDD Basics and DemoFlash Memory Basics and DemoStorage TrendsConclusions

Page 4: Hydra: High Performance · 2018-08-17 · Buffer: 8MB DRAM Performance brief: ... increases with a regular interval. Demo IV – Read/Write in a convergent manner 78,236,550 0

Electronic components

4

HDD internals

Disk cache

Hos

t int

erfa

ce

Disk controller

data

control

Mechanical components

Page 5: Hydra: High Performance · 2018-08-17 · Buffer: 8MB DRAM Performance brief: ... increases with a regular interval. Demo IV – Read/Write in a convergent manner 78,236,550 0

5

Mechanical components

Arm Assembly

Arm HeadCylinderSpindle

PlatterTrack

Source: “ABCs of Disk Drives,” Sudhanva Gurumurthi

Page 6: Hydra: High Performance · 2018-08-17 · Buffer: 8MB DRAM Performance brief: ... increases with a regular interval. Demo IV – Read/Write in a convergent manner 78,236,550 0

6

Data layout

Rotating disks consist of platters, each with two surfacesEach surface consists of concentric rings called tracksEach track consists of sectors separated by gaps

Source: “http://camars.kaist.ac.kr/~joon/course/sep562_2006_1/notes/10_11%20Memory_Hierarchy.ppt”

spindle

surfacetracks

track k

sectors

gaps

Page 7: Hydra: High Performance · 2018-08-17 · Buffer: 8MB DRAM Performance brief: ... increases with a regular interval. Demo IV – Read/Write in a convergent manner 78,236,550 0

7

Disk operation

spindle

By moving radially, the arm can position the head over any track

The disk surface spins at a fixed rotational rate

The head is attached to the end of the arm and flies over the disk surface on a thin cushion of air

Source: “http://camars.kaist.ac.kr/~joon/course/sep562_2006_1/notes/10_11%20Memory_Hierarchy.ppt”

Page 8: Hydra: High Performance · 2018-08-17 · Buffer: 8MB DRAM Performance brief: ... increases with a regular interval. Demo IV – Read/Write in a convergent manner 78,236,550 0

8

Disk operation details

Source: “http://www.cs.duke.edu/~chase/cps110/slides/files1.ppt”

Page 9: Hydra: High Performance · 2018-08-17 · Buffer: 8MB DRAM Performance brief: ... increases with a regular interval. Demo IV – Read/Write in a convergent manner 78,236,550 0

9

Disk operation details

Seek time

Source: “http://www.cs.duke.edu/~chase/cps110/slides/files1.ppt”

Page 10: Hydra: High Performance · 2018-08-17 · Buffer: 8MB DRAM Performance brief: ... increases with a regular interval. Demo IV – Read/Write in a convergent manner 78,236,550 0

10

Disk operation details

Seek time Rotational latency

Source: “http://www.cs.duke.edu/~chase/cps110/slides/files1.ppt”

Page 11: Hydra: High Performance · 2018-08-17 · Buffer: 8MB DRAM Performance brief: ... increases with a regular interval. Demo IV – Read/Write in a convergent manner 78,236,550 0

11

Disk operation details

TransfertimeSeek time Rotational latency

Source: “http://www.cs.duke.edu/~chase/cps110/slides/files1.ppt”

Page 12: Hydra: High Performance · 2018-08-17 · Buffer: 8MB DRAM Performance brief: ... increases with a regular interval. Demo IV – Read/Write in a convergent manner 78,236,550 0

12

Disk access time

Disk access timeSeek time + Rotational latency + Transfer time

Seek timeTime to position heads over cylinder containing target sector0 ~ 25 ms

Rotational latencyTime waiting for first bit of target sector to pass under r/w headFull rotation: 4 ~ 12 ms (15000 ~ 5400 RPM)

Transfer timeTime to read the bits in the target sector1 sector transfer: 1.3 ~ 12.8 us (380 ~ 40 MB/s transfer rate)

Page 13: Hydra: High Performance · 2018-08-17 · Buffer: 8MB DRAM Performance brief: ... increases with a regular interval. Demo IV – Read/Write in a convergent manner 78,236,550 0

13

Electronic components

Presenting a simple abstract view of the complex sector geometry

LBA 0LBA 1LBA 2

LBA N-1

Disk cacheHos

t int

erfa

ce

Disk controller

data

control

(cylinder, surface, sector)

Page 14: Hydra: High Performance · 2018-08-17 · Buffer: 8MB DRAM Performance brief: ... increases with a regular interval. Demo IV – Read/Write in a convergent manner 78,236,550 0

14

Electronic components

Disk controllerControlling the overall systemMajor functions

Host interfaceRequest translation (LBA [cylinder, surface, sector] )Reliability mechanism (e.g. ECC, bad sector handling)Performance improvement (e.g. request scheduling and disk caching)Power management (e.g. spin down of spindle motor)

Typically, embedded processor (such as ARM) + logic circuits

Page 15: Hydra: High Performance · 2018-08-17 · Buffer: 8MB DRAM Performance brief: ... increases with a regular interval. Demo IV – Read/Write in a convergent manner 78,236,550 0

Outline

HDD Basics and Demo Demo

Flash Memory Basics and DemoStorage TrendsConclusions

Page 16: Hydra: High Performance · 2018-08-17 · Buffer: 8MB DRAM Performance brief: ... increases with a regular interval. Demo IV – Read/Write in a convergent manner 78,236,550 0

Demo HDD Specification

Model Name: SAMSUNG MP0402H (2.5 in)Size:

total 78,236,550 sectors40,057,113,600 bytes ≈ 37.30 GB

Interface: ATA-6 (supports UDMA100)Buffer: 8MB DRAMPerformance brief:

Avg. Seek time: 12 msAvg. Rotational Latency: 5.6 ms (5400 RPM)

reference url: http://www.samsung.com/Products/HardDiskDrive/SpinPointMSeries/HardDiskDrive_SpinpointMseries_MP0402H_sp.htm

http://www.samsung.com/Products/HardDiskDrive/SpinPointMSeries/HardDiskDrive_SpinpointMseries_MP0402H_sp.htm
Page 17: Hydra: High Performance · 2018-08-17 · Buffer: 8MB DRAM Performance brief: ... increases with a regular interval. Demo IV – Read/Write in a convergent manner 78,236,550 0

Demo I – Power-on sequence

Page 18: Hydra: High Performance · 2018-08-17 · Buffer: 8MB DRAM Performance brief: ... increases with a regular interval. Demo IV – Read/Write in a convergent manner 78,236,550 0

Demo II – Sequential read/write

78,236,550

0

Access patternread/write data whose address increases continuously

Page 19: Hydra: High Performance · 2018-08-17 · Buffer: 8MB DRAM Performance brief: ... increases with a regular interval. Demo IV – Read/Write in a convergent manner 78,236,550 0

Demo III – Read/Write with a stride

78,236,550

0

Access patternread/write data whose address increases with a regular interval

Page 20: Hydra: High Performance · 2018-08-17 · Buffer: 8MB DRAM Performance brief: ... increases with a regular interval. Demo IV – Read/Write in a convergent manner 78,236,550 0

Demo IV – Read/Write in a convergent manner

78,236,550

0

Access patternread/write data whose addressis not overlapped and is in a convergent manner

Page 21: Hydra: High Performance · 2018-08-17 · Buffer: 8MB DRAM Performance brief: ... increases with a regular interval. Demo IV – Read/Write in a convergent manner 78,236,550 0

Demo V – Random read/write

78,236,550

0

Access patternread/write random addresses

Page 22: Hydra: High Performance · 2018-08-17 · Buffer: 8MB DRAM Performance brief: ... increases with a regular interval. Demo IV – Read/Write in a convergent manner 78,236,550 0

Demo VI – Effect of read caching/write buffering

78,236,550

0

Access patternaccess on the fixed addresses repeatedly

Page 23: Hydra: High Performance · 2018-08-17 · Buffer: 8MB DRAM Performance brief: ... increases with a regular interval. Demo IV – Read/Write in a convergent manner 78,236,550 0

Demo VII – Windows XP start-up

Page 24: Hydra: High Performance · 2018-08-17 · Buffer: 8MB DRAM Performance brief: ... increases with a regular interval. Demo IV – Read/Write in a convergent manner 78,236,550 0

24

HDD performance trends (1)

HDD access time trends are fairly flat due to mechanical nature of device

Page 25: Hydra: High Performance · 2018-08-17 · Buffer: 8MB DRAM Performance brief: ... increases with a regular interval. Demo IV – Read/Write in a convergent manner 78,236,550 0

25

HDD Performance trends (2)

A workload that was 5% disk bound in ‘96 would be 55% disk bound in ‘05

Page 26: Hydra: High Performance · 2018-08-17 · Buffer: 8MB DRAM Performance brief: ... increases with a regular interval. Demo IV – Read/Write in a convergent manner 78,236,550 0

HDD density trends

Source: Hitachi Global Storage Technologies

Page 27: Hydra: High Performance · 2018-08-17 · Buffer: 8MB DRAM Performance brief: ... increases with a regular interval. Demo IV – Read/Write in a convergent manner 78,236,550 0

HDD Summary

The Good- High capacity- Low cost

The Bad- High latency- High power consumption- Low reliability- Large form factor- Limited parallelism

The Ugly- Latent sector errors

Page 28: Hydra: High Performance · 2018-08-17 · Buffer: 8MB DRAM Performance brief: ... increases with a regular interval. Demo IV – Read/Write in a convergent manner 78,236,550 0

Outline

HDD Basics and Demo Flash Memory Basics and DemoStorage TrendsConclusions

Page 29: Hydra: High Performance · 2018-08-17 · Buffer: 8MB DRAM Performance brief: ... increases with a regular interval. Demo IV – Read/Write in a convergent manner 78,236,550 0

Conventional MOS Transistor

gate (G)

p-substraten+ source (S) n+ drain (D)

Schematic symbol

G

S

D

Page 30: Hydra: High Performance · 2018-08-17 · Buffer: 8MB DRAM Performance brief: ... increases with a regular interval. Demo IV – Read/Write in a convergent manner 78,236,550 0

Conventional MOS Transistor: A Constant-Threshold Transistor

Id

VgsVth

RonS D

Vgs > Vth

Page 31: Hydra: High Performance · 2018-08-17 · Buffer: 8MB DRAM Performance brief: ... increases with a regular interval. Demo IV – Read/Write in a convergent manner 78,236,550 0

Flash Memory

Control gate

erasure

p-substrate

Floating gate

Thin tunneling oxide

n+ source n+ drain

programming

Schematic symbol

G

S

D

Page 32: Hydra: High Performance · 2018-08-17 · Buffer: 8MB DRAM Performance brief: ... increases with a regular interval. Demo IV – Read/Write in a convergent manner 78,236,550 0

Flash Memory

Control gate

p-substraten+ source n+ drain

Control gate

p-substraten+ source n+ drain

Erased Cell Programmed Cell

Page 33: Hydra: High Performance · 2018-08-17 · Buffer: 8MB DRAM Performance brief: ... increases with a regular interval. Demo IV – Read/Write in a convergent manner 78,236,550 0

Flash Memory:A “Programmable-Threshold” Transistor

Id

VgsVth-0 Vth-1

“1” state “0” state

Control gate

p-substraten+ source n+ drain

Control gate

p-substraten+ source n+ drain

Erased state Programmed state

Page 34: Hydra: High Performance · 2018-08-17 · Buffer: 8MB DRAM Performance brief: ... increases with a regular interval. Demo IV – Read/Write in a convergent manner 78,236,550 0

More Bits Per Transistor

Source: Eli Harari (SanDisk), “NAND at Center Stage,” Flash Memory Summit 2007.

Page 35: Hydra: High Performance · 2018-08-17 · Buffer: 8MB DRAM Performance brief: ... increases with a regular interval. Demo IV – Read/Write in a convergent manner 78,236,550 0

NAND Flash Memory Interface

SpareData

…

SpareData

SpareData

SpareData

SpareData

…

SpareData

SpareData

SpareData

SpareData

…

SpareData

SpareData

SpareData

………

2j blocks

2i

pages

SpareData

…

SpareData

SpareData

SpareData

SpareData

…

SpareData

SpareData

SpareData

SpareData

…

SpareData

SpareData

SpareData

………

2j blocks

2i

pages

Read physical page (chip #, block #, page #)~ 20 us

Write physical page(chip #, block #, page #)~ 200 us

Erase block(chip#, block #)~ 2 ms

Page 36: Hydra: High Performance · 2018-08-17 · Buffer: 8MB DRAM Performance brief: ... increases with a regular interval. Demo IV – Read/Write in a convergent manner 78,236,550 0

Why (NAND) Flash Memory?

Advantages of Flash Memory over HDD

Low latencyLow power consumptionTolerant to shock & vibrationSilent operationSmall sizeAbundant parallelism…

Single NAND Flash Memory Chip Density Trends

Source: Samsung Electronics

Page 37: Hydra: High Performance · 2018-08-17 · Buffer: 8MB DRAM Performance brief: ... increases with a regular interval. Demo IV – Read/Write in a convergent manner 78,236,550 0

(More) NAND Flash Memory Trends

$/MB DRAM NAND Flash

2000 $0.97 $1.35

2001 0.22 0.43

2002 0.22 0.25

2003 0.17 0.21

2004 0.17 0.10

2005 0.11 0.05

2006 0.096 0.021

2007 0.057 0.012

2008 ~0.025 <0.005

CAGR -32.1%/yr -50.0%/yr

Source: Lane Mason (Denali Software), “NAND FlashPoint Platform”

Page 38: Hydra: High Performance · 2018-08-17 · Buffer: 8MB DRAM Performance brief: ... increases with a regular interval. Demo IV – Read/Write in a convergent manner 78,236,550 0

(More) NAND Flash Memory Trends

Millions GB DRAM NAND Flash

2000 30 1.1

2001 50 1.6

2002 71 4.6

2003 98 14.6

2004 158 68

2005 240 200

2006 340 600

2007 645 1600

2008 1000 4000

CAGR +60.0%/yr +150%/yr

Source: Lane Mason (Denali Software), “NAND FlashPoint Platform”

Page 39: Hydra: High Performance · 2018-08-17 · Buffer: 8MB DRAM Performance brief: ... increases with a regular interval. Demo IV – Read/Write in a convergent manner 78,236,550 0

Solid State Disk

Provides an interface identical to a hard disk, but uses flash memory as a storage medium

Identical Interface

Page 40: Hydra: High Performance · 2018-08-17 · Buffer: 8MB DRAM Performance brief: ... increases with a regular interval. Demo IV – Read/Write in a convergent manner 78,236,550 0

Solid State Disk: Form Factor Agnostic

Source: Jim Elliot (Samsung Electronics), “SSD: The Next Killer App in NAND Flash,” Flash Memory Summit 2007.

Page 41: Hydra: High Performance · 2018-08-17 · Buffer: 8MB DRAM Performance brief: ... increases with a regular interval. Demo IV – Read/Write in a convergent manner 78,236,550 0

Flash memory summary

The Good- Low latency - Low power consumption- High Reliability- Small form factor- Massive parallelism

….

The Bad- No in-place updating- Limited endurance- Bad blocks- Write disturbance- Read disturbance

FROM THE DARK NIGHT

The Ugly- Retention errors- Paired page problem

Page 42: Hydra: High Performance · 2018-08-17 · Buffer: 8MB DRAM Performance brief: ... increases with a regular interval. Demo IV – Read/Write in a convergent manner 78,236,550 0

Outline

HDD Basics and Demo Flash Memory Basics and DemoStorage TrendsConclusions

Page 43: Hydra: High Performance · 2018-08-17 · Buffer: 8MB DRAM Performance brief: ... increases with a regular interval. Demo IV – Read/Write in a convergent manner 78,236,550 0

Storage Trends

Tape Is DeadDisk Is Tape

1 TB disks are available10+ TB disks are predicted in 5 yearsBut: ~5..15 hours to read (sequential)

~15..150 days to read (random)Need to treat most of disk as Cold-storage archive

Source: Jim Gray (Microsoft), “Tape is Dead, Disk is Tape, Flash is Disk, RAM Locality is King”

Page 44: Hydra: High Performance · 2018-08-17 · Buffer: 8MB DRAM Performance brief: ... increases with a regular interval. Demo IV – Read/Write in a convergent manner 78,236,550 0

Storage Trends

Disk Is TapeFlash Is Disk

1995 16 Mb NAND flash chips2005 16 Gb NAND flash chips2012 1 Tb NAND flash chips== 128 GB chip== 1 TB or 2 TB solid state disk for ~$400or 128 GB solid state disk for ~$40or 32 GB solid state disk for ~$5

Source: Jim Gray (Microsoft), “Tape is Dead, Disk is Tape, Flash is Disk, RAM Locality is King”

Page 45: Hydra: High Performance · 2018-08-17 · Buffer: 8MB DRAM Performance brief: ... increases with a regular interval. Demo IV – Read/Write in a convergent manner 78,236,550 0

Disk is Tape / Flash is Disk

Source: Esther Spanjer (Adtron), “Enterprise SSD: The next killer app,” Flash Memory Summit 2007.

Page 46: Hydra: High Performance · 2018-08-17 · Buffer: 8MB DRAM Performance brief: ... increases with a regular interval. Demo IV – Read/Write in a convergent manner 78,236,550 0

Disk is Tape / Flash is Disk

Performance

1 SSD 35~50 HDDs

Source: Jim Gray (Microsoft), “Tape is Dead, Disk is Tape, Flash is Disk, RAM Locality is King”

Page 47: Hydra: High Performance · 2018-08-17 · Buffer: 8MB DRAM Performance brief: ... increases with a regular interval. Demo IV – Read/Write in a convergent manner 78,236,550 0

Disk is Tape / Flash is Disk

Power Consumption

Source: Jim Elliot (Samsung Electronics), “SSD: The Next Killer App in NAND Flash,” Flash Memory Summit 2007.

Page 48: Hydra: High Performance · 2018-08-17 · Buffer: 8MB DRAM Performance brief: ... increases with a regular interval. Demo IV – Read/Write in a convergent manner 78,236,550 0

Future Outlook

Source: Scott Deutsch (SanDisk), “Bringing Solid State Drives to Mainstream Notebooks,” Flash Memory Summit 2007.

Page 49: Hydra: High Performance · 2018-08-17 · Buffer: 8MB DRAM Performance brief: ... increases with a regular interval. Demo IV – Read/Write in a convergent manner 78,236,550 0

Outline

HDD Basics and Demo Flash Memory Basics and DemoStorage TrendsConclusions

Page 50: Hydra: High Performance · 2018-08-17 · Buffer: 8MB DRAM Performance brief: ... increases with a regular interval. Demo IV – Read/Write in a convergent manner 78,236,550 0

Conclusions

In the animal worldSurvival of the fittest

In the memory worldSurvival of the fastest or cheapest

Volatile Non-volatile

Fastest SRAM FRAM?

Cheapest DRAM NAND FlashHDD

Page 51: Hydra: High Performance · 2018-08-17 · Buffer: 8MB DRAM Performance brief: ... increases with a regular interval. Demo IV – Read/Write in a convergent manner 78,236,550 0

Conclusions

From the history

IBM 360/85 IBM 360/91

Clock Rate 80 ns 60 ns

Memory Speed 1040 ns 750 ns

Memory Interleaving 4 way 8 way

Additional Features Cache MemoryRegister Renaming,

Out-of-order Execution, etc

But, IBM 360/85 faster on 8 of 11 programs!Source: David Patterson, et al., “A Case for Intelligent DRAM: IRAM”, Hot Chips VIII, August, 1996

Page 52: Hydra: High Performance · 2018-08-17 · Buffer: 8MB DRAM Performance brief: ... increases with a regular interval. Demo IV – Read/Write in a convergent manner 78,236,550 0

The Ultimate Limit – HDD

FlyBy

NightBoeing 747

2,000,000 Miles Per Hour

1/100” Flying Height

Source: Richard Lary, The New Storage Landscape: Forces shaping the storage economy, 2003.

Source: B. Parhami, Dependable Computing: A Multilevel Approach

Page 53: Hydra: High Performance · 2018-08-17 · Buffer: 8MB DRAM Performance brief: ... increases with a regular interval. Demo IV – Read/Write in a convergent manner 78,236,550 0

The Ultimate Limit – Flash Memory

Scanning tunneling microscope image of a silicon surface showing 10 nm is ~20 atoms across

Source: B. Shirley, “The Many Flavors of NAND …and More to Come,” Flash Memory Summit 2009

Page 54: Hydra: High Performance · 2018-08-17 · Buffer: 8MB DRAM Performance brief: ... increases with a regular interval. Demo IV – Read/Write in a convergent manner 78,236,550 0

Outline

HDD Basics and Demo Flash Memory Basics and DemoStorage TrendsConclusions(More Demos)

Page 55: Hydra: High Performance · 2018-08-17 · Buffer: 8MB DRAM Performance brief: ... increases with a regular interval. Demo IV – Read/Write in a convergent manner 78,236,550 0

Flash Memory Software Development Platforms

Embedded Platform

Flash / NV-RAM Modules

Samsung SLC NAND

Samsung MLC NAND

Samsung OneNAND

Hynix MLC NAND

FREESCALE MRAM (parallel)

RAMTRON FRAM (parallel)

RAMTRON FRAM (serial)

Samsung Phase-change RAM

SSD Platform

Embedded Flash Memory 소프트웨어솔루션개발용

Solid State Disk 소프트웨어개발용

Page 56: Hydra: High Performance · 2018-08-17 · Buffer: 8MB DRAM Performance brief: ... increases with a regular interval. Demo IV – Read/Write in a convergent manner 78,236,550 0

SDRAM

FPGA

DAQ connector

NAND slot x 2

Embedded Platform

CirrusEDB9315A Board

Embedded Platform

FeaturesFor embedded Flash memory software developmentFPGA-basedNAND slot x 2DAQ (Data Acquisition) interface

Page 57: Hydra: High Performance · 2018-08-17 · Buffer: 8MB DRAM Performance brief: ... increases with a regular interval. Demo IV – Read/Write in a convergent manner 78,236,550 0

SSD (Solid State Disk) Platform

S-ATAConnector

DAQ Connector

NAND Slotx 4

Auxiliary Slot x 1

FPGA

SDRAM

Ethernet

SSD Platform

FeaturesFor SSD developmentFPGA-basedSSD interface (P-ATA, S-ATA)NAND slot x 4


Convergent Minerals | ASX:CVG | RIS2014 Broken Hill Investor Presentation

CONVERGENT FLOWS: HUMANITIES SCHOLARS AND THEIR INTERACTIONS WITH ELECTRONIC TEXTS Suzana Sukovic

ニュースレター SCJ69 8MB

T©l©charger (8Mb) - Depositum

Catálogo.digital pao diario 2015 - 8mb

Linear Convergent Decentralized Optimization with Compression

ATT Convergent Bill

Divergent Studies Convergent Attitudes

La lunette de Galilée Objectif convergent Oculaire divergent Image droite

workstation en 04 17 - sisthai.com PRICE... · Turbo, 8MB 45W) Intel Core i7-6820HQ (Quad Core 2.70GHz, Turbo 3.60GHz, 8MB 45W) Intel Core i5-7300HQ (Quad Core 2.50GHz, Turbo 3.50GHz,

Procesul de Convergent A Contabila

klik om de PDF (8Mb) te openen

Numerical Analysis of Dry Ice Blasting Convergent

Documento PDF(8MB)

D4.1 Convergent Platfom

CONVERGENT USE OF DFD-DFR PRINCIPLES AND OF … fasc 3/L2_CM 3_2017.pdfAbstract. The presented research is oriented towards the convergent use of Design for Disassembly (DFD) and Design

(8MB) PF. Pedoman Pelaksanaan Pemeriksaan Komprehensif

Descargar (8MB)

Convergent - Startseite - cronos Unternehmensberatung PDFs/ci42 PDF... ·  · 2016-09-01Das SAP Convergent Invoicing (CI) bietet genau diese Funktio-nalität. Statt hoher manueller

Convergent media group portfolio 2013

Aquapac Workbook 2015 Screen Universal 8MB

ANALISA NUMERIK NOZZLE CONVERGENT-DIVERGENT PADA …

ZEBRA Barcode Printer 제안서 · 2019-05-09 · Memory 4MB Flash, 8MB SDRAM V V 8MB Flash, 8MB SDRAM V V 64MB Flash(68MB total) w RTC Option 256MB Flash, 128MB RAM V Media/Ribbon

Convergent Evolution of Polysaccharide Debranching Defines a … · Convergent Evolution of Polysaccharide Debranching Defines a Common Mechanism for Starch Accumulation in Cyanobacteria

Insight13 ud 8mb

Convergent Fabrication of a Nanoporous Two-Dimensional

A Convergent Adaptive Uzawa Finite Element Method for the

Convergent Evolution of Syringyl Lignin Biosynthesis via ... ARTICLES Convergent Evolution of Syringyl Lignin Biosynthesis via Distinct Pathways in the Lycophyte Selaginella and Flowering

BILAYER PLATES: MODEL REDUCTION, -CONVERGENT FINITE ... · BILAYER PLATES: MODEL REDUCTION, -CONVERGENT FINITE ELEMENT APPROXIMATION AND DISCRETE GRADIENT FLOW SOREN BARTELS, ANDREA

ANALIZĂ MATEMATICĂ - imst.ro · 3 10. Orice subşir al unui şir convergent este convergent şi are limita egală cu limita şirului respectiv. 11. Dacă două subşiruri ale aceluiaşi

Final Version , 8mb

Convergent journalism

062-065 LP615 Convergent - Bold - high end vertrieb€¦ · Nr_6-2015 64 Test Endstufe Convergent JL5 Gespieltes Michael Hedges Aerial Boundaries Glowsun Beyond the Wall of Time Colour

Download (8Mb) - [email protected]

Convergent Evolution of C239S Mutation in Pythium spp. β