oracle为数据库优化的系统平台 · april 2010 windows 2008r2 last release for itanium by...

32
<Insert Picture Here> Oracle 为数据库优化的系统平台

Upload: others

Post on 11-Oct-2020

0 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Oracle为数据库优化的系统平台 · April 2010 Windows 2008R2 last release for Itanium by Microsoft Dec 2008 PA-RISC / Superdome ends Summer 2010 HP last vendor standing Feb

<Insert Picture Here>

Oracle 为数据库优化的系统平台

Page 2: Oracle为数据库优化的系统平台 · April 2010 Windows 2008R2 last release for Itanium by Microsoft Dec 2008 PA-RISC / Superdome ends Summer 2010 HP last vendor standing Feb

© 2010 Oracle Corporation – Proprietary and Confidential – Do Not Distribute 2

优化的境界

• 第一重:选择正确的产品

• 第二重:产品的优化组合

• 第三重:应用部署架构的最佳实践

Page 3: Oracle为数据库优化的系统平台 · April 2010 Windows 2008R2 last release for Itanium by Microsoft Dec 2008 PA-RISC / Superdome ends Summer 2010 HP last vendor standing Feb

© 2010 Oracle Corporation – Proprietary and Confidential – Do Not Distribute 3

数据库应用的特点分析和优化思路

• 数据库是 90% 以上商业应用的基础和核心

• 数据库平台要求– 吞吐量与单线程处理能力并重

– 可靠、可用、连续

• 现实世界的大量数据库性能瓶颈存在于 I/O– Flash 简单有效助力性能优化

– Server+Flash 组合 ,“闪”耀性能

• 完美架构设计全方位消除瓶颈– Exadata

Page 4: Oracle为数据库优化的系统平台 · April 2010 Windows 2008R2 last release for Itanium by Microsoft Dec 2008 PA-RISC / Superdome ends Summer 2010 HP last vendor standing Feb

© 2010 Oracle Corporation – Proprietary and Confidential – Do Not Distribute 4

2011 Oracle SPARC Server Portfolio

M-Series Servers

SPARC T3

SPARC Enterprise M3000

SPARC Enterprise M4000

SPARC Enterprise M5000

SPARC Enterprise M8000

SPARC Enterprise M9000

SPARC T3-1 SPARC T3-2 SPARC T3-4

Blade Chassis Storage Blades

Sun Blade 6000 Disk Blade 2Sun Blade 6000

SPARC T3-1B

SPARC T4

SPARC T4-1 SPARC T4-2 SPARC T4-4 SPARC T4-1B

UltraSPARC T2/T2+

Sun SPARC Enterprise T5120/T5140Sun SPARC Enterprise

T5220/T5240Sun SPARC

Enterprise T5440 Sun Blade T6320/ T6340

SPARC Supercluster

Page 5: Oracle为数据库优化的系统平台 · April 2010 Windows 2008R2 last release for Itanium by Microsoft Dec 2008 PA-RISC / Superdome ends Summer 2010 HP last vendor standing Feb

© 2010 Oracle Corporation – Proprietary and Confidential – Do Not Distribute 5

T4-1B T4-2 T4-4T4-1

T3 Processor• 1.65GHz• Shared L2 6MB cache• No L3 cache• 16 Cores

• 3.0 GHz with OOO execution• Dedicated L2 128KB cache• Shared L3 4MB cache• 8 Cores with Private L2 Cache

单线程性能提高 5X以上

投资保护

T4 Processor

SPARC T4 Server – 更强大的数据库服务器 New Brain. Same Body.

Page 6: Oracle为数据库优化的系统平台 · April 2010 Windows 2008R2 last release for Itanium by Microsoft Dec 2008 PA-RISC / Superdome ends Summer 2010 HP last vendor standing Feb

© 2010 Oracle Corporation – Proprietary and Confidential – Do Not Distribute 6

Oracle SPARC T4 性能

• 性能大大超越 SPARC T3 and SPARC M3

• 在数据库,中间件,虚拟化,安全加密和企业应用上,性能比对手高出 2-5 倍– Fusion Middleware: 3x better than x86 and IBM Power7– Database: 2x Power7 $/performance– Security/Cryptography: 3x HP x86, 5x IBM Power7– #1 across a leading range of ERP, CRM, SCM

Page 7: Oracle为数据库优化的系统平台 · April 2010 Windows 2008R2 last release for Itanium by Microsoft Dec 2008 PA-RISC / Superdome ends Summer 2010 HP last vendor standing Feb

© 2010 Oracle Corporation – Proprietary and Confidential – Do Not Distribute 7

SPARC T4 Benchmark

TPCH @1000GB

System CPU type (Proc/Core/Thread) Result Database

SPARC T4-4 3 GHz SPARC T4 (4 / 32 / 256) 201,487 Oracle 11g

IBM Power 780 4.14 GHz POWER7 (8 / 32 / 128) 164,747 Sybase

HP SuperDome 2 1.73 GHz Intel Itanium 9350 (16 / 64 / 64) 140,181 Oracle 11g

SPARC T4-4 delivers 27% better TPCH performance than IBM Power780 (full hardware configuration with turbo-core) !

SPECjEnterprise2010

System CPU type (Proc/Core/Thread) Result One node Perf using linear methodology

4*SPARC T4-4 3 GHz SPARC T4 (16 / 128 / 1024) 40,104.86 10,026.21

IBM Power 750 3.55 GHz POWER7 (4 / 32 / 128) 7,172.93 -

SPARC T4-4 delivers 40% better performance than IBM Power750!

满配

Page 8: Oracle为数据库优化的系统平台 · April 2010 Windows 2008R2 last release for Itanium by Microsoft Dec 2008 PA-RISC / Superdome ends Summer 2010 HP last vendor standing Feb

© 2010 Oracle Corporation – Proprietary and Confidential – Do Not Distribute 8

SPARC T4 Processor

• Replace 16 S2 cores & L2$ used on T3 with 8 S3 cores and new 4MB L3$

• Reuse T3 Coherence, memory controllers, and I/O interfaces

• Features– 8 S3 cores, 8-64 threads @ up to

3Ghz– Single or multi-threaded operation

per core– System scalability to 4 sockets

• SPARC Core S3– 1-8 Strand Dynamically

Threaded Pipeline – ISA-based

Crypto-acceleration• 4MB Shared L3$

Full Crossbar4MB, 8 Bank, 16-way L3$

Coherency Unit Coherency Unit

PEUNIU

C2C1 C4C3 C6C5 C8C7

Memory Controller Memory Controller

BOB

DDR3

BOB

DDR3

BOB

DDR3

BOB

DDR3

PEU

2 x8 PCIe gen2 @ 5Gb/s8 GB/s each direction

6x 9.6GT/s Coherency Ports2-4 Socket Scalability

2 XAUI 10Gb Ethernet16KB I$16KB D$

128KB L2$FPU

Core S3

NDA Only

Page 9: Oracle为数据库优化的系统平台 · April 2010 Windows 2008R2 last release for Itanium by Microsoft Dec 2008 PA-RISC / Superdome ends Summer 2010 HP last vendor standing Feb

© 2010 Oracle Corporation – Proprietary and Confidential – Do Not Distribute 9

T-Series1-4 Socket

+ 2x Throughput

M-Series1-64 Socket

+ 20%

M-Series

Powered Up32-64 Sockets

+6x Throughput+1.5x Single Thread

T-Series1-4 Sockets

+5x Single Thread

M-Series32-64 Sockets

+2x Throughput>1x Single Thread

T-Series

In fabrication1-8 Sockets

+3x Throughput

SPARC1-64 Sockets

+2x Throughput+1.5x Single Thread

5 年 划

内核 4x

线程 32x

内存容量 16x

数据库 TPM 40x

每秒 Java 操作数 10x

Solaris 10

Update

Solaris 11 UpdateSolaris 11 Solaris 11 Update Solaris 11 UpdateSolaris 11 Express

2010 2011 2012 2013 2014 2015

Solaris 10

Update

Solaris 10

Update

SPARC 处理器发展蓝图Maximizing Results

Page 10: Oracle为数据库优化的系统平台 · April 2010 Windows 2008R2 last release for Itanium by Microsoft Dec 2008 PA-RISC / Superdome ends Summer 2010 HP last vendor standing Feb

© 2010 Oracle Corporation – Proprietary and Confidential – Do Not Distribute 10

M8000

M4000

M5000

M9000

M 系列服务器: Oracle 数据库软件的基础平台关键业务的最佳选择

企业级数据库的平台

• Reliability, availability, serviceability,and security

• 极高的垂直扩展能力

Page 11: Oracle为数据库优化的系统平台 · April 2010 Windows 2008R2 last release for Itanium by Microsoft Dec 2008 PA-RISC / Superdome ends Summer 2010 HP last vendor standing Feb

11© 2010 Oracle Corporation – Proprietary and Confidential – Do Not Distribute

M 系列服务器作为数据库基础平台价值所在

• 简单的,在线的系统资源的扩展 – 处理器,内存,操作系统, I/O, 等等。

• 世界纪录级的性能 – PeopleSoft, TPC-H… 处理能力的高扩展性

• 主动的自我修复能力 – 在处理器,内存, I/O 的一般错误下仍能够提供持续的服务

• 系统,软件升级无需停止数据库服务

无停机的数据库服务

• 完整的解决方案的提供

• 单一的部署管理

• 单一的系统,软件,以及售后服务。

简化的管理

优异的投资保护

• 系统生命周期的延长,扩展 — 在线硬件升级,扩展

• 对原有硬件,软件的广泛的支持能力

• 领先的总拥有成本的控制力 ( TCO )

Page 12: Oracle为数据库优化的系统平台 · April 2010 Windows 2008R2 last release for Itanium by Microsoft Dec 2008 PA-RISC / Superdome ends Summer 2010 HP last vendor standing Feb

12

不停顿的数据库服务 (cont.)

Oracle Database+ RAC+ ASM

+ M-Series RAS+ XSCF & Dynamic Reconfiguration+ Solaris Optimizations (I.E. DISM)

NON-STOP OPERATIONS

Page 13: Oracle为数据库优化的系统平台 · April 2010 Windows 2008R2 last release for Itanium by Microsoft Dec 2008 PA-RISC / Superdome ends Summer 2010 HP last vendor standing Feb

13

安腾 CPU 的发展趋势 Road to nowhere

April 2010Windows 2008R2 last release for Itanium by Microsoft

Dec 2008PA-RISC / Superdome ends

Summer 2010HP last vendor standing

Feb 2009•HP drops Windows 2003•Unisys drops Itanium

Dec 2009RedHat Linux drops Itanium (no support after RHEL v5)

Jan 2005Microsoft stops Windows XP on Itanium

Jan 2010Customers can no longer purchase PA-RISC CPUs

请问,现在还在使用 HP-UX

的用户将来怎么办?

Sept 2005Dell & IBM drop Itanium

Feb 2010SGI drops Itanium from its roadmap

* Source: Intel Server Update, Boyd Davis, GM Server Marketing, May 2009

© 2010 Oracle – Proprietary and Confidential / Internal Use Only

Mar 2011Oracle stops Software Development on Itanium

Page 14: Oracle为数据库优化的系统平台 · April 2010 Windows 2008R2 last release for Itanium by Microsoft Dec 2008 PA-RISC / Superdome ends Summer 2010 HP last vendor standing Feb

14

安腾前景渺茫

• 安腾被市场所抛弃已成事实

• Oracle 停止 Itanium 上的所有研发

• 传统安腾用户面临系统迁移、甚至系统重建的问

• 与其被动补救,不如主动求变

Page 15: Oracle为数据库优化的系统平台 · April 2010 Windows 2008R2 last release for Itanium by Microsoft Dec 2008 PA-RISC / Superdome ends Summer 2010 HP last vendor standing Feb

15© 2010 Oracle Corporation – Proprietary and Confidential – Do Not Distribute

Flash 加速 Oracle DB 性能

Page 16: Oracle为数据库优化的系统平台 · April 2010 Windows 2008R2 last release for Itanium by Microsoft Dec 2008 PA-RISC / Superdome ends Summer 2010 HP last vendor standing Feb

© 2010 Oracle Corporation – Proprietary and Confidential – Do Not Distribute 16

存储的层次

毫秒千分之一

微秒百万分之一

毫微秒十亿分之一

微微秒兆分之一

Page 17: Oracle为数据库优化的系统平台 · April 2010 Windows 2008R2 last release for Itanium by Microsoft Dec 2008 PA-RISC / Superdome ends Summer 2010 HP last vendor standing Feb

17© 2010 Oracle Corporation – Proprietary and Confidential – Do Not Distribute

Oracle 闪存全系列产品Comprehensive Flash Storage Portfolio

加速应用降低成本

Flash ModulesEmbedded in Servers and Flash Array

Flash Drives (2.5” & 3.5” SSDs)Optional with Servers and Storage

F20 Flash AcceleratorFlash/HBA PCIe cards for Servers

F5100 Flash ArrayCompact Storage Device

Sun FlashFire Technology - delivering the highest level of performance, durability and reliability

17

Page 18: Oracle为数据库优化的系统平台 · April 2010 Windows 2008R2 last release for Itanium by Microsoft Dec 2008 PA-RISC / Superdome ends Summer 2010 HP last vendor standing Feb

© 2010 Oracle Corporation – Proprietary and Confidential – Do Not Distribute 18

Flash 释放的能量

Page 19: Oracle为数据库优化的系统平台 · April 2010 Windows 2008R2 last release for Itanium by Microsoft Dec 2008 PA-RISC / Superdome ends Summer 2010 HP last vendor standing Feb

© 2010 Oracle Corporation – Proprietary and Confidential – Do Not Distribute 19

Do you have a Database I/O Bottleneck?Using ADDM / AWR / Statspack

• Statspack ‘free’ PL code download since Oracle 8.1.7• AWR since 10g• Use SWAT to determine what causing waits.

Top 5 Timed Events                                  Avg %Total

~~~~~~~~~~~~~~~~~~                                  wait Call

Event                           Waits    Time (s)  (ms)  Time Wait Class

---------------------------- ---------- -------- ---- ------ ----------

db file sequential read      19,858,182    72,997    4   41.0 User I/O

CPU time                                   55,805        31.4

log file sync                 3,840,570    33,452    9   18.8 Commit

log file parallel write       3,356,001    12,749    4    7.2 System I/O

db file scattered read        3,672,892    10,018    3    5.6 User I/O

          -------------------------------------------------------------

Page 20: Oracle为数据库优化的系统平台 · April 2010 Windows 2008R2 last release for Itanium by Microsoft Dec 2008 PA-RISC / Superdome ends Summer 2010 HP last vendor standing Feb

© 2010 Oracle Corporation – Proprietary and Confidential – Do Not Distribute 20

中型存储• 很少机框

少量 I/O

数据库智能闪存缓存技术 - 有效解决 I/O 问题

数据库智能闪存缓存透明地扩展了缓冲区缓存

• 呈数量级扩大

• 使用闪存阵列或 PCIe 卡

• 缓存消除了大部分读 I/O

优点

• 所需磁盘更少

• 不需要很强大的阵列

• 响应更快

• 大作业运行速度更快

• 耗能更低

• 大大降低 TCO

Buffer Cache

企业存储

多个机柜

Buffer Cache

数据库智能闪存缓存

F20 或 F5100

大量 I/O

Oracle 是首个闪存优化的数据库

Oracle 11gR2 Flash Cache 不支持 AIX 和 HP-UX !

Page 21: Oracle为数据库优化的系统平台 · April 2010 Windows 2008R2 last release for Itanium by Microsoft Dec 2008 PA-RISC / Superdome ends Summer 2010 HP last vendor standing Feb

21© 2010 Oracle Corporation – Proprietary and Confidential – Do Not Distribute

0

1

2

3

4

5

0x

1x

2x

3x

4x

5x

Oracle 11g, Sun SPARC Enterprise 5000, F5100 Flash Array

Please Note: Use of Flash Cache can boost performance significantly.  When one uses the Flash Cache feature of 11gR2 results will be dependent upon the amount of memory a system has and the amount of System Global Area (SGA) defined, the amount of flash cache being requested, and the working set size at any point in time. Source: Oracle Performance Benchmarks

FlashFire Accelerates Database Integrated Oracle Database Flash Cache Solutions

Database Flash Cache Size

Wor

kloa

d

No Flash = No Scale Acceleration

ThroughputResponse Time

4XFASTERPerformance

Page 22: Oracle为数据库优化的系统平台 · April 2010 Windows 2008R2 last release for Itanium by Microsoft Dec 2008 PA-RISC / Superdome ends Summer 2010 HP last vendor standing Feb

© 2010 Oracle Corporation – Proprietary and Confidential – Do Not Distribute 22

客户案例

• 系统架构: 2 台 M5000 作为数据库部署高可靠的数据库环境

• Oracle 10gR2 数据库软件

• F5100 作为数据库存储,将所有的数据文件都部署在 F5100 上 .

• 解决方案的关键,通过超级的 I/O 能力,彻底消除了 I/O 的瓶颈, 使得系统的整体性能达到了一个前所未有的高度 .

• ST2540 通过 SAN 网络部署到数据库服务环境中,作为非关键数据,备份数据的存储部件 .

SAN

F5100 Flash

F5100 Flash

DB

DB

M5000 database server HA

Archive & historyData storage

mirror

Page 23: Oracle为数据库优化的系统平台 · April 2010 Windows 2008R2 last release for Itanium by Microsoft Dec 2008 PA-RISC / Superdome ends Summer 2010 HP last vendor standing Feb

23© 2010 Oracle Corporation – Proprietary and Confidential – Do Not Distribute

Exadata 工程一体化消除数据库瓶颈

Page 24: Oracle为数据库优化的系统平台 · April 2010 Windows 2008R2 last release for Itanium by Microsoft Dec 2008 PA-RISC / Superdome ends Summer 2010 HP last vendor standing Feb

24© 2010 Oracle Corporation – Oracle Confidential – 24 –

前所未有的交钥匙方案:Oracle Exadata工程一体化数据库机

• 软硬件契合,工程一体化的系统提供极限性能

•随付即用的系统,可在数天内完成部署,极大缩短建设周期

• 完整的 , 预配置的 , 严格测试的系统,保证高可用性

Page 25: Oracle为数据库优化的系统平台 · April 2010 Windows 2008R2 last release for Itanium by Microsoft Dec 2008 PA-RISC / Superdome ends Summer 2010 HP last vendor standing Feb

25

传统架构的瓶颈

© 2010 Oracle Corporation – Oracle Confidential – 25 –

• 传统的存储系统已经成为数据库处理的瓶颈1. 存储系统到数据库的带宽有限

2. 存储阵列内部瓶颈

3. SAN 系统瓶颈

4. 因为物理磁盘的速度导致随机 I/O瓶颈• 数据带宽严重地限制了数据仓库的性能

• 随机 I/O 的瓶颈限制了 OLTP 应用的性能

Page 26: Oracle为数据库优化的系统平台 · April 2010 Windows 2008R2 last release for Itanium by Microsoft Dec 2008 PA-RISC / Superdome ends Summer 2010 HP last vendor standing Feb

26

出路 : 标本兼治

更多 ,更快的数据通道

减少数据传输

减少 I/O 数量 ,提升 I/O 性能

Page 27: Oracle为数据库优化的系统平台 · April 2010 Windows 2008R2 last release for Itanium by Microsoft Dec 2008 PA-RISC / Superdome ends Summer 2010 HP last vendor standing Feb

27

Exadata : 数据处理架构革命打破数据带宽瓶颈

• Exadata 采用更高的单路带宽– InfiniBand 提供 40Gb/s 的带宽,比高端阵列的光纤通道技术快 5~10 倍

• Exadata 提供更多的并发带宽– 模块化存储 /DB 单元,高度并行的存储网格

– 带宽与容量 / 处理能力成正比

• Exadata 传送更少的数据– 智能扫描 SmartScan– 自动透明的存储索引

– 混合型列压缩技术

• Exadata 提供更高的 IOPS– 智能 Exadata Smart Flash Cache技术处理更多的 IOPS

© 2010 Oracle Corporation – Oracle Confidential – 27 –

Exadata以更快的速度

传送更少的数据

Page 28: Oracle为数据库优化的系统平台 · April 2010 Windows 2008R2 last release for Itanium by Microsoft Dec 2008 PA-RISC / Superdome ends Summer 2010 HP last vendor standing Feb

28

国内用户实际性能数据

•某电信运行商数据仓库内轻度汇总性能在 Exadata 上提高近 200 倍。

•某电信运营商数据仓库内月结周期缩短 20 倍

•某电信运营商手机阅读平台承载能力在 Exadata 上提高了 10 倍

•某银行大型测试中,竞争对手平台在 10TB 场景中已经无法正常返回结果时, Exadata可在 1~20 分钟内返回查询结果。

•某银行数据仓库数据(协议,历史金额,参与人等)在 Exadata可达 10倍压缩比,且伴随 40% 的性能提升

•某大型制造业企业数据仓库 ETL周期缩短 34 倍

•某保险行业使用 Exadata带来 20 倍以上的性能提升

•某电信运营商网管系统整合, Exadata承载了 17个应用,压缩比 8倍~23 倍,性能 18 倍到 352 倍

无与伦比的性能

Page 29: Oracle为数据库优化的系统平台 · April 2010 Windows 2008R2 last release for Itanium by Microsoft Dec 2008 PA-RISC / Superdome ends Summer 2010 HP last vendor standing Feb

29

优化的境界

• 第一重:选择正确的产品兼顾性能 ,可靠性和扩展能力

• 第二重:产品的优化组合消除瓶颈,提升系统整体性能

• 第三重:应用部署架构的最佳实践软硬件相结合,达到性能和可靠性的最优境界

Page 30: Oracle为数据库优化的系统平台 · April 2010 Windows 2008R2 last release for Itanium by Microsoft Dec 2008 PA-RISC / Superdome ends Summer 2010 HP last vendor standing Feb

30

国内教育行业部分案例

• 广州考试中心 考试系统 M8000 、 M5000

• 华工 数字校园 M8000 、 M5000 、 M4000

• 华农 图书馆 v890 等

• 中大 图书馆 v890 等

• 深圳技术学校 M4000

• 深大 图书馆 v890

• 东莞理工大学 v490 , M3000

• 广州中山图书馆 M5000

• 中央财经大学 VDI 及教学系统

• 公安大学 数字图书馆

• 传媒大学 数字图书馆

• 北京第二外国语学院辅助决策支持系统

Page 31: Oracle为数据库优化的系统平台 · April 2010 Windows 2008R2 last release for Itanium by Microsoft Dec 2008 PA-RISC / Superdome ends Summer 2010 HP last vendor standing Feb

31

国内教育行业部分案例

• 西北工业大学教务系统 M5000,F4800

• 重庆邮电大学数字化校园 M8000 等

• 重庆大学 数字化校园 M8000 等

• 西华大学 数字化校园 M5000 等、 Storage 6180/6120

• 电子科技大学数字化校园 E25K,E6900,Sun Ray,Storage 6580/5320 NAS, SL500

• 重庆医科大学数字化校园 ,校园一卡通

• 四川大学 数字化校园 ,邮件系统

• 西南交通大学校园一卡通

• 西南科技大学数字化校园

• 重庆工商大学数字化校园,校园一卡通

• 云南财经大学数字化校园

Page 32: Oracle为数据库优化的系统平台 · April 2010 Windows 2008R2 last release for Itanium by Microsoft Dec 2008 PA-RISC / Superdome ends Summer 2010 HP last vendor standing Feb

32© 2010 Oracle Corporation – Proprietary and Confidential – Do Not Distribute