oceanbase数据库架构演进 及 双11”实践 压/giac 2016 -...
TRANSCRIPT
thegiac.com
OceanBase 11
thegiac.com
OceanBase
2011.10(v0.2)
2012.4(v0.3)
2012.11(v0.4)
2014.2(v0.5)
2015.11
2016.11v1.2)
2011.2(v0.1)
2010.6
thegiac.com
OceanBase
OLAP
2006400GB QPS
thegiac.com
11
0.5 9.36 33.6191
352
571
912
1207
0
200
400
600
800
1000
1200
1400
2009 2010 2011 2012 2013 2014 2015 2016
thegiac.com
201611
17.5 12
OceanBase QPS650 TPS360 RT0.7ms
thegiac.com
Scalability is the capability of a system, network, or process to handle a growing amount of work, or its potential to be enlarged in order to accommodate that growth. For example, it can refer to the capability of a system to increase its total output under an increased load when resources (typically hardware) are added.
-Wikipedia
thegiac.com
thegiac.com
thegiac.com
A1
B1
KV
R
LDC1
C
A2
B2
KV
R
LDC2
C
thegiac.com
OceanBase1
thegiac.com
OceanBase
1161200/200 1K600GB
LSM-Tree
bloomfilter
SSD
MemTable
SSTable
DATA
thegiac.com
cont.
ac#ve memtable(v3)
frozen memtable(v3.2)
frozen memtable(v3.1)
ac#ve memtable(v4)
baseline sstable(v2)
baseline sstable(v2)
stored sstable(v3.2)
stored sstable(v3.1)
ac#ve memtable(v4)
baseline sstable(v2)
ac#ve memtable(v4)
baseline sstable(v3)
freeze
dump(maybe)
merge merge
thegiac.com
SQL
SQL
SQL HashRangeInterval OceanBase 0.5
hash uidinterval
thegiac.com
MVCC REDOMulti-Paxos
2PC
XA Transaction vs. vs.
P0 P1
P0 P1
P3
P3
P4
P4
thegiac.com
&
RAID OceanBase OceanBase OceanBase
OB 0.5
&
thegiac.com
()
()
OB() OB()
OB()
OceanBaseMulti-Paxos&
RPaxos R R20s
R R R
thegiac.com
zoneregion
thegiac.com
SQL
MySQL MySQL
&
& range DDL CTXCAT
thegiac.com
Output
Exchange
HashJoin
TableScan(T1)
Exchange Exchange
TableScan(T2)
thegiac.com
M0
T0 T2 T1
M1 M2 M3
R
TablePar66ons
S0 S1 S2
Output
Channal
P0 P1 P2
thegiac.com
Proxy
Proxy vs.
JDBC Driver session
Proxy
thegiac.com
CPU
thegiac.com
&hash SQLPlan Cache
IOget
thegiac.com
INSERT SELECT OLTP
TPS/QPS 181,869 751,808 206,437
RT 2.75ms 0.66ms 43.59ms
95%RT 4.20ms 1.22ms 57.17ms
Sysbench Intel(R) Xeon(R) E5-2682
[email protected](HT) Memory512GB RAM DiskLSI RAID5 500
201611
1/(0.3+0.7/2)=1.54 1/(0.3/2+0.7)=1.18
thegiac.com
cont.
DB
SQL-VM CPU
thegiac.com
P0 P1
P0 P1 P0 P1
thegiac.com
SSD
thegiac.com
11
OceanBase OceanBase
thegiac.com
OceanBase1
thegiac.com
OceanBase2
ZONE1
OBS1
L
T1-VM1
L
T2-VM1
OBS2
R L
T1-VM2
L L
T3-VM1
ZONE2
OBS3
R
T1-VM3
L L
T4-VM1
OBS4
R L
T1-VM4
L
T2-VM2
APP1
APP2 APP2
APP1
thegiac.com
SQL-VM
LeaderSQL-VM
IOPSCPU
thegiac.com
SELECT
ZONE > IDC >
ZONE
thegiac.com
OceanBase OLTP, OLAP DaaS
thegiac.com
vs.
thegiac.com
C++ STL Coverity
Code Review
thegiac.com
gtestgmock SQLobschema mysqltest, RQG, pquery, obgene
mysqltest: PS, j-connector obtest obmonstor
sysbench, obmeter obstress obtradeobbank
thegiac.com
& git+release ob-reviewreview ob-pretest ob-commitbug fast-train ob-deployRD dmucs+distcc HTCondor & ob-farm AONEbug, issue, review
Thank you
OceanBase
thegiac.com
OceanBase [email protected]
thegiac.com