mysql56 replication

MySQL 5.6 Replication New feature

데이터기술팀 운영파트

조민

INDEX

1. New Crash-Safe Slaves

2. New Multi-threaded Slaves

3. New Time-delayed Replication

4. New Optimized Row-based Replication

5. New Replication Checksums

6. New Global Transactions Identifiers (GTIDs)

1. New Crash-Safe Slaves (설정)

my.cnf

relay-log-info-repository=TABLE

master-info-repository=TABLE

# default FILE

==============================================================

mysql> stop slave;

Query OK, 0 rows affected, 1 warning (0.00 sec)

mysql> set global master_info_repository='TABLE';

Query OK, 0 rows affected (0.02 sec)

mysql> set global relay_log_info_repository='TABLE';


mysql> start slave;



mysql> select * from mysql.slave_master_info\G

*************************** 1. row ***************************

Number_of_lines: 23

Master_log_name: mysql-bin.000005

Master_log_pos: 2396

Host: 10.98.98.115

User_name: mig

User_password: mig

Port: 7979

Connect_retry: 60

Enabled_ssl: 0

Ssl_ca:

Ssl_capath:

Ssl_cert:

Ssl_cipher:

Ssl_key:

Ssl_verify_server_cert: 0

Heartbeat: 1800

Bind:

Ignored_server_ids: 0

Uuid: c35b769a-8fac-11e2-a667-00a0d1e293e2

Retry_count: 86400

Ssl_crl:

Ssl_crlpath:

Enabled_auto_position: 0

1 row in set (0.00 sec)


mysql> select * from mysql.slave_relay_log_info\G

*************************** 1. row ***************************

Number_of_lines: 7

Relay_log_name: ./db-ha-db2-relay-bin.000011

Relay_log_pos: 1770



Sql_delay: 60

Number_of_workers: 0

Id: 1


장애 시 Duplication 제거 Query 이용 !!! (DIS)

느리다!!!

2. New Multi-threaded Slaves (설정)

my.cnf

relay-log-info-repository=TABLE

master-info-repository=TABLE

slave-parallel-workers=3

=============================================

mysql> stop slave;


mysql> set global slave_parallel_workers=3;


mysql> start slave;



mysql> select * from slave_worker_info\G

*************************** 1. row ***************************

Id: 1

Relay_log_name:

Relay_log_pos: 0

Master_log_name:

Master_log_pos: 0

Checkpoint_relay_log_name:

Checkpoint_relay_log_pos: 0

Checkpoint_master_log_name:

Checkpoint_master_log_pos: 0

Checkpoint_seqno: 0

Checkpoint_group_size: 64

Checkpoint_group_bitmap:

*************************** 2. row ***************************

Id: 2

Relay_log_name:

Relay_log_pos: 0

Master_log_name:

Master_log_pos: 0





Checkpoint_seqno: 0



*************************** 3. row ***************************

Id: 3

Relay_log_name:

Relay_log_pos: 0

Master_log_name:

Master_log_pos: 0





Checkpoint_seqno: 0




2. New Multi-threaded Slaves (thread 1)

MASTER

mysql> show processlist;

+----+------+--------------------------+-------+-------------+------+-----------------------------------------------------------------------+------------------------------------------------------------------------------------------------------+


+----+------+--------------------------+-------+-------------+------+-----------------------------------------------------------------------+------------------------------------------------------------------------------------------------------+

| 5 | root | localhost | mysql | Query | 0 | init | show processlist |

| 7 | mig | db-ha-db2.daum.net:58746 | NULL | Binlog Dump | 208 | Master has sent all binlog to slave; waiting for binlog to be updated | NULL |

| 9 | root | localhost | test | Query | 1 | query end | INSERT INTO sbtest(k, c, pad) VALUES (0,' ','qqqqqqqqqqwwwwwwwwwweeeeeeeeeerrrrrrrrrrtttttttttt'),(0 |

+----+------+--------------------------+-------+-------------+------+-----------------------------------------------------------------------+------------------------------------------------------------------------------------------------------+



mysql> select * from slave_worker_info\G

*************************** 1. row ***************************

Id: 1

Relay_log_name:

Relay_log_pos: 0

Master_log_name:

Master_log_pos: 0





Checkpoint_seqno: 0



*************************** 2. row ***************************

Id: 2

Relay_log_name:

Relay_log_pos: 0

Master_log_name:

Master_log_pos: 0





Checkpoint_seqno: 0



*************************** 3. row ***************************

Id: 3


Relay_log_pos: 34788107



Checkpoint_relay_log_name: ./db-ha-db2-relay-bin.000013


Checkpoint_master_log_name: mysql-bin.000003


Checkpoint_seqno: 1





mysql> select * from slave_worker_info \G

*************************** 1. row ***************************

Id: 1

Relay_log_name:

Relay_log_pos: 0

Master_log_name:

Master_log_pos: 0





Checkpoint_seqno: 0



*************************** 2. row ***************************

Id: 2









Checkpoint_seqno: 5


Checkpoint_group_bitmap: *

*************************** 3. row ***************************

Id: 3









Checkpoint_seqno: 4





빠르다!!!

Database 단위.... -_-; Distribution ???

- CPU: 2 sockets, 6 cores with hyper-threading, 2930 MHz. - OS: 64-bit Oracle Enterprise Linux 6.1

- Memory: 48 GB

- sysbench unit test with multiple schema

INDEX








mysql> stop slave;


mysql> CHANGE MASTER TO MASTER_DELAY =60;


mysql> start slave;



mysql> show slave status\G

*************************** 1. row ***************************

Master_Log_File: mysql-bin.000005

Read_Master_Log_Pos: 2652

Relay_Log_File: db-ha-db2-relay-bin.000002

Relay_Log_Pos: 314

Relay_Master_Log_File: mysql-bin.000005

Slave_IO_Running: Yes

Slave_SQL_Running: Yes

Exec_Master_Log_Pos: 2396

SQL_Delay: 60

SQL_Remaining_Delay: 33

Slave_SQL_Running_State: Waiting until MASTER_DELAY seconds after master executed event



Drop 을 막을 수 있다…

서비스 이용에는... -_-;

INDEX








my.cnf

binlog_row_image=MINMAL

# default FULL

# full : Log all columns

# minimal : Log only changed columns, and columns needed to identify rows

# noblob : Log all columns, except for unneeded BLOB and TEXT columns


mysql> reset master;


mysql> show master status;

+------------------+----------+--------------+------------------+-------------------+

| File | Position | Binlog_Do_DB | Binlog_Ignore_DB | Executed_Gtid_Set |

+------------------+----------+--------------+------------------+-------------------+

| mysql-bin.000001 | 151 | | | |

+------------------+----------+--------------+------------------+-------------------+


mysql> show session variables like 'binlog_row_image';

+------------------+-------+

| Variable_name | Value |

+------------------+-------+

| binlog_row_image | FULL |

+------------------+-------+


mysql> update sss set k=10 where id=1;

Query OK, 1 row affected (0.01 sec)

Rows matched: 1 Changed: 1 Warnings: 0


+------------------+----------+--------------+------------------+----------------------------------------+


+------------------+----------+--------------+------------------+----------------------------------------+

| mysql-bin.000001 | 511 | | | c35b769a-8fac-11e2-a667-00a0d1e293e2:1 |

+------------------+----------+--------------+------------------+----------------------------------------+



mysql> set session binlog_row_image='MINIMAL';


mysql> reset master;



+------------------+----------+--------------+------------------+-------------------+


+------------------+----------+--------------+------------------+-------------------+

| mysql-bin.000001 | 151 | | | |

+------------------+----------+--------------+------------------+-------------------+


mysql> update sss set k=11 where id=1;




+------------------+----------+--------------+------------------+----------------------------------------+


+------------------+----------+--------------+------------------+----------------------------------------+

| mysql-bin.000001 | 399 | | | c35b769a-8fac-11e2-a667-00a0d1e293e2:1 |

+------------------+----------+--------------+------------------+----------------------------------------+




+------------------+-------+


+------------------+-------+

| binlog_row_image | FULL |

+------------------+-------+

1 row in set (0.00 sec)mysql> update sss set k=12 where id=1;



### UPDATE `ttt`.`sss`

### WHERE

### @1=1

### @2=11

### @3=''

### @4='qqqqqqqqqqwwwwwwwwwweeeeeeeeeerrrrrrrrrrtttttttttt'

### SET

### @1=1

### @2=12

### @3=''

### @4='qqqqqqqqqqwwwwwwwwwweeeeeeeeeerrrrrrrrrrtttttttttt'

# at 728


+------------------+---------+


+------------------+---------+

| binlog_row_image | MINIMAL |

+------------------+---------+

1 row in set (0.00 sec)mysql> update sss set k=11 where id=1;



### UPDATE `ttt`.`sss`

### WHERE

### @1=1

### SET

### @2=11

# at 368


CREATE TABLE `t1` (

à` int(11) NOT NULL DEFAULT '0',

`b` int(11) DEFAULT NULL,

`c` char(10) DEFAULT NULL,

PRIMARY KEY (à`)

)

update t1 set b=10 where a=1;

### UPDATE `ttt`.`t1`

### WHERE

### @1=1

### SET

### @2=10

CREATE TABLE `t2` (

à` int(11) NOT NULL DEFAULT '0',


`c` char(10) DEFAULT NULL,

PRIMARY KEY (à`),

KEY `b` (`b`)

)

update t2 set b=10 where b=1;


### WHERE

### @1=101

### SET

### @2=10

CREATE TABLE `t3` (

à` int(11) DEFAULT NULL,


`c` char(10) DEFAULT NULL

)

update t3 set b=10 where a=1;


### WHERE

### @1=1

### @2=100

### @3='aaaaa'

### SET

### @2=10


스마트해진 ROW format

PK가 필요함 !!!

INDEX








MASTER SLAVE

binary log

relay log

I/O thread

SQL thread

Dump thread

binlog_checksum Default:CRC32 {NONE|CRC32}

master_verify_checksum Default:OFF {0|1}

slave_sql_verify_checksum Default:0 {0|1}


mysql> show binlog events in 'mysql-bin.000007' from 191;

+------------------+-----+------------+-----------+-------------+--------------------------------------------------------------------+

| Log_name | Pos | Event_type | Server_id | End_log_pos | Info |

+------------------+-----+------------+-----------+-------------+--------------------------------------------------------------------+

| mysql-bin.000007 | 191 | Gtid | 1234 | 239 | SET @@SESSION.GTID_NEXT= 'c35b769a-8fac-11e2-a667-00a0d1e293e2:39' |

| mysql-bin.000007 | 239 | Query | 1234 | 316 | BEGIN |

| mysql-bin.000007 | 316 | Query | 1234 | 418 | use `ttt`; insert into ttt values (12345) |

| mysql-bin.000007 | 418 | Xid | 1234 | 449 | COMMIT /* xid=1053612 */ |

+------------------+-----+------------+-----------+-------------+--------------------------------------------------------------------+


Binlog 수정


+------------------+-----+------------+-----------+-------------+--------------------------------------------------------------------+

| Log_name | Pos | Event_type | Server_id | End_log_pos | Info |

+------------------+-----+------------+-----------+-------------+--------------------------------------------------------------------+

| mysql-bin.000007 | 191 | Gtid | 1234 | 239 | SET @@SESSION.GTID_NEXT= 'c35b769a-8fac-11e2-a667-00a0d1e293e2:39' |

| mysql-bin.000007 | 239 | Query | 1234 | 316 | BEGIN |

| mysql-bin.000007 | 316 | Query | 1234 | 418 | use `ttt`; insert into ttt values (12341) |

| mysql-bin.000007 | 418 | Xid | 1234 | 449 | COMMIT /* xid=1053612 */ |

+------------------+-----+------------+-----------+-------------+--------------------------------------------------------------------+


mysql> SET GLOBAL MASTER_VERIFY_CHECKSUM=1;



ERROR 1220 (HY000): Error when executing command SHOW BINLOG EVENTS: Wrong offset or I/O error

#130327 20:59:04 server id 1234 end_log_pos 418 CRC32 0x171597fb Query thread_id=148 exec_time=0 error_code=0

use `ttt`/*!*/;

SET TIMESTAMP=1364385544/*!*/;

insert into ttt values (12645)

/*!*/;

# at 418


MASTER SLAVE

binary log

relay log

I/O thread

SQL thread

Dump thread

장애부분 최소화

느려요~

INDEX








my.cnf

log-bin

log-slave-updates

gtid-mode=ON

disable-gtid-unsafe-statements

mysql> show master status\G

*************************** 1. row ***************************

File: mysql-bin.000007

Position: 449

Binlog_Do_DB:

Binlog_Ignore_DB:

Executed_Gtid_Set: c35b769a-8fac-11e2-a667-00a0d1e293e2:1-39


mysql> show slave status\G

Retrieved_Gtid_Set: c35b769a-8fac-11e2-a667-00a0d1e293e2:38-45

Executed_Gtid_Set: 6873760e-8fb3-11e2-a693-00a0d1e291dc:1-2,

c35b769a-8fac-11e2-a667-00a0d1e293e2:1-61152

고맙습니다

mysql56 replication

Technology