sql pass taiwan 七月份聚會-1
TRANSCRIPT
04/18/2023
Virtual Heterogeneous Database Platform
Smith Yang 楊士岳Trend Micro-Corp IT Technology Team DBA
Version 0.1
Virtual Heterogeneous Database Platform
Agenda
Project Background Project Objective Virtual Platform and Solutions DB Server Model Selection DB High Availability Solution Datakeeper vs Failover Clustering Operation Team’s Concern Monitoring Team’s Endorsement
04/18/2023 |
2 |
Project Background
Current physical DB server challenges• Low utilization : High occupation of rack space
for physical servers• Physical limitation: Difficulty to move services
in the rack• High Cost : Hosting and maintenance of
physical servers dedicated for single projects
04/18/2023 |
Virtual Heterogeneous Database Platform3 |
Project Objective
Support direction of Cloud Enablement by moving 100% of Data Center Virtualization
Provide a Virtualization Platform to host multiple database platforms and solutions requiring high performance
Provide Security and Performance Isolation for services while still achieving high degree of Hardware Utilization
Improve Efficiency of DB Service through automated provisioning and management
04/18/2023 |
Virtual Heterogeneous Database Platform4 |
Virtual Heterogeneous Database Platform04/18/2023 |
5 |
APP APP
SQL SQL
SSD/SAS
CPU
RAM
Hypervisors
SSD/SAS
CPU
RAM
SSD/SAS
CPU
RAM
SSD/SAS
CPU
RAM
Management Layer
APP APP
VIRTUAL SOLUTIONS
VIRTUAL PLATFORM
• Support Legacy DB Services (SQL2005, 2008, MySQL, etc..)
• Multiple HA Solutions depending on Service Needs (DataKeeper, Replication, AlwaysOn, Load Balancing Solutions etc..)
• Automated Deployment and Configuration• Leveraging Application or Database HA
Solutions (not VMware HA)
• Platform to Support Cloud Design• Utilize local SSD and Caching Technology
to improve IO capability by a factor of x10• Segregation of Services into Different
Virtual Machines• Compute Performance Isolated Per
Service• Security Isolated per Service• Platform to Support Package Apps (see
above)• Full Utilization of Hardware
Orchestration
Virtual Platform and Solutions
DB Server Model Selection
Consumption Low Medium High
CPU 1 v-CPU 2 v-CPU 4 v-CPU
Memory 8 GB 16 GB 32 GB
Compute resource allocation for VM server
• VM local storage allocation base on service need
Model HighPerformance
HighCapacity
Hard disk
Pure SSD Hybrid SSD+SAS
Capacity Up to 2880 GB Up to 4860 GB
Note. Higher resource request would be exception only
Local Datastore
DB High Availability Solution
Features Datakeeper Clustering Mirroring AlwaysOn Log Shipping Replication
SoftwareHardware
DKCELicenses
MS-SQL / Storage
MS-SQLMS-SQL
2012MS-SQL MS-SQL
Auto Failover Yes Yes
Yes (HA mode)
Yes No No
Units Node Server
Node Server
DBGroup of
DBDB
TableArticles
Data Replica 1 (*) 0 1 0-4 Unlimited Unlimited
Note (*) New version DKCE allow for snapshot at Mirror node, offload the backup and reporting from Primary node
Our application level solutions can also utilized similar to physical DB servers.
04/18/2023 |
Virtual Heterogeneous Database Platform7 |
Datakeeper - Alternative Approach to ClusteringTraditional Clustering - Shared SAN Storage Clustering with Local Storage and Datakeeper
Challenges : • No Persistent Shared Storage Options
in AWS – Not cloud ready• Requirement for Shared SAN Storage• Disaster Recovery Requires Expensive
SAN Replication Technology• 1 Copy of the Data• Complex Setup – Raw Device
Mappings
Benefits : • Fully Supported HA Solution in AWS
Public Cloud – more here• Local Storage – no SAN• Low cost solution for keeping
Disaster Recovery site in synch. • Mirror Copy of data can be used to
offload backups and reporting• Simple to configure
04/18/2023 |
Virtual Heterogeneous Database Platform8 |
Future Flexibility : DC OPs consider to reserve more resources (HBA/Memory/HDD) in server.
Multiple Cluster Nodes Design : We could have enough time to recovery from any hardware failure.
Standard SOP : Exercise and rebuild in pilot test servers. Parallel Pilot : P2V transformation from Production then test
together with service owners. Get Familiar With : Maintenance for Windows Cluster + SQL 2012
AlwaysOn AG + Datakeeper. Performance Impact : While multiple DB Instance running
together in one physical server. Network Loading : Monitor 1GB Ethernet Switch within
DataCenter and cross-site utilization.
Operation Team’s Concern
04/18/2023 |
Virtual Heterogeneous Database Platform9 |
The monitoring scope of new DB platform can be covered by
the following tools.
Monitoring Team’s Endorsement
Item Monitor Tools
Service availability PRTG, Quest Foglight
Performance Monitoring Quest Performance Analysis
Capacity Management PRTG, Quest Capacity Manager
Backup Quest LiteSpeed, Veeam, SQL Backup, CommVault
Audit MS SQL Audit tool
04/18/2023 |
Virtual Heterogeneous Database Platform10 |
Q & A
04/18/2023 |
Virtual Heterogeneous Database Platform11 |