a revolutionary approach to modernizing the data warehouse
TRANSCRIPT
ANALYST:
Rick Sherman Managing Partner, Athena IT Solutions
ANALYST:
Dr. Robin Bloor Chief Analyst, The Bloor Group
GUEST:
Bob Muglia CEO, Snowflake Computing TH
E LINE UP
Copyright © 2015 Athena IT Solutions
Rick Sherman Athena IT Solu4ons
A Revolu4onary Approach to Modernizing the Data Warehouse
Hot Technologies
Rick Sherman Athena IT Solu4ons rsherman@athena-‐solu4ons.com
Slide 8 Copyright © 2015 Athena IT Solutions All rights reserved.
Modernizing the Data Warehouse Traditional DW - Data Architecture - Hub & Spoke
Slide 9 Copyright © 2015 Athena IT Solutions All rights reserved.
Modernizing the Data Warehouse Traditional DW – Technology Architecture – 3 Enabling Layers
Slide 10 Copyright © 2015 Athena IT Solutions All rights reserved.
Modernizing the Data Warehouse Traditional DW – Moving Out of Its Comfort Zone
Data - Differences in origin, management & use of data
Slide 11 Copyright © 2015 Athena IT Solutions All rights reserved.
Modernizing the Data Warehouse Traditional DW - Evolution
Databases - Differences in data structures, schemas & technologies
Slide 12 Copyright © 2015 Athena IT Solutions All rights reserved.
Modernizing the Data Warehouse Traditional DW - Evolution
Integration - Differences in types of integration, data & technologies
Slide 13 Copyright © 2015 Athena IT Solutions All rights reserved.
Modernizing the Data Warehouse Traditional DW – Current State of Affairs
Slide 14 Copyright © 2015 Athena IT Solutions All rights reserved.
Modernizing the Data Warehouse Changing the Architectural Approach
Classic DW-Oriented Architecture Analytical Data Architecture (ADA)
Slide 15 Copyright © 2015 Athena IT Solutions All rights reserved.
Modernizing the Data Warehouse Creating an Analytics-Oriented Data Architecture
Slide 16 Copyright © 2015 Athena IT Solutions All rights reserved.
Modernizing the Data Warehouse Analytical Data Architecture (ADA)
Slide 18 Copyright © 2015 Athena IT Solutions All rights reserved.
Creating a Data Architecture BI & Analytics My Background
• Experience ü 25 years of DW & BI experience ü 30 years relational database experience ü Consulting, IT and Software Engineering
• Consulting ü Business & IT Groups ü Software Vendors
• Instructor ü Northeastern University, Graduate School of Engineering ü DW & BI Conferences; DW & BI Courses
• Writer, Columnist, Blogger ü Book & 200+ Published Articles ü White papers, Webinars, Podcasts & Seminars ü DataDoghouse.com Blog on BI/DW industry
• Thought Leadership: ü TDWI – Boston User Group Officer ü Boulder BI Brain Trust
§ Inexpensive (?) § Any data § May have metadata § Poor performance § Weak scheduling § Weak data mgmt § Security? § Data lake
§ Expensive § Prepared data § Will have metadata § Optimized § Optimized § Good data mgmt § Secure § Data workhorse
Hadoop v Data Warehouse
Hadoop DBMS/EDW
§ Cloud deployments
§ CPU/GPU merging
§ Commodity servers and storage
§ On-chip processing
§ Memory-based architectures
§ Virtual networks
§ Parallel S/W
§ Data volumes!!
§ Hadoop + Schema on read
§ Unstructured data
§ Event data
§ Data availability and the market for data
§ Analytics workloads
§ Analytics tools
Dimensions of Disruption
The Questions?
What are the characteristics of an appropriate data warehouse?
Should it live in the cloud?