aws re:invent 2016: tableau rules of engagement in the cloud (stg306)

Tableau: Rules of Engagement in the Cloud

Albert Wong - Enterprise Reporting PlatformSrikanth Devidi - Data Engineering & Analytics

Re:invent - December 1, 2016

Metrics

Re:Invent - Tableau Rules of Engagement in the Cloud - December 1, 2016

86 million members125 hours/day190 countries

Netflix Culture

Re:Invent - Tableau Rules of Engagement in the Cloud - December 1, 2016

● Freedom and responsibility

● Loosely coupled, highly aligned

● Context over control

Google Search: Netflix Culture Deck

Re:Invent - Tableau Rules of Engagement in the Cloud - December 1, 2016

Data Platform

Re:Invent - Tableau Rules of Engagement in the Cloud - December 1, 2016

events data

operations data

data processors

fast storage data viz

data

exploration

data services

kragle

metacat

portal

Amazon S3

Amazon Redshift

Single Data Warehouse

Re:Invent - Tableau Rules of Engagement in the Cloud - December 1, 2016

Amazon S3

Accessing Data Warehouse

Re:Invent - Tableau Rules of Engagement in the Cloud - December 1, 2016

Specialized Data Storage

Re:Invent - Tableau Rules of Engagement in the Cloud - December 1, 2016

Amazon Redshift

Tableau Development

Re:Invent - Tableau Rules of Engagement in the Cloud - December 1, 2016

Re:Invent - Tableau Rules of Engagement in the Cloud - December 1, 2016

REST API

Connecting to Data

Re:Invent - Tableau Rules of Engagement in the Cloud - December 1, 2016

Amazon Redshift

Addressing Big Data Issues

Re:Invent - Tableau Rules of Engagement in the Cloud - December 1, 2016

Amazon Redshift

Tableau data extract

Netflix + Tableau API

Summary

Re:Invent - Tableau Rules of Engagement in the Cloud - December 1, 2016

● Culture● Cloud● Scalability● Development

Analytics(How we use Tableau to run our business)

Re:Invent - Tableau Rules of Engagement in the Cloud - December 1, 2016

Re:Invent - Tableau Rules of Engagement in the Cloud - December 1, 2016

Data Engineering & Analytics

Metrics

Data Engineering

Visualization

f(x) = (a*b)/n

Re:Invent - Tableau Rules of Engagement in the Cloud - December 1, 2016

Audience

Re:Invent - Tableau Rules of Engagement in the Cloud - December 1, 2016

Read Process Store Sync Visualize

Architecture

Amazon S3 Amazon RedshiftAmazon S3

Data Products

Re:Invent - Tableau Rules of Engagement in the Cloud - December 1, 2016

Example: Exploratory dashboards

Re:Invent - Tableau Rules of Engagement in the Cloud - December 1, 2016

Re:Invent - Tableau Rules of Engagement in the Cloud - December 1, 2016

Example: Personalization

Iterative development

Storytelling

Tableau DesktopBuilt-in chart typesConnectors

Tableau ServerDeploymentVersion control

Re:Invent - Tableau Rules of Engagement in the Cloud - December 1, 2016

Tableau for Dashboards

Packaged Data Sources(for power users)

Re:Invent - Tableau Rules of Engagement in the Cloud - December 1, 2016

Re:Invent - Tableau Rules of Engagement in the Cloud - December 1, 2016

Tableau Data Source

TableauServer

TableauExtractRaw Data

AdditionalMetadata

+

Re:Invent - Tableau Rules of Engagement in the Cloud - December 1, 2016

Tableau Data Source

Re:Invent - Tableau Rules of Engagement in the Cloud - December 1, 2016

Reusable

Data governance

Tested up to 100M recordsVery wide Varying cardinality

~90 GB uncompressed~6 GB compressed

Why Tableau Data Source?

Hell’s Kitchen Stats

Re:Invent - Tableau Rules of Engagement in the Cloud - December 1, 2016

Tableau JS API

Tableau React

Re:Invent - Tableau Rules of Engagement in the Cloud - December 1, 2016

XML Hacking

Rule #1

Re:Invent - Tableau Rules of Engagement in the Cloud - December 1, 2016

Are you still watching?

Continue watching

Back

For iterative development, use:• Smaller, local extracts• Database views

#1

Re:Invent - Tableau Rules of Engagement in the Cloud - December 1, 2016

For dashboard performance, stick with extracts.

#2

Re:Invent - Tableau Rules of Engagement in the Cloud - December 1, 2016

Slow queries? Check system background jobs.

#3

Re:Invent - Tableau Rules of Engagement in the Cloud - December 1, 2016

For live connections, check:• concurrency limits• .tdc and query fusion

#4

Re:Invent - Tableau Rules of Engagement in the Cloud - December 1, 2016

Test with the user in mind.

#5

Re:Invent - Tableau Rules of Engagement in the Cloud - December 1, 2016

See you at the Netflix booth!

@albertcwong@srikanthdevidi@netflixdata