トレジャーデータのバッチクエリとアドホッククエリを理解する
DESCRIPTION
トレジャーデータのバッチクエリ，アドホッククエリの紹介です。ケースや可視化ツールに応じて柔軟に使い分けることが肝要です。TRANSCRIPT
- 1. 12014/09Takahiro Inoue (Chief Data Scientist)[email protected]
2. 21Agenda1. Hive v.s. Presto2. 2-1. Metric Insights2-2. Tableau Server2-3. Redshift Tableau Desktop/Server2-4 (a). DMP2-4 (b). DMP DSP3. 3-1. Chartio3-2. Tableau Desktop3-3. DMP 3. 31. 4. 4Treasure Data Service Result OutputFlexible, Scalable,Columnar StorageWebAppRDBMSCRMERPTreasure AgentTD ToolbeltKPIMetric Insights, etc.Tableau,Motion Board etc.SQL, PigRDBMS, Google Docs,AWS S3, FTP Server,etc.POSHadoop, Treasure Query AcceleratorREST APIODBC/JDBCSQL, Pig 5. 5Treasure Data Service Result OutputFlexible, Scalable,Columnar StorageWebAppRDBMSCRMERPTreasure AgentTD ToolbeltKPIMetric Insights, etc.Tableau,Motion Board etc.SQL, PigRDBMS, Google Docs,AWS S3, FTP Server,etc.POSHadoop, Treasure Query AcceleratorREST APIODBC/JDBCSQL, Pig 6. 6 Hive Presto HiveQL (SQL Like) Prestgres (SQL Like) Map Reduce MPP (Massively Parallel Processor) KPI Metric Insights Tableau Server Chartio Tableau Desktop Basic Plan Premium Plan 7. 7 8. 8PDCAPlanCheckDoActKPIHadoopKPIBI / Treasure Query Accelerator 9. 9 10. 10(a). Hive 11. 11 12. 12(b). Presto 13. 13MPP 14. 14WebAppAppRDBMSCRMERPPOSCSV/TSVInside DBDirectData martCSV / TSVRaw SQLKPIBIBISQLCSV / TSVMetric Insights etcTableau,MotionBoardSAS, SPSS, R etcJDBC/ODBCREST APIJDBC/ODBCREST APITreasureAgentiOS /AndroidSDKTD ToolbeltWebBrowserStreamingMobileLegacyTrialPower BI,Excel,QlikView 15. 152. 16. WebAppAppRDBMSCRMERPPOSCSV/TSVKPI Inside DBMetric Insights etc JDBC/ODBCREST APITreasureAgentiOS /AndroidSDKTD ToolbeltWebBrowserStreamingMobileLegacyTrial 162-1. Metric Insights 17. 172-1. Metric Insights 18. 182-2. Tableau ServerWebAppAppRDBMSCRMERPPOSCSV/TSVcDirectTableauServerResult PushTreasureAgentiOS /AndroidSDKTD ToolbeltWebBrowserStreamingMobileLegacyTrial Tableau Server 19. 192-3. Redshift Tableau Server/DesktopWebAppAppRDBMSCRMERPPOSCSV/TSVTreasureAgentiOS /AndroidSDKTD ToolbeltWebBrowserStreamingMobileLegacyTrial BI Data mart Redshift 20. 202-4(a). DMP SegmentDBDBData Mart 21. 212-4(b). DMP DSP SegmentDBDBDSPKV Store 22. 223. 23. 233. WebAppAppRDBMSCRMERPPOSCSV/TSVTreasureAgentiOS /AndroidSDKTD ToolbeltWebBrowserStreamingMobileLegacyTrial DirectData martBI BITableau,Chartio JDBC/ODBCREST APIRedshift Tableau 24. 243-1. ChartioWebAppAppRDBMSCRMERPPOSCSV/TSVTreasureAgentiOS /AndroidSDKTD ToolbeltWebBrowserStreamingMobileLegacyTrial BI DirectChartio JDBC/ODBCREST API 25. 253-1. Chartio 26. 263-2. Tableau DesktopWebAppAppRDBMSCRMERPPOSCSV/TSVTreasureAgentiOS /AndroidSDKTD ToolbeltWebBrowserStreamingMobileLegacyTrial BI DirectTableau JDBC/ODBCREST API 27. 273-2. Tableau Desktop 28. 283-3. DMP Segment Table