echtzeit-analyse von social media daten mit jedox und gpu ... · business driven intelligence,...
TRANSCRIPT
Business Driven Intelligence, Analytics & Performance Management. www.jedox.com - @JedoxAG - @PSJedox
Echtzeit-Analyse von Social Media Daten mit Jedox
und GPU-beschleunigten OLAP Datenbanken
Peter Strohm, Offenburg, 05.03.2015
Business Driven Intelligence, Analytics & Performance Management. www.jedox.com - @JedoxAG - @PSJedox
Jedox: In-Memory OLAP Database
2002 Gegründet in Freiburg
Heute 100+ Mitarbeiter Standorte in Freiburg,
Frankfurt, Düsseldorf, Paris, Boston
120+ int. Business Partner 100.000+ Jedox Users
Version 5.1
Business Driven Intelligence Self-Service BI & Performance Management ExcelPLUS Jedox Web & Mobile GPU Accelerator
Business Driven Intelligence, Analytics & Performance Management. www.jedox.com - @JedoxAG - @PSJedox
In-Memory OLAP-Database
Alle Daten im Arbeitsspeicher 1
Multi-dimensionale Datenbank-Struktur
2
Jan
Feb
Mar
Q
1
Ap
r
May
Jun
Jul
Q2
Au
g
Sep
Q3
O
ct
No
v
Dec
Q4
Yea
r
All regions Europe France
Italy UK
North America USA
Canada Mexico
Count TweetID Longitude
Business Driven Intelligence, Analytics & Performance Management. www.jedox.com - @JedoxAG - @PSJedox
In-Memory OLAP-Database
Jan Feb Mar Apr May Jun Jul Aug Sep Dec Nov Oct
Q1 Q2 Q3 Q4
Year
Hierarchische Struktur der konsolidierten Elemente
3
Berechnung “on-the-fly” 4 Jan
Feb
Mar
Q
1
Ap
r
May
Jun
Jul
Q2
Au
g
Sep
Q3
O
ct
No
v
Dec
Q4
Yea
r
All regions Europe France
Italy UK
North America USA
Canada Mexico
Count TweetID Longitude
Business Driven Intelligence, Analytics & Performance Management. www.jedox.com - @JedoxAG - @PSJedox
In-Memory OLAP-Database
Nur Basis-Elemente speichern 5
Keine Null-Werte speichern 6
Speicher sparen, “up to date” !
Jan
Feb
Mar
Q
1
Ap
r
May
Jun
Jul
Q2
Au
g
Sep
Q3
O
ct
No
v
Dec
Q4
Yea
r
All regions Europe France
Italy UK
North America USA
Canada Mexico
Count TweetID Longitude
Multi-dimensional & In-Memory i
Business Driven Intelligence, Analytics & Performance Management. www.jedox.com - @JedoxAG - @PSJedox
Twitter: Big Data in Real-time
Business Driven Intelligence, Analytics & Performance Management. www.jedox.com - @JedoxAG - @PSJedox
Persistente Twitter Daten in OLAP
add
Update „trending“ mit
Web+ETL
update
Einfügen der Tweets
in ETL
Jedox Social Analytics Workflow
filtering
Streaming via php in . Web
Public Twitter Stream
streaming
analyzing
www
Mobile
SA App
Web
ExcelPLUS
Business Driven Intelligence, Analytics & Performance Management. www.jedox.com - @JedoxAG - @PSJedox
Jedox Social Analytics Showcase
Business Driven Intelligence, Analytics & Performance Management. www.jedox.com - @JedoxAG - @PSJedox
Jedox Social Analytics Showcase
Business Driven Intelligence, Analytics & Performance Management. www.jedox.com - @JedoxAG - @PSJedox
Jedox Social Analytics Demo
Business Driven Intelligence, Analytics & Performance Management. www.jedox.com - @JedoxAG - @PSJedox
Social Media Analytics: HeatMap
Business Driven Intelligence, Analytics & Performance Management. www.jedox.com - @JedoxAG - @PSJedox
Social Media Analytics: Trending
Top 100 Trending Faktor: 1
# Alle vorherigen Tage
# Aktueller Tag ___________________
~28.000 Wörter 2
Business Driven Intelligence, Analytics & Performance Management. www.jedox.com - @JedoxAG - @PSJedox
Jedox Social Analytics with GPU
System: 2 x K40 mit 2 GB GPURAM
Xeon CPU mit 128 GB RAM 1
Datensätze mit > 400 Millionen Einträgen 2
Berechnung findet auf allen Daten statt 3
Speed-up bis zu 50x (und mehr)! 4
Business Driven Intelligence, Analytics & Performance Management. www.jedox.com - @JedoxAG - @PSJedox
Jedox BI Open Source
Open Source Download: http://sf.net/projects/palo 1
Jedox Base Version unter: www.jedox.com 2
Social Analytics App unter: www.jedox.com/de/jedox-social-analytics
oder im Windows 8.1/Phone Store
3
Business Driven Intelligence, Analytics & Performance Management. www.jedox.com - @JedoxAG - @PSJedox
Ausblick
Features:
- HeatMap ausbauen
- Trending-/Cooling-Faktoren
- Tonalität von Tweets
1
Input Stream:
- GPU beschleunigt
- Asynchron
2
Business Driven Intelligence, Analytics & Performance Management. www.jedox.com - @JedoxAG - @PSJedox
VIELEN
DANK