elastic{on} 2016 review - 김종민 님
TRANSCRIPT
2
3
elastic{ON} 2015
• 장소：San Francisco
• Pier 27
• 참가인원：약 1300 명
4
Pier 27
5
elastic{ON} 2016
• 장소：San Francisco
• Pier 48
• 참가인원：…
6
Pier 48
Pier 27
Attendees
1800+
8
9
10
Agenda 보드
11
12
13
14
15
16
17
18
19
20
21
22
23
24
Product Logo
ELK Stack
ELK Stack
Along Came Beats
ELKB
TheElasticStack
elasticsearch
elasticsearch
Columnar Store
Not Yo’ Mama’sInverted Index
Date CustomerStore Product Price
elasticsearch
SECURITY
VALUABLE RESOURCES
CODE
JVM
CLASS LOADEROne does not simply fork a process
Java Security Manager
elasticsearch
Y U SO SLOW
Profile API
elasticsearch
LocationLocationLocation
GEO
Pipeline Aggregations
Thu 31
Smooth Average Data Value Upper Control Limit
August Aug 03 Tue 05 Thu 07 Sat 09 Mon 11 Wed 13 Fri 15 Aug 17 Tue 19
10
20
30
40
50
60
70
10
20
30
40
50
60
70
Numb3rs elasticsearch
kibana
kibana
Eye-meltinglycolourific
Colour picker
kibana
Naming matters
Custom Legends
kibana
Not onlyfor the 1%
Field formatters
kibana
Back in Black
Black theme
kibana
PredatorVision
Heat map
kibana
Ice IceBaby
Pluggable Tile Servers
kibana
Which 3pm?
Global timezone
logstash
logstash
Faster, more reliable pipeline
New pipeline Architecture
In-Memory Synchronous Queue
InputThread1
Worker Thread 1
<Event>
<Event>
[<Event>, <Event>, ...]
[<Event>, <Event>, ...]
Batch Stage
Filter Stage
Output Stage
RedisInput
InputThread1
Worker Thread 1
<Event>
<Event>
[<Event>, <Event>, ...]
[<Event>, <Event>, ...]
Batch Stage
Filter Stage
Output Stage
BeatsInput
logstash
Responsivedesign
Config Reload
logstash
Kafka, HDFS,Salesforce, HTTP,Oh my!
Plugins
Analysis
Alerting
Monitoring
Archiving
Elasticsearch + ANY data store
Watcher + ANY notifications tools
Marvel + ANY monitoring tools
Hadoop + ANY cloud storage platform
Log and metrics data
Web and social data
Sensor and device data
Data stores and streams
logstash
JAVA is the assembly of (J)Ruby
Java Event
logstash
Eve
nts
0
1000000
2000000
3000000
4000000
5000000
6000000
7000000
8000000
Logstash Releases1.4.4 1.5.0 2.0.0 2.1.0 2.2.0 (Pipeline) 2.3.0 (Java Event)
Apache Parsing Complex Syslog
Now you cangrok faster
Performance
beats
Capture thePacket
Packetbeat
Capture thePacket
Packetbeat
Unleash theBeats
libbeat
Beat 1
libbeat
Beat 2 Beat 3 +
It was only supposed to be a demo
topbeat
It was only supposed to be a demo
topbeat
To tail aFile
filebeat + logstash
To tail aFile
filebeat + logstash
Welcome to 1998
winlogbeat
Now
winlogbeat
MySQL
metricbeat
Redis Apache +ConnectingNumb3rs
metricbeat
The future
Versions
Jun 9, 2015
1.6Jul 16, 2015
1.7
Feb 19, 2015
4.0Jun 10, 2015
4.1
May 14th, 2015
1.5
May 27th, 2015
1.0 Beta 1July 13th, 2015
1.0 Beta 2Sept 4 th, 2015
1.0 Beta 3
May 23, 2015
1.5Nov 5, 2014
1.4
It’s complicated
es
kibana
ls
beats
es
kibana
ls
beats
Oct 28th Nov 21st Feb 2nd
2.0
4.2
2.0
2.1
4.3
2.1
1.0
2.2
4.4
2.2
1.1
Release Bonanza
v5. 0
“I just want to tail a file.”
Ingest
Grok
Geo
INGEST
kibana
Kibana 4
Discover Visualize Dashboard
Marvel 2.0
Timelion
Tag Cloud
A Window to our Stack
Extensions
We love extensions
Packs
NO OPEN SOURCEENTERPRISE EDITION
Bundled set of features: Security, Alerting, Monitoring, and more …
x-pack
Security: Shield
AuthenticationAuthorization
EncryptionIP Filtering
Audit Logging
Security: Shield
Field and DocumentLevel Security
Alerting: Watcher
• Alerts• Notifications to email, Slack, JIRA,
Hipchat, PagerDuty, and more • Analyze Watch history
Security in Kibana
• Session Management• Login/ & Logout Capabilities
Graph Real-Time Graph Analyticshttps://www.elastic.co/products/graph
Elasticsearch + Kibana as a ServiceLatest release of the Elastic Stack and X-Pack
cloud
Cloud as a Product
* Not actual packaging
*
It’s all about choice
We want to install it
Even more choice
Many clusters / use cases, exposed within the
organization
Single use case, as a service, exposed within the organization
You want to install it
PRIVATE BETA
cloud
Elastic Cloud
Deploy
Elastic Cloud Enterprise
Download
elastic{on} 콘텐츠 사이트https://www.elastic.co/elasticon/conf/2016/sf
91
2차 모임 - 9:00 pm
93