elastic{on} 2016 review - 김종민 님

‹#›

2016/03/31 Jongmin Kim jongmin.kim@elastic.co

Elastic{ON} 2016 Review

2

3

elastic{ON} 2015

• 장소：San Francisco

• Pier 27

• 참가인원：약 1300 명

4

Pier 27

5

elastic{ON} 2016

• 장소：San Francisco

• Pier 48

• 참가인원：…

6

Pier 48

Pier 27

Attendees

1800+

8

9

10

Agenda 보드

11

12

13

14

15

16

17

18

19

20

21

22

23

24

Product Logo

ELK Stack

ELK Stack

Along Came Beats

ELKB

TheElasticStack

elasticsearch

elasticsearch

Columnar Store

Not Yo’ Mama’sInverted Index

Date CustomerStore Product Price

elasticsearch

SECURITY

VALUABLE RESOURCES

CODE

JVM

CLASS LOADEROne does not simply fork a process

Java Security Manager

elasticsearch

Y U SO SLOW

Profile API

elasticsearch

LocationLocationLocation

GEO

Pipeline Aggregations

Thu 31

Smooth Average Data Value Upper Control Limit

August Aug 03 Tue 05 Thu 07 Sat 09 Mon 11 Wed 13 Fri 15 Aug 17 Tue 19

10

20

30

40

50

60

70

10

20

30

40

50

60

70

Numb3rs elasticsearch

kibana

kibana

Eye-meltinglycolourific

Colour picker

kibana

Naming matters

Custom Legends

kibana

Not onlyfor the 1%

Field formatters

kibana

Back in Black

Black theme

kibana

PredatorVision

Heat map

kibana

Ice IceBaby

Pluggable Tile Servers

kibana

Which 3pm?

Global timezone

logstash

logstash

Faster, more reliable pipeline

New pipeline Architecture

In-Memory Synchronous Queue

InputThread1

Worker Thread 1

<Event>

<Event>

[<Event>, <Event>, ...]

[<Event>, <Event>, ...]

Batch Stage

Filter Stage

Output Stage

RedisInput

InputThread1

Worker Thread 1

<Event>

<Event>

[<Event>, <Event>, ...]

[<Event>, <Event>, ...]

Batch Stage

Filter Stage

Output Stage

BeatsInput

logstash

Responsivedesign

Config Reload

logstash

Kafka, HDFS,Salesforce, HTTP,Oh my!

Plugins

Analysis

Alerting

Monitoring

Archiving

Elasticsearch + ANY data store

Watcher + ANY notifications tools

Marvel + ANY monitoring tools

Hadoop + ANY cloud storage platform

Log and metrics data

Web and social data

Sensor and device data

Data stores and streams

logstash

JAVA is the assembly of (J)Ruby

Java Event

logstash

Eve

nts

0

1000000

2000000

3000000

4000000

5000000

6000000

7000000

8000000

Logstash Releases1.4.4 1.5.0 2.0.0 2.1.0 2.2.0 (Pipeline) 2.3.0 (Java Event)

Apache Parsing Complex Syslog

Now you cangrok faster

Performance

beats

Capture thePacket

Packetbeat

Capture thePacket

Packetbeat

Unleash theBeats

libbeat

Beat 1

libbeat

Beat 2 Beat 3 +

It was only supposed to be a demo

topbeat

It was only supposed to be a demo

topbeat

To tail aFile

filebeat + logstash

To tail aFile

filebeat + logstash

Welcome to 1998

winlogbeat

Now

winlogbeat

MySQL

metricbeat

Redis Apache +ConnectingNumb3rs

metricbeat

The future

Versions

Jun 9, 2015

1.6Jul 16, 2015

1.7

Feb 19, 2015

4.0Jun 10, 2015

4.1

May 14th, 2015

1.5

May 27th, 2015

1.0 Beta 1July 13th, 2015

1.0 Beta 2Sept 4 th, 2015

1.0 Beta 3

May 23, 2015

1.5Nov 5, 2014

1.4

It’s complicated

es

kibana

ls

beats

es

kibana

ls

beats

Oct 28th Nov 21st Feb 2nd

2.0

4.2

2.0

2.1

4.3

2.1

1.0

2.2

4.4

2.2

1.1

Release Bonanza

v5. 0

“I just want to tail a file.”

Ingest

Grok

Geo

INGEST

kibana

Kibana 4

Discover Visualize Dashboard

Marvel 2.0

Timelion

Tag Cloud

A Window to our Stack

Extensions

We love extensions

Packs

NO OPEN SOURCEENTERPRISE EDITION

Bundled set of features: Security, Alerting, Monitoring, and more …

x-pack

Security: Shield

AuthenticationAuthorization

EncryptionIP Filtering

Audit Logging

Security: Shield

Field and DocumentLevel Security

Alerting: Watcher

• Alerts• Notifications to email, Slack, JIRA,

Hipchat, PagerDuty, and more • Analyze Watch history

Security in Kibana

• Session Management• Login/ & Logout Capabilities

Graph Real-Time Graph Analyticshttps://www.elastic.co/products/graph

Elasticsearch + Kibana as a ServiceLatest release of the Elastic Stack and X-Pack

cloud

Cloud as a Product

* Not actual packaging

*

It’s all about choice

We want to install it

Even more choice

Many clusters / use cases, exposed within the

organization

Single use case, as a service, exposed within the organization

You want to install it

PRIVATE BETA

cloud

Elastic Cloud

Deploy

Elastic Cloud Enterprise

Download

elastic{on} 콘텐츠 사이트https://www.elastic.co/elasticon/conf/2016/sf

91

사람을 찾습니다!https://www.elastic.co/about/careers

92

2차 모임 - 9:00 pm

93