Confiden'al :Discussion purpose only

Copyright (C) 2012 Yahoo Japan Corpora'on. All Rights Reserved.

Sensu Casual Talks #1

takaswat@yahoo-corp.jp

Confiden'al :Discussion purpose only Copyright (C) 2012 Yahoo Japan Corpora'on. All Rights Reserved.

P2

OS & Linux, FreeBSD

PCM, ReRAM, MRAM, ...)

Confiden'al :Discussion purpose only Copyright (C) 2012 Yahoo Japan Corpora'on. All Rights Reserved.

P3

Sensu + Graphite 1 - -

Confiden'al :Discussion purpose only Copyright (C) 2012 Yahoo Japan Corpora'on. All Rights Reserved.

P4

2011 IaaS HV

Nagios

Confiden'al :Discussion purpose only Copyright (C) 2012 Yahoo Japan Corpora'on. All Rights Reserved.

P5

2013OpenStack HV 5000

Sensu + Graphite

Confiden'al :Discussion purpose only Copyright (C) 2012 Yahoo Japan Corpora'on. All Rights Reserved.

P6 Sensu + Graphite

Nagios API Chef cookbook

portertech/chef-monitor sensu/sensu-chef

subscriber role LWRP

Confiden'al :Discussion purpose only Copyright (C) 2012 Yahoo Japan Corpora'on. All Rights Reserved.

P7

1

Confiden'al :Discussion purpose only Copyright (C) 2012 Yahoo Japan Corpora'on. All Rights Reserved.

P8 1

All-in-one Sensu Server x 1

rabbitmq-server

sensu-api sensu-dashboard

sensu-serverredis

Hypervisor x N

sensu-client

carbon-relay server x 1

carbon-relay

carbon-cache server x 3

carbon-cache

graphite-web

conetxt-hashingreplication=1

Confiden'al :Discussion purpose only Copyright (C) 2012 Yahoo Japan Corpora'on. All Rights Reserved.

P9 1

All-in-one Sensu Server x 1

rabbitmq-server

sensu-api sensu-dashboard

sensu-serverredis

Hypervisor x N

sensu-client

Xeon L5640 2.13GHz x 1DDR3-1333 2GB x 3300GB 15k SAS HDD x 4 (RAID1+0)Intel 5520 + IOH-36D

carbon-relay server x 1

carbon-relay

carbon-cache server x 3

carbon-cache

graphite-webSensu

Xeon E5-2630L 2.00GHz x 2DDR3-1600 8GB x 8300GB 10k SAS HDD x 4 (RAID1+0)Intel C602

conetxt-hashingreplication=1

Confiden'al :Discussion purpose only Copyright (C) 2012 Yahoo Japan Corpora'on. All Rights Reserved.

P10 1

200 500

Confiden'al :Discussion purpose only Copyright (C) 2012 Yahoo Japan Corpora'on. All Rights Reserved.

P11 1

sensu LOG LEVEL = warn max open files server Checks10 per 60sec

/ RAID etc...

11 graphite

Confiden'al :Discussion purpose only Copyright (C) 2012 Yahoo Japan Corpora'on. All Rights Reserved.

P12 1

graphite relay

consistent hash 1 cache

HDD IO tmpfs 55GB cron

aggregator

Confiden'al :Discussion purpose only Copyright (C) 2012 Yahoo Japan Corpora'on. All Rights Reserved.

P13

2

Confiden'al :Discussion purpose only Copyright (C) 2012 Yahoo Japan Corpora'on. All Rights Reserved.

P14 2

All-in-one Sensu Server x 3

rabbitmq-server

sensu-api sensu-dashboard

sensu-serverredis

carbon-relay server x 2

carbon-relay

carbon-cache server x 3

carbon-cache

Hypervisor x N

sensu-client

graphite-web

conetxt-hashingreplication=1

Confiden'al :Discussion purpose only Copyright (C) 2012 Yahoo Japan Corpora'on. All Rights Reserved.

P15 2

Sensu All-in-one 3 redis 1 rabbitmq

Graphite carbon-relay

2

Confiden'al :Discussion purpose only Copyright (C) 2012 Yahoo Japan Corpora'on. All Rights Reserved.

P16 2

1000 ...

ntp sensu-server

Confiden'al :Discussion purpose only Copyright (C) 2012 Yahoo Japan Corpora'on. All Rights Reserved.

P17

3

Confiden'al :Discussion purpose only Copyright (C) 2012 Yahoo Japan Corpora'on. All Rights Reserved.

P18

dashboard server x 1

redis server x 1

sensu server x 30

3

rabbitmq server x 3

rabbitmq-server

sensu-api uchiwa

sensu-server

redis

carbon-relay server x 2

carbon-relay x N

carbon-cache server x 6

carbon-cache x N

Hypervisor x N

sensu-client graphite-webhaproxy

carbon-relay x N

gluster

conetxt-hashingreplication=1

conetxt-hashingreplication=1

replication=2

Confiden'al :Discussion purpose only Copyright (C) 2012 Yahoo Japan Corpora'on. All Rights Reserved.

P19 3

3000+ VM 1HV 10VM+ VM API

Confiden'al :Discussion purpose only Copyright (C) 2012 Yahoo Japan Corpora'on. All Rights Reserved.

P20 3

sensu sensu-server on VM

redis ... UI uchiwa

v0.2+

Confiden'al :Discussion purpose only Copyright (C) 2012 Yahoo Japan Corpora'on. All Rights Reserved.

P21 3

graphite LB haproxy relay daemon

carbon-relay = CPU bound carbon-cache = IO bound megacarbon v0.10+

LOG_WRITES=false / LOG_CACHE_HITS = false

max open files whisper ceres (v0.10+)

whisper cron

Confiden'al :Discussion purpose only Copyright (C) 2012 Yahoo Japan Corpora'on. All Rights Reserved.

P22

Confiden'al :Discussion purpose only Copyright (C) 2012 Yahoo Japan Corpora'on. All Rights Reserved.

P23

sensu + graphite 1

CM

carbon-cache