yahoo! japan の ambari 活用事例 #yjdsnight
TRANSCRIPT
-
Copyright (C) 2016 Yahoo Japan Corporation. All Rights Reserved.
&
2
20160428
Yahoo! JAPAN Ambari
-
Copyright (C) 2016 Yahoo Japan Corporation. All Rights Reserved.
(2013)
Hadoop
()Splatoon ()
-
Copyright (C) 2016 Yahoo Japan Corporation. All Rights Reserved.
Ambari
2015/03v1.7.0
2015/05v2.0.0
2015/07v2.1.0
2015/10v2.1.1
2015/11v2.1.2
2016/02v2.2.0.0
2016/05v2.2.2.0
-
Copyright (C) 2016 Yahoo Japan Corporation. All Rights Reserved.
Yahoo! JAPAN Ambari Ambari
(Yahoo! JAPAN )
MoveNameNode
-
Copyright (C) 2016 Yahoo Japan Corporation. All Rights Reserved.
Yahoo! JAPAN Ambari
Cluster13PB
(2011/06)
Cluster220PB
(2013/01)
Cluster458PB
(2015/12)
Cluster330PB
(2014/4)
Cluster590PB
(2016/06)
-
Copyright (C) 2016 Yahoo Japan Corporation. All Rights Reserved.
Yahoo! JAPAN Ambari
Cluster13PB
(2011/06)
Cluster220PB
(2013/01)
Cluster458PB
(2015/12)
Cluster330PB
(2014/4)
Cluster590PB
(2016/06)
2Ambari
-
Copyright (C) 2016 Yahoo Japan Corporation. All Rights Reserved.
Yahoo! JAPAN Ambari
Cluster13PB
(2011/06)
Cluster220PB
(2013/01)
Cluster458PB
(2015/12)
Cluster330PB
(2014/4)
Cluster590PB
(2016/06)
800 800
-
Copyright (C) 2016 Yahoo Japan Corporation. All Rights Reserved.
Ambari
https://ambari.apache.org/
Hadoop100%
-
Copyright (C) 2016 Yahoo Japan Corporation. All Rights Reserved.
Ambari
View
-
Copyright (C) 2016 Yahoo Japan Corporation. All Rights Reserved.
Ambari
View
-
Copyright (C) 2016 Yahoo Japan Corporation. All Rights Reserved.
Ambari
View
-
Copyright (C) 2016 Yahoo Japan Corporation. All Rights Reserved.
Ambari
View
AmbariHA
-
Copyright (C) 2016 Yahoo Japan Corporation. All Rights Reserved.
Ambari
View
-
Copyright (C) 2016 Yahoo Japan Corporation. All Rights Reserved.
-
Copyright (C) 2016 Yahoo Japan Corporation. All Rights Reserved.
Agent
-
Copyright (C) 2016 Yahoo Japan Corporation. All Rights Reserved.
Agent
/
-
Copyright (C) 2016 Yahoo Japan Corporation. All Rights Reserved.
Agent
Agent
-
Copyright (C) 2016 Yahoo Japan Corporation. All Rights Reserved.
Ambari Server
Ambari Agent
-
Copyright (C) 2016 Yahoo Japan Corporation. All Rights Reserved.
Ambari Server
Ambari Agent
-
Copyright (C) 2016 Yahoo Japan Corporation. All Rights Reserved.
Ambari Server
Ambari Agent
-
Copyright (C) 2016 Yahoo Japan Corporation. All Rights Reserved.
Master Node / Application
Data Node
Ambari Server
Ambari Agent
-
Copyright (C) 2016 Yahoo Japan Corporation. All Rights Reserved.
Master Node / Application
Data Node
Agent
Ambari Server
Ambari Agent
-
Copyright (C) 2016 Yahoo Japan Corporation. All Rights Reserved.
Master Node / Application
Data Node
Agent
Ambari Server
Ambari Agent
800 Node
-
Copyright (C) 2016 Yahoo Japan Corporation. All Rights Reserved.
Master Node / Application
Data Node
Agent
Ambari Server
Ambari Agent
800 Node
800 Ambari Agent
-
Copyright (C) 2016 Yahoo Japan Corporation. All Rights Reserved.
Master Node / Application
Data Node
Agent
Ambari Server
Ambari Agent
800 Node
-
Copyright (C) 2016 Yahoo Japan Corporation. All Rights Reserved.
Start/StopNode Decommission/Recommission
-
Copyright (C) 2016 Yahoo Japan Corporation. All Rights Reserved.
Start/StopNode Decommission/Recommission
WebUINode
-
Copyright (C) 2016 Yahoo Japan Corporation. All Rights Reserved.
Start/StopNode Decommission/Recommission Node
-
Copyright (C) 2016 Yahoo Japan Corporation. All Rights Reserved.
-
Copyright (C) 2016 Yahoo Japan Corporation. All Rights Reserved.
-
Copyright (C) 2016 Yahoo Japan Corporation. All Rights Reserved.
-
Copyright (C) 2016 Yahoo Japan Corporation. All Rights Reserved.
-
Copyright (C) 2016 Yahoo Japan Corporation. All Rights Reserved.
1000
-
Copyright (C) 2016 Yahoo Japan Corporation. All Rights Reserved.
1000hdfs
chmod r
-
Copyright (C) 2016 Yahoo Japan Corporation. All Rights Reserved.
1000
-
Copyright (C) 2016 Yahoo Japan Corporation. All Rights Reserved.
Service
-
Copyright (C) 2016 Yahoo Japan Corporation. All Rights Reserved.
Service
Config
-
Copyright (C) 2016 Yahoo Japan Corporation. All Rights Reserved.
ServiceAmbariConfig
-
Copyright (C) 2016 Yahoo Japan Corporation. All Rights Reserved.
MoveNameNode
-
Copyright (C) 2016 Yahoo Japan Corporation. All Rights Reserved.
MoveNameNode
NameNode
AmbariMoveNameNode
23-4
-
Copyright (C) 2016 Yahoo Japan Corporation. All Rights Reserved.
MoveNameNode
-
Copyright (C) 2016 Yahoo Japan Corporation. All Rights Reserved.
MoveNameNode
sudo su hdfs l c hdfs namenode -bootstrapStandby
-
Copyright (C) 2016 Yahoo Japan Corporation. All Rights Reserved.
MoveNameNode
-
Copyright (C) 2016 Yahoo Japan Corporation. All Rights Reserved.
MoveNameNode
-
Copyright (C) 2016 Yahoo Japan Corporation. All Rights Reserved.
MoveNameNode
-
Copyright (C) 2016 Yahoo Japan Corporation. All Rights Reserved.
MoveNameNode
-
Copyright (C) 2016 Yahoo Japan Corporation. All Rights Reserved.
MoveNameNode
-
Copyright (C) 2016 Yahoo Japan Corporation. All Rights Reserved.
MoveNameNode
-
Copyright (C) 2016 Yahoo Japan Corporation. All Rights Reserved.
MoveNameNode
-
Copyright (C) 2016 Yahoo Japan Corporation. All Rights Reserved.
MoveNameNode
NameNode3
-
Copyright (C) 2016 Yahoo Japan Corporation. All Rights Reserved.
MoveNameNode
NameNode3
-
Copyright (C) 2016 Yahoo Japan Corporation. All Rights Reserved.
MoveNameNode
NameNodeinstallBootstrap
-
Copyright (C) 2016 Yahoo Japan Corporation. All Rights Reserved.
MoveNameNode
-
Copyright (C) 2016 Yahoo Japan Corporation. All Rights Reserved.
MoveNameNode
-
Copyright (C) 2016 Yahoo Japan Corporation. All Rights Reserved.
MoveNameNode
NameNode4
-
Copyright (C) 2016 Yahoo Japan Corporation. All Rights Reserved.
MoveNameNode
NameNode4
1 + APINameNode
-
Copyright (C) 2016 Yahoo Japan Corporation. All Rights Reserved.
MoveNameNode
NameNode4
1 + APINameNode
Bug
-
Copyright (C) 2016 Yahoo Japan Corporation. All Rights Reserved.
WebUI
I Ambari
-
Copyright (C) 2016 Yahoo Japan Corporation. All Rights Reserved.
Appendix
Ambari#yjdsw3http://www.slideshare.net/techblogyahoo/ambariyjdsw3Yahoo! JAPAN Ambari #ambarimeetup
http://www.slideshare.net/techblogyahoo/yahoo-japan-ambari-ambarimeetup
-
Copyright (C) 2016 Yahoo Japan Corporation. All Rights Reserved.
Copyright (C) 2015 Yahoo Japan Corporation. All Rights Reserved.