openstack swiftの最新機能とstorlets
TRANSCRIPT
Copyright©2017 NTT Corp. All Rights Reserved.
Lightning Talk:OpenStack Swiftの最新機能とStorlets
Kota Tsuyuzaki [IRC: kota_][email protected] Software Innovation CenterOpenStack Storlets Project Team LeadOpenStack Swift Core Team
Copyright(c)2009-2017 NTT CORPORATION. All Rights Reserved.
2Copyright©2017 NTT Corp. All Rights Reserved.
NTT Confidential
OpenStack Swift and OpenStack Storlets
OpenStack Swift: Distributed Object Storage
OpenStack Storlets: Computable Object Storage
Swift Cluster
Storlets Environment UserApplication
Stolrets is computable environment on Swift Object Storage
APP APP APP
3Copyright©2017 NTT Corp. All Rights Reserved.
NTT Confidential
本日のLightning Talk
4Copyright©2017 NTT Corp. All Rights Reserved.
NTT Confidential
本日のLightning Talk
受かった
落ちた
⇒ こちらを中心にLT
5Copyright©2017 NTT Corp. All Rights Reserved.
NTT Confidential
Global Erasure Coding
6Copyright©2017 NTT Corp. All Rights Reserved.
NTT Confidential
Erasure Coding
REPLICATION
ＤＡＴＡ ＤＡＴＡ ＤＡＴＡ
ERASURE CODING (10:4)
3x
1.4x
ＤＡＴＡPart 2
ＤＡＴＡPart 3
ＤＡＴＡPart 4
ＤＡＴＡPart 5
ＰＡＲＩＴＹPart 1
ＰＡＲＩＴＹPart 2
ＤＡＴＡPart 7
ＤＡＴＡPart 8
ＤＡＴＡPart 9
ＤＡＴＡPart 10
ＰＡＲＩＴＹPart 3
ＰＡＲＩＴＹPart 4
ＤＡＴＡPart 1
ＤＡＴＡPart 6
7Copyright©2017 NTT Corp. All Rights Reserved.
NTT Confidential
Problem with Data Centers
Network
ＤＡＴＡPart 5
ＰＡＲＩＴＹPart 1
ＰＡＲＩＴＹPart 2
ＤＡＴＡPart 9
ＤＡＴＡPart 10
ＰＡＲＩＴＹPart 3
ＰＡＲＩＴＹPart 4
ＤＡＴＡPart 2
ＤＡＴＡPart 3
ＤＡＴＡPart 4
ＤＡＴＡPart 7
ＤＡＴＡPart 8
ＤＡＴＡPart 1
ＤＡＴＡPart 6
8Copyright©2017 NTT Corp. All Rights Reserved.
NTT Confidential
1.EC Fragment Duplication
2.Composite Ring
Global Erasure Coding
9Copyright©2017 NTT Corp. All Rights Reserved.
NTT Confidential
Global Erasure Coding
ＤＡＴＡPart 2
ＤＡＴＡPart 3
ＤＡＴＡPart 4
ＤＡＴＡPart 5
ＰＡＲＩＴＹPart 1
ＰＡＲＩＴＹPart 2
ＤＡＴＡPart 7
ＤＡＴＡPart 8
ＤＡＴＡPart 9
ＤＡＴＡPart 10
ＰＡＲＩＴＹPart 3
ＰＡＲＩＴＹPart 4
ＤＡＴＡPart 1
ＤＡＴＡPart 6
ＤＡＴＡPart 2
ＤＡＴＡPart 3
ＤＡＴＡPart 4
ＤＡＴＡPart 5
ＰＡＲＩＴＹPart 1
ＰＡＲＩＴＹPart 2
ＤＡＴＡPart 7
ＤＡＴＡPart 8
ＤＡＴＡPart 9
ＤＡＴＡPart 10
ＰＡＲＩＴＹPart 3
ＰＡＲＩＴＹPart 4
ＤＡＴＡPart 1
ＤＡＴＡPart 6
2.8x
10Copyright©2017 NTT Corp. All Rights Reserved.
NTT Confidential
• Multi-Worker Reconstructor
• Increase Part Power
Other Great Staffs on Swift Pike
Reconstructor
worker worker worker
11Copyright©2017 NTT Corp. All Rights Reserved.
NTT Confidential
Storlets: Computing on Swift
https://www.openstack.org/videos/sydney-2017/using-storletsdocker-for-large-scale-image-processing
12Copyright©2017 NTT Corp. All Rights Reserved.
NTT Confidential
Thank youRepository:https://github.com/openstack/swifthttps://github.com/openstack/storlets
IRC:#openstack-swift @ freenode#openstack-storlets @ freenode
Wiki:https://github.com/openstack/swifthttps://github.com/openstack/storlets
Presenter:[email protected]: kota_
13Copyright©2017 NTT Corp. All Rights Reserved.
NTT Confidential
• Global EC Cluster
• https://specs.openstack.org/openstack/swift-specs/specs/in_progress/global_ec_cluster.html
• https://www.slideshare.net/tsuyuzaki/global-ec-cluster-updates-openstack-mitaka-swift-design-summit
• Storlets
• https://www.slideshare.net/tsuyuzaki/using-storletsdocker-for-large-scale-image-processing
参考資料など：