PlanetLabオーバーレイネットワークプラットフォーム

情報通信研究機構

新世代ネットワーク研究センター

中内清秀，中尾彰宏

NWGN推進フォーラム テストベッドNW推進WG #42009年6月29日

光パス

管理仮想ルータドメインA

管理仮想ルータドメインB

管理仮想ルータドメインC

管理仮想ルータドメインD

仮想化ストレージ

オーバレイネットワークＡ

P2P/オーバレイ技術

オーバレイネットワークB

仮想ネットワーク実験環境Ａ

管理仮想化ルータ・ネットワーク

WDM/光SW WDM/光SW WDM/光SW WDM/光SW

DCNドメイン/DCN-Interドメインコントローラ

DCN:Dynamic Circuit Network

NW制御技術

計測実行/データ収集

サービス/トポロジー検索

perfSONAR

計測技術

コンソール(NW可視化、コントロール)

仮想ネットワーク実験環境B仮想ネットワーク技術

光スイッチネットワーク

JGN2plusサービスプラットフォーム

K. Nakauchi, NICT 22009/6/29

3

PlanetLab: 分散アプリケーションプラットフォーム(Public PlanetLab)

The largest and most popular overlay network test-bed Operated by Princeton Univ. and PlanetLab Consortium Currently consists of 900+ nodes at 450+ sites 800+ Projects/ 1000+ Researchers

180+ high-level academic publications enabled

2009/6/29 K. Nakauchi, NICT

PlanetLab Model: VM and Slice VM: Each node can serve multiple VMs (Virtual Machines)

Linux Vserver Slice: A set of VMs is allocated to a user (experimenter)

A user can build his own experimental environment on socket API

2009/6/29 K. Nakauchi, NICT 4

PlanetLab nodes w/ wired connection

PlanetLab nodes w/ wireless connection

Slice

VM

eth0

eth0

ath0

Log in via ssh

Slice

VM VMManagement Server

Request

2009/6/29 5K. Nakauchi, NICT

PlanetLab ApplicationsCoMon: monitoring slice-level statistics

2008/05/16 K.NAKAUCHI, NICT 5

http://summer.cs.princeton.edu/status/index_slice.html

Over 400 nodes

PlanetLab-related Activities in NICT

2009/6/29 K. Nakauchi, NICT 6

Sendai

Tsukuba

Tokyo

NaganoKanazawa

Nagoya

Osaka Keihanna

Kochi

Okayama

Kitakyushu

Fukuoka

Sapporo

USAChicago

Kyutech

Hiroshima U.

Kochi-techOsaka U. NICT Koganei

NICT Otemachi

U. Tokyo

Tohoku U.

Sapporo Medical U.

NII

• Operate public PlanetLab• Federate with PLC/PLE

• Nation-wide private PlanetLab• JGN2plus’s official service• Boost PlanetLab community

(1) PlanetLab Japan (Public PL) (2) J-Lab (Private PL)

(3) CoreLab(Research ) • Network virtualization research

• Prototype of virtual routers• Will be open for R&D community

J-Lab: Private PlanetLab for JGN2plus Trial Service

2009/6/29 K. Nakauchi, NICT 7

…

- Official trial service on JGN2plus- 1Gbps throughput for each peering- IP: 202.180.37.64/27 (Global)- 12 sites, 24 nodes

…

- Closed for NICT internal researches- Spans several Ases- IP: Depends on the site- 12 sites, 12 nodes

J-Lab Research J-Lab Trial

…

Operated by JGN2plus and NVLabOperated by NVLab

PLC

Goal: Boost PlanetLab community in Japan Open for roughly 100 user projects on JGN2plus Sandbox for new functions and applications Currently vanilla PlanetLab (MyPLC4.2 on Fedora8)

J-Lab Trial: Overview

8

Kyutech

Sendai

Tsukuba

Tokyo

NaganoKanazawa

Nagoya

Osaka Keihanna

Kochi

Okayama

KitakyushuFukuoka

Sapporo

Hiroshima U.

Kurashiki U. of Science and Arts

Osaka U.

NICT Koganei

NICT Otemachi

NICT Hakusan

Tohoku U.

Sapporo Medical U.

U. Tokyo

JAIST

Nagoya U.

https://www-jlab.planet-lab.jp/

2009/6/29 K. Nakauchi, NICT

Sendai

TsukubaTok

yo

Nagano

Kanazawa

Nagoya

Osaka

Keihanna

Kochi

Okayam

aKitakyushuFuk

uoka

Sapporo

Overlay HDV Distribution on J-Lab

2009/6/29 K. Nakauchi, NICT 9

IEEE1394

Sender(Win)

IEEE1394

Decoder

HD/SD Monitor

Receiver (Win)

Splitter(running on J-Lab node)

IP

J-Lab Trial (Private PlanetLab)

HDV/DV video distribution (～30Mbps) over JGN2plus Overlay multicast: split a video stream with reasonable CPU load Windows media, FEC, UDP/TCP, and CLI/GUI are also supported Centralized topology management with web interface

Topology managementServer

JGN2plusトライアルサービスのメリット

メリット：

Princeton大学との利用契約締結が不要（ Public PlanetLabの場合，民間企業は有料）

JGN2plusのコア網に直収されるため，広帯域アプリケーションで利用可能

デメリット：

単一L2セグメント内への展開なので，「広域」「超分散」「多様性(heterogeneity)」などを目的とした実験には適さない

→ 本サービスの試用後にPublic PlanetLabに移行を促進

2009/6/29 K. Nakauchi, NICT 10

CoreLab: Highly Flexible Overlay Platform Achieves flexibility and code-reusability

Arbitrary kernel/network stacks/resources Catch up with the latest technology and minimize engineering effort

Sliver VEE: Hosted Virtual Machine Monitor (KVM) VM Disk Image Transfer: Embedded BitTorrent client Network Configuration: IP & Ports are managed

2009/6/29 K. Nakauchi, NICT 11

PlanetLab CoreLabSliver Resource Container Hosted VMMKernel Shared SeparatedGuest OS Various Linux Distros Any OSesIP & Port Shared Shared (managed)Privileged System Calls Shared Isolated

Aki Nakao, et al, “CoreLab: An Emerging Network Test-bed Employing Hosted Virtual Machine Monitor”, ROADS’08

CoreLab : In Action…

2009/6/29 12K. Nakauchi, NICT

CoreLab Network Configuration

2009/6/29 K. Nakauchi, NICT 13

PlanetLab Model CoreLab Model

CoreLab/J-Lab Deployment

J-Lab 12sites, 36 nodes H/W: HP DL320G4 トライアルサービス中

CoreLab 12 sites, 12 nodes Multi-homing

JGN2plus, SINET

H/W Spec

2009/6/29 K. Nakauchi, NICT 14

HP DL 580 (4U)Intel Xeon 16-core (quad 4-core)128GB (Max 256GB) memory300GB RAID5(accommodate up to 254 slices)

Federation Overview Split PlanetLab

Several regional PlanetLabswith original policy

Interconnection Share node resources among

PlanetLabs

2009/6/29 K. Nakauchi, NICT 15

PLC

PLC

PLC

PlanetLab(Princeton U)

PlanetLab-EU

PlanetLab-JP

VMM

NodeMgr VM1 VM2 VMn

VMM

NodeMgr VM1 VM2 VMn

Trade

Internet

Multi-party Federation

16

MyPLC1 MyPLC2

Admin (MyPLC1)

MyPLC2MyPLC3

(1) AddPeer(MyPLC2, cacert, gpg)-> create a local cache of the master DB

(2) RefreshPeer(MyPLC2)-> sync the local cache and the master DB

MyPLC1MyPLC3

XML-RPC/HTTPS

2009/6/29 K. Nakauchi, NICT

Create Sync

MyPLC3

DB ServerMyPLC1MyPLC2

Sync