iram.cs.berkeley.eduiram.cs.berkeley.edu/retreat_w00/data-location-pres.pdf · m r c d f b i g q @?...
TRANSCRIPT
���������������� ���� ���
���� �� ���
���������
� ��������� �!"""
#$%$&'($%)'*)*%+,- (,$*. %'/,
0 $*1$/2435647888
9�9�:
;<=>? @ABC D>EDFG> D
;HI>J?B? KC=?B FC @EDCLM> G
;EDCN CO>P QMR C DFB IG
;Q@? MS O FOC TB I>EDCN CO>P QMR C DFB IG
;A FGU M?B FC @V>OU MBO
;WUBU D>XC DY
;ZC @= MUO FC @
3
#$%$&'($%)'*)*%+,- (,$*. %'/,
0 $*1$/2435647888
���� ���[��\�
;J?B?OBC D?R >=? @L>N DC]FP>P MFY>>M>=B DF= FBS_^
;QMB ICUR IC @>ON >= F`=N DC]FP> DFO `O=? MMS D>ON C @O FL M> TC DCU D
P?B?a FB G?S L>OBC D>P? @S�b I> D> ^
;EDFG? DS =COB F@B I>OS OB> GFO @>BbC DY=C GGU @F=?B FC @^
7
#$%$&'($%)'*)*%+,- (,$*. %'/,
0 $*1$/2435647888
���� ���[��\�c ���ed�fg
2
10.1.2 The O
ceanic Data U
tility
Exp
loitin
g a d
irect a
nalo
gy w
ith the e
lectric d
istributio
n infra
structure, this p
rop
osa
l is ab
out e
leva
ting ph ersistent
data storage to the level of a utility service. We envision a utility m
odel in which consum
ers pay a monthly fee in
exchange for a
ccess to
their p
ersistent sto
rage
. Such a utility w
ould
be
highly-a
vailab
le fro
m an
ywhere
in thenetw
ork, em
ploy a
utomatic re
plica
tion for disaste
r reco
very, use
stron
g security by de
fault, and
pro
vide p
erfo
rmance
that is sim
ilar to
that o
f loca
l storage
und
er m
any circu
mstance
s. Further, the se
lf-rep
airing n
ature
of such system
sw
ould m
ake them e
asy to service
and
maintain from
the stand
po
int of the
utility pro
viders.
Actua
l service
s are
pro
vide
d b
y a co
nfe
de
ratio
n of com
panies, as illustra
ted
in Fig
ure 1
. Ea
ch user p
ays a fee to
one
pa
rticular “utility p
rovid
er” a
lthough they consu
me
stora
ge a
nd b
andw
idth re
source
s from m
any d
ifferentprovid
ers. The utility provid
ers buy and sell capacity amongst them
selves to make up the difference. Insufficient
cap
acity o
r ba
ndwid
th in one
pa
rticular re
gion o
f the w
orld co
uld e
ncourage
entre
pre
neurs to b
ring resource
s online.F
urther, sma
ll cafés
4 or a
irpo
rts could
bring servers o
n their p
remises to give cu
stome
rs be
tter pe
rform
ance; in re
turnthey w
ould get a small divid
end for their participation in global utility.
Ideally, a user would entrust all of his or her data to the utility infrastructure; in return, the utility’s econom
iesof scale w
ould yield much better availability, perform
ance, and reliability than would be available otherw
ise.P
roperly
con
structed, the
syste
m
en
visione
d here
could
m
ake the
stand
ard
p
rotoco
ls for
EM
ail,
the
We
b,
filesystems, d
atab
ases, a
nd softw
are d
istributio
n completely o
bso
lete
. Further, one
of the
insidio
us pro
blem
s with
archiva
l stora
ge, nam
ely the ra
pid
de
cay of sto
rage
med
ia a
nd the
eq
ually rap
id o
bso
lesce
nce o
f ph
ysical sto
rage
form
ats5, is directly addressed via inform
ation utilities: utility providers sim
ply upgrade or replace their servers asd
esire
d; the
rep
licatio
n pro
toco
ls reco
gnize this a
s a failure
and
automatica
lly resto
re the
level o
f rep
licatio
n.O
ne o
f our key p
remise
s is that use
rs are
“mostly co
nne
cted
, most of the tim
e”. A
s a re
sult, once
users haveentrusted their inform
ation to the utility, they can access this information from
all of their wireless and w
ireddevices. F
or instance, on-board devices in cars and boats can access personal databases to track fuel utilization and
engine m
aintenance
schedules, a
ccess map
s and p
rep
lanned
course
s, manipula
te p
hone a
nd em
ail da
tab
ase
s, etc.
Further, the distributed nature of the inform
ation utility means that data sharing is fundam
ental to the model (sharing
be
twe
en use
rs is identica
l to sh
arin
g be
twe
en d
ifferent de
vices of a
single
use
r).G
iven its widely-distrib
uted nature, a data utility provides the opportunity to
continuo
usly a
da
pt to
changin
gaspects of data locality and utilization. The key property required for such adaptation is that data be nom
adic, i.e.,
4 C
afé Strada, referenced in Figure 1, is a small outdoor café near the Berkeley cam
pus.5 C
onsider, for instance, vaults full of information that N
AS
A has collected from
the Voyager spacecraft.
Pac
Bell S
IBM
AT
&T
Canadian
Oce
anStore
Café
Strad
aIB
M
Figure 1: T
he Oceanic D
ata Utility
i
#$%$&'($%)'*)*%+,- (,$*. %'/,
0 $*1$/2435647888
���� ���[��\�c ���ed�fg
jOOU>O k;QMMP?B? GUOBL>> @= DS N B>P ^lCb=? @b> I? @P M>=C @mF=B
D>OC MUB FC @C @> @= DS N B>PP?B? n
;J?B?O ICU MPpomCbpqBCb I> D>FB FOUO>P GCOBC TB> @^
r j@B I>=C GGC @=?O>a b>O ICU MPL>?L M>BC `@PP?B?b FB ICUB
D> T> D> @= F@R ?=> @B D? M?UB IC DFBS_^s
#$%$&'($%)'*)*%+,- (,$*. %'/,
0 $*1$/2435647888
t�������������[��uv\
QOOU GN B FC @O k
;QMMPC=U G> @BO I?]>OC G>U @Fw U>xyz{|}~�}��a b IF= IFO
F@P>N > @P> @BC TB I>FDN IS O F=? MMC=?B FC @F@B I> @>BbC DY^
;HI>FD> �FOBOOC G>P>B> DGF@FOB F=a LUB>�N > @O F]>a ? MR C DFB IGTC D
`@P F@R ? @S PC=U G> @BR F]> @B IFO] FDBU? M@? G> ^
;��N > @O>Ob FB IF@B I><=>? @ABC D>? D> G>?OU D>PN DFG? DFMS F@
B> DGOC T=C GGU @F=?B FC @=COBO ^�
#$%$&'($%)'*)*%+,- (,$*. %'/,
0 $*1$/2435647888
t�������������[��uv\
c ���ed�fg
HI>FP>? k
;�O>OC G>F@> �N > @O F]>N DCL?L FMFOB F=? MR C DFB IGBCB DS ? @P `@P
B I>PC=U G> @B ^jTFB T? FMOa T? MML?= YC @B I>>�N > @O F]>LUB
P>B> DGF@FOB F=? MR C DFB IG^
;A FGFM? DBCB I>FP>?C TUO F@R ?=?= I>BC GFB FR ?B>B I>=COBC T
R C F@R BC G? F@G> GC DS ^
�
#$%$&'($%)'*)*%+,- (,$*. %'/,
0 $*1$/2435647888
[��� ����v� �����\�
�� ���[���c � ����
g
;QOOC= F?B>b FB I>?= IO> D]> D? �MCC G`MB> Da b IF= ID>N D>O> @BOB I>
O>BC TPC=U G> @BOC @B I?BO> D]> D^
;��? GN M> k
0000000000
000000000000000
11010
(0, 3, 4)
X
(0, 1, 3)
Y
0000000000
10011
s0
s1
s2
�
#$%$&'($%)'*)*%+,- (,$*. %'/,
0 $*1$/2435647888
[��� ����v� �����\�
�� ���[���c � ����
g
;X I> @>]> DB I> �MCC G`MB> D?B?O> D]> D= I? @R >Oa B I?BO> D]> D
O> @PO? @|���}{�����}� �=C @B? F@F@R B I> @>b]? MU>BC? MM
@> FR ILC DF@R O> D]> DO ^
;j@CU D>�? GN M>a B I> �MCC G`MB> DO TC D�8 ? @P�7 I?]>LCB I
= I? @R >Pa OCB I>S O> @PB I> GBCB I>FD=C MM>=B F]> @> FR ILC Da �3a
b IF= I=C GLF@>OB I> Gb FB IB I>LF@? DS��� TU @=B FC @F@FBO
O>=C @P M>]>M^
0000000000
11010
(0, 3, 4)
X
(0, 1, 3)
Y
0000000000
10011
s0
s1
s2
1101100000
00000
�
#$%$&'($%)'*)*%+,- (,$*. %'/,
0 $*1$/2435647888
[��� ����v� �����\�
�� ���[���c � ����
g
;HI>UN P?B> G>OO?R >O=C @B F@U>U @B FMB I> �MCC G`MB> DO?B? MM
O> D]> DOOB?L FMF�> ^
;j@CU D>�? GN M>a B I> �MCC G`MB> DTC D�3 b?O= I? @R >P M?OB=S = M>a
OC FBO> @POUN P?B> G>OO?R >OBCFBO @> FR ILC DOB IFO=S = M> ^
0000011011
11010
(0, 3, 4)
X
(0, 1, 3)
Y
0000011011
10011
s0
s1
s2
1101100000
00000�
#$%$&'($%)'*)*%+,- (,$*. %'/,
0 $*1$/2435647888
[��� ����v� �����\�
�� ���[���c � ���
g
;WF@? MMS a ? MB ICUR I�8 ? @P�7 I?]>LCB I= I? @R >P?R ? F@a B I>S I?]>
@CBPC @>OC F@?b?S B I?Bb FMM> ¡>=B�3a OCB I>UN P?B>N I?O> FO
=C GN M>B> ^
0000011011
11010
(0, 3, 4)
X
(0, 1, 3)
Y
0000011011
10011
s0
s1
s2
1101100000
0000038
#$%$&'($%)'*)*%+,- (,$*. %'/,
0 $*1$/2435647888
[��� ����v� �����\�
¢�£ [���c � �� �
g
;Qw U> DS FO?P FD>=B>PP>N B I¥¤`DOBO>? D= IaR U FP>PLS B I> �MCC G
`MB> DO ^;j@B IFO> �? GN M>a �8 FOB DS F@R BCMC=?B>B I>PC=U G> @B ¦^A F@=>
B I>LFBO?OOC= F?B>Pb FB I¦? D>F@�§©¨O �MCC G`MB> D?B M>]>Mªa FB
FON COO FL M>B I?B ¦FOBbCOB>N O?b?S_^
;�8 O> @PO?w U> DS G>OO?R >BCFBO @> FR ILC Da �3a BCO>>FT? @S C TFBO
@> FR ILC DO I?]> ¦^
0000011010
(0, 3, 4)
X
(0, 1, 3)
Y
0000011011
10011
s0
s1
s2
1101100000
00000
11011Y
?
33
#$%$&'($%)'*)*%+,- (,$*. %'/,
0 $*1$/2435647888
[��� ����v� �����\�
¢�£ [���c � �� �
g
;�3 O>>O TDC GFBO �MCC G`MB> DB I?B FBP> `@FB> MS PC>O�«{ I?]> ¦a
LUBB I?BC @>C TFBO @> FR ILC DOC @>OB>N ?b?S GFR IB ^
;�3 O> @PO?w U> DS G>OO?R >BC�7a BCO>>FTFB I?O ¦^00000
11010
(0, 3, 4)
X
(0, 1, 3)
Y
0000011011
10011
s0
s1
s2
1101100000
00000
11011Y
?
37
#$%$&'($%)'*)*%+,- (,$*. %'/,
0 $*1$/2435647888
[��� ����v� �����\�
¢�£ [���c � �� �
g
;A F@=>�7 PC>O F@P>>P I?]> ¦a FB=? @O> @P?N CO FB F]> D>ON C @O>
L?= YBC�8 B IDCUR I�3 ^Y
at s2
Y at s
2
0000011010
(0, 3, 4)
X
(0, 1, 3)
Y
0000011011
10011
s0
s1
s
1101100000
00000
11011
2
35
#$%$&'($%)'*)*%+,- (,$*. %'/,
0 $*1$/2435647888
[��� ����v� �����\�
¢�£ [���¬ \���
;�?= Iw U> DS G>OO?R >=C @B? F@O
®B I> @? G>C TB I>PC=U G> @B FB FO MCC YF@R TC D
®FBON C F@BC TC DFR F@
®B I>=U DD> @B D>BU D@N ?B IBCB I?BN C F@B
®? MFOBC T? MMB I> @CP>O FB I?O] FO FB>POC T? D
;¯C @CP> FO>]> D]FO FB>PBb F=>a ? @PB I> D>BU D@N ?B I@>]> DR DCbO
M? DR > DB I? @B I> �MCC G`MB> DP>N B I^
3s
#$%$&'($%)'*)*%+,- (,$*. %'/,
0 $*1$/2435647888
�� ����v� �����\° ��9�� ��
;�N P?B>? MR C DFB IG± b FB ICUBPC=U G> @B GCB FC @² O>BB M>O F@
³±�´y�{µ¶��� {µ¶��� ��² >]> @TC D=S = MF=R D?N IO ^
;EDCC TTDC G=C GN FM> DP?B?�·mCb? @? MS O FO k
®QBB> @U?B>P �MCC G`MB> DO± L FB]>=BC DO² TC DG? `@FB> M?BB F=>¸
®�N P?B> TU @=B FC @FO GC @CBC @F= k? Mb?S O
GC]>OUN M?BB F=>BCb? DP¹ ººº»¸
®HI> D> TC D>a C @MS ? `@FB> @U GL> DC T
UN P?B>O=? @C==U DL> TC D>? MM�MCC G
> @B DF>O? D>¼º ¨^
<111>
<101>
<011>
<110>
<010>
<001>
<000>
<100>½¾¿ ÀÁ ÃÄ¿Å Æ
ÇÉÈ¿ À¿ Ê¿ ËÂÌ ÃÂÍ¿ÄÂÅ ÎÏ Ð
3�
#$%$&'($%)'*)*%+,- (,$*. %'/,
0 $*1$/2435647888
�� ����v� �����\° ��������
;�N P?B> TU @=B FC @FO? IC GC GC DN IFO GC @B I>M?BB F=>C T�MCC G
`MB> DO ^ACUN P?B>O=? @L> D>C DP> D>PC DP> M?S >P ^
;HI>UN P?B>? MR C DFB IGO FGU M?B>OB I> TC Db? DPP?B? ¤mCb? @? MS O FO
N DCLM> G? @PB IUO=C GN UB>OB I>Ñ «y�ÓÒ«x�z Ò}~~ Ò��}{µ�OC MUB FC @^
;EDCC TLS > �B> @O FC @C TÔFMP? MM ¨O ºÕÖ×P?B? ¤mCbbC DY^
;ACB I> �MCC G`MB> DO=C @B? F@B I>=C DD>=B]? MU>Ob I> @B I>
? MR C DFB IGO>BB M>O ^
; ¼ZC DD>=B ¨G>? @O @C>�B D? º ¨O? @P @CF@=C DD>=BØ ¨O ^
3�
#$%$&'($%)'*)*%+,- (,$*. %'/,
0 $*1$/2435647888
�� ����v� �����\:��������
;j@B I>N D>O> @=>C TPC=U G> @B GCB FC @a =C @]> DR > @=>FO @CMC @R > D
R U? D? @B>>P? @P �MCC G`MB> DO G?S =C @B? F@CUB ¤C T ¤P?B>
F@TC DG?B FC @^
;HIFO F@= D>?O>OLCB IB I> T? MO>N CO FB F]> D?B>? @PB I> T? MO>
@>R ?B F]> D?B>± b IF= Ib?ON D>]FCUO MS �> DC Ù² ^�CB IF@= D>?O>B I>
= I? @=>B I?BCU D? MR C DFB IGb FMMT? FMBC `@P?PC=U G> @BB I?B FO
?=BU? MMS b FB IF@D? @R > ^
3�
#$%$&'($%)'*)*%+,- (,$*. %'/,
0 $*1$/2435647888
¢�£ �v� �����\° ��������
;Ú U> DS ? MR C DFB IGFOR D>>PS ? @P=? @B? Y>OULCN B FG? MN ?B IO ^
;Ú U> DS ? MR C DFB IG=? @T? FMBC D>?= IB I>P>OB F@?B FC @FTB I> D>? D>
BCC G? @S T? MO>N CO FB F]>O ^
;HIFO I?NN > @OL>=?UO>b>MFGFBw U> DS N ?B IP>N B I? @P @>]> D
]FO FB? @CP>Bb F=> kFT?w U> DS B? Y>O? MC @R N ?B I± G>?OU D>PLS
>PR > ¤=CU @B² BC? @CP>b I> @?O IC DB> DN ?B I>�FOBOa FB=? @@CBR C
L?= Y? @P] FO FBB I> @> FR ILC DOC TB I?B @CP>]F?B I>O IC DB> DN ?B I
M?B> D^;A F@=>CU D? MR C DFB IGFOR D>>PS ? @PB? Y>OB I>O IC DB>OBN ?B I
± G>?OU D>PLS >PR > ¤=CU @B² a B IFO=? @C @MS I?NN > @F@B I>
N D>O> @=>C TT? MO>N CO FB F]>O ^3�
#$%$&'($%)'*)*%+,- (,$*. %'/,
0 $*1$/2435647888
� �\¢v������ �¢�
;�O>PB I> �COBC @� @F]> DO FBS X>LB D?=>Oa b IF= I=C @O FOBC T
> @B DF>O MFY> k
Û ÜÝÞßàâáãÝßäÜàâåæßçàéèêëì
;WC D>?= IP F¡> D> @B ICOB F@? @S �V Ka b>?PP>P?O> D]> D@CP> ^
HI>O> D]> D@CP>Ob> D> D? @PC GMS =C @@>=B>PL>Bb>> @OC G>
GF@FGU G? @P G? �FGU GP>R D>> ^�?= I= MF> @Bb?O=C @@>=B>PBC
>�?=B MS C @>O> D]> D^
;HI>O> D]> DOb> D>? MMCb>PBCUN P?B>B I>FD�MCC G`MB> DOU @B FM
B I>S O>BB M>P ^
;WF@? MMS a TC D>?= I> @B DS F@B I>B D?=>a B I>MFOB>P= MF> @BN > DTC DG>P
?w U> DS TC DB I>MFOB>P�V K^3�
#$%$&'($%)'*)*%+,- (,$*. %'/,
0 $*1$/2435647888
í î\¢vïðîñò¬ ó�¢vð� �° ñ�ðô�fõîvðóöî�ð÷
0
1000
2000
3000
4000
5000
0100
200300
400500
600700
800900
1000
Cost (bytes transmitted)
Bloom
Filter W
idth
Cost P
er Query vs. F
ilter Width
Best
Random
DF
S / 2
Bloom
øù
úûüûýþÿûü�þ���ü��� ÿ�û�� üþ��
� û��û� �� øùùù
í î ��ïðîñò� ó���ð�
í ���ó����� �óöîó�ô��õî�ðóö�ó� ð÷
2�
3�
4�
5�
6�7�
8�
Filter D
epth
20 40 60 80
1000 20 40 60 80
100
Percent Found�S
uccessful Queries vs. F
ilter Depth
�
1
1 2!
1 2! 3" 4#
1 2! 3" 4# 5$ 7%
1 2! 3" 4# 5$ 6& 7% 8' 14
1 2! 3" 4# 5$ 6& 7% 8' 9( 11 13 18
1 2! 3" 4# 5$ 6& 7% 8' 9( 10 11 13 31
ø
úûüûýþÿûü�þ���ü��� ÿ�û�� üþ��
� û��û� �� øùùù
õ�ð�öóñö)
*+,-./102,3456, 07 28 0, 9, 93.3,34:020;, 065 <= 7 40, 9:>
?@78 <7 2= ; 97- <.83;35 46 9A3 B7 43= 0C 02= -DFE
?G 95, 0;, 935C3 45= 3D 5, 9<3 2= , 97 B5;-663;; B- <H -34/ E
*I7.3 <, 93J635 2+,7 43 27, 07 27 B.76- :3 2,;LKM78 02=ON,7, 93
D <563;, 93/ 5 43 :7;,-;3. >
[email protected];, 90;3 P36,, 93H -34/ 5 <= 7 40, 9:E
?Q73;, 93-D .5,35 <= 7 40, 9:;, 0<<67 2C3 4= 3 E@78H - 06 R</ E
*+ 0:- <5,3, 935 <= 7 40, 9:02:7 43.3,5 0<>
øø
úûüûýþÿûü�þ���ü��� ÿ�û�� üþ��
� û��û� �� øùùù
S TU����VTU
*W,,3 2-5,3. X<77 :Y<,34;5 435 23P36, 0C3 :3, 97. B7 4. 0436, 02=
<765 <0Z3.;35 46 93; >
*[25 <:7;,5 <<65;3;\ , 93/ 7-,D 3 4B7 4:5 45 2.7 :0Z3..3D , 9]Y4;,
;35 46 9>
*^7 4;- _6 03 2,Y<,34; 0Z3\ , 93/ 5DD 47 `0:5,35 27 456 <3]. 0436,3.
;35 46 9-; 02= 7 2</ <765 <</ 5C5 0<5A <3 02B7 4:5, 07 2>
ø�