abhishek singh rana uc san diego | uscms | disun rana@fnal
DESCRIPTION
Edge Services Framework ESF in Open Science Grid. Joint OSG and EGEE Operations Workshop September 27-29, 2005 RAL, UK. Abhishek Singh Rana UC San Diego | USCMS | DISUN [email protected]. Kate Keahey Argonne Lab | Globus Alliance [email protected]. Outline. OSG-ESF Activity. ESF Phase 1. - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: Abhishek Singh Rana UC San Diego | USCMS | DISUN rana@fnal](https://reader036.vdocuments.pub/reader036/viewer/2022081514/568140cf550346895dac9abb/html5/thumbnails/1.jpg)
Joint OSG and EGEE Operations Workshop RAL UK September 27 2005
Abhishek Singh Rana and Kate Keahey OSG Edge Services Framework www.opensciencegrid.org
The Open Science Grid Consortium
Abhishek Singh RanaUC San Diego | USCMS | DISUN
Kate KeaheyArgonne Lab | Globus [email protected]
Edge Services FrameworkESF in Open Science Grid
Joint OSG and EGEE Operations WorkshopSeptember 27-29, 2005 RAL, UK
![Page 2: Abhishek Singh Rana UC San Diego | USCMS | DISUN rana@fnal](https://reader036.vdocuments.pub/reader036/viewer/2022081514/568140cf550346895dac9abb/html5/thumbnails/2.jpg)
2
Joint OSG and EGEE Operations Workshop RAL UK September 27 2005
Abhishek Singh Rana and Kate Keahey OSG Edge Services Framework www.opensciencegrid.org
The Open Science Grid Consortium
Outline
• OSG-ESF Activity.• ESF Phase 1.
– Concepts and Design.
• ESF future direction.• Xen overview.• Plan for Phase 1 on OSG.
– Site admin responsibilities.– VO admin responsibilities.
• Status and Next Steps.
![Page 3: Abhishek Singh Rana UC San Diego | USCMS | DISUN rana@fnal](https://reader036.vdocuments.pub/reader036/viewer/2022081514/568140cf550346895dac9abb/html5/thumbnails/3.jpg)
3
Joint OSG and EGEE Operations Workshop RAL UK September 27 2005
Abhishek Singh Rana and Kate Keahey OSG Edge Services Framework www.opensciencegrid.org
The Open Science Grid Consortium
Vision
From talk by Frank Wuerthwein at OSG Consortium Meeting 2005
(simplified snapshot of a typical OSG/LCG site in 2007)
![Page 4: Abhishek Singh Rana UC San Diego | USCMS | DISUN rana@fnal](https://reader036.vdocuments.pub/reader036/viewer/2022081514/568140cf550346895dac9abb/html5/thumbnails/4.jpg)
4
Joint OSG and EGEE Operations Workshop RAL UK September 27 2005
Abhishek Singh Rana and Kate Keahey OSG Edge Services Framework www.opensciencegrid.org
The Open Science Grid Consortium
OSG-ESF Activity
• Started in September 2005.• Physicists, Computer Scientists & Engineers, Software Architects.• Chairs: Kate Keahey and Abhishek Singh Rana.
• Workspace Services Design: – Timothy Freeman & Kate Keahey (Globus Alliance).
• Edge Services Implementations:– USATLAS: Rob Gardner (U Chicago), Alexander Vaniachine (ANL).– USCMS: Frank Wuerthwein, Abhishek Singh Rana (UC San Diego).
• Mailing List – osg-edgeservices at opensciencegrid.org
• Web collaborative area –http://osg.ivdgl.org/twiki/bin/view/EdgeServices
![Page 5: Abhishek Singh Rana UC San Diego | USCMS | DISUN rana@fnal](https://reader036.vdocuments.pub/reader036/viewer/2022081514/568140cf550346895dac9abb/html5/thumbnails/5.jpg)
5
Joint OSG and EGEE Operations Workshop RAL UK September 27 2005
Abhishek Singh Rana and Kate Keahey OSG Edge Services Framework www.opensciencegrid.org
The Open Science Grid Consortium
Current OSG-ESF mailing list
[email protected] Ian [email protected] Barry [email protected] Simone [email protected] Kaushik [email protected] Laurence [email protected] Tim [email protected] Rob [email protected] Burt [email protected] Kate [email protected] Maarten [email protected] Stuart [email protected] Razvan [email protected] Ruth [email protected] Abhishek Singh [email protected] Markus [email protected] Jim [email protected] Dane [email protected] David [email protected] Preston [email protected] Alexander [email protected] Torre [email protected] Frank Wuerthwein
![Page 6: Abhishek Singh Rana UC San Diego | USCMS | DISUN rana@fnal](https://reader036.vdocuments.pub/reader036/viewer/2022081514/568140cf550346895dac9abb/html5/thumbnails/6.jpg)
6
Joint OSG and EGEE Operations Workshop RAL UK September 27 2005
Abhishek Singh Rana and Kate Keahey OSG Edge Services Framework www.opensciencegrid.org
The Open Science Grid Consortium
ESF - Phase 1
![Page 7: Abhishek Singh Rana UC San Diego | USCMS | DISUN rana@fnal](https://reader036.vdocuments.pub/reader036/viewer/2022081514/568140cf550346895dac9abb/html5/thumbnails/7.jpg)
7
Joint OSG and EGEE Operations Workshop RAL UK September 27 2005
Abhishek Singh Rana and Kate Keahey OSG Edge Services Framework www.opensciencegrid.org
The Open Science Grid Consortium
No ESF - Phase 0
SECE
Site
![Page 8: Abhishek Singh Rana UC San Diego | USCMS | DISUN rana@fnal](https://reader036.vdocuments.pub/reader036/viewer/2022081514/568140cf550346895dac9abb/html5/thumbnails/8.jpg)
8
Joint OSG and EGEE Operations Workshop RAL UK September 27 2005
Abhishek Singh Rana and Kate Keahey OSG Edge Services Framework www.opensciencegrid.org
The Open Science Grid Consortium
No ESF - Phase 0
Site
SECE
Static deployment
CMS ATLAS CDF
![Page 9: Abhishek Singh Rana UC San Diego | USCMS | DISUN rana@fnal](https://reader036.vdocuments.pub/reader036/viewer/2022081514/568140cf550346895dac9abb/html5/thumbnails/9.jpg)
9
Joint OSG and EGEE Operations Workshop RAL UK September 27 2005
Abhishek Singh Rana and Kate Keahey OSG Edge Services Framework www.opensciencegrid.org
The Open Science Grid Consortium
ESF?
SECE
Site
![Page 10: Abhishek Singh Rana UC San Diego | USCMS | DISUN rana@fnal](https://reader036.vdocuments.pub/reader036/viewer/2022081514/568140cf550346895dac9abb/html5/thumbnails/10.jpg)
10
Joint OSG and EGEE Operations Workshop RAL UK September 27 2005
Abhishek Singh Rana and Kate Keahey OSG Edge Services Framework www.opensciencegrid.org
The Open Science Grid Consortium
ESF - Phase 1
ESF
SE
Site
Snapshot ofES Wafers
implemented asVirtual Workspaces
CE CDFCMS ATLAS
GuestVO
![Page 11: Abhishek Singh Rana UC San Diego | USCMS | DISUN rana@fnal](https://reader036.vdocuments.pub/reader036/viewer/2022081514/568140cf550346895dac9abb/html5/thumbnails/11.jpg)
11
Joint OSG and EGEE Operations Workshop RAL UK September 27 2005
Abhishek Singh Rana and Kate Keahey OSG Edge Services Framework www.opensciencegrid.org
The Open Science Grid Consortium
An attempt at ESF Terminology
• Edge Services Wafer (ES Wafer)– A specific instance of a dynamically-created VM (workspace) is called
an Edge Services Wafer. – An ES Wafer can have several Edge Services running. – A VO can have multiple ES Wafers up at a Site.
• Edge Services Slot (ES Slot) – An ES Slot has hardware characteristics specified by the Site Admin.– An ES Slot can be leased by a VO to host an ES Wafer.
• Edge Service (ES) – A VO-specific service instantiated by a VO in a Wafer.
• Workspace Service (WS)– Service at a Site that allows VOs to instantiate ES Wafers in ES Slots.
![Page 12: Abhishek Singh Rana UC San Diego | USCMS | DISUN rana@fnal](https://reader036.vdocuments.pub/reader036/viewer/2022081514/568140cf550346895dac9abb/html5/thumbnails/12.jpg)
12
Joint OSG and EGEE Operations Workshop RAL UK September 27 2005
Abhishek Singh Rana and Kate Keahey OSG Edge Services Framework www.opensciencegrid.org
The Open Science Grid Consortium
ESF - Phase 1
CDFCMS ATLAS
GuestVO
ESF
SECE
Site
GT4 Workspace Service & VMM
Dynamically deployed ES Wafers for each VO
Wafer imagesstored in SE
Compute nodes and Storage nodes
Snapshot ofES Wafers
implemented asVirtual Workspaces
![Page 13: Abhishek Singh Rana UC San Diego | USCMS | DISUN rana@fnal](https://reader036.vdocuments.pub/reader036/viewer/2022081514/568140cf550346895dac9abb/html5/thumbnails/13.jpg)
13
Joint OSG and EGEE Operations Workshop RAL UK September 27 2005
Abhishek Singh Rana and Kate Keahey OSG Edge Services Framework www.opensciencegrid.org
The Open Science Grid Consortium
User jobs at Compute nodes using ES Wafers for VO Edge Services
ESF
SECE
Site
CDFCMS ATLAS
GuestVO
![Page 14: Abhishek Singh Rana UC San Diego | USCMS | DISUN rana@fnal](https://reader036.vdocuments.pub/reader036/viewer/2022081514/568140cf550346895dac9abb/html5/thumbnails/14.jpg)
14
Joint OSG and EGEE Operations Workshop RAL UK September 27 2005
Abhishek Singh Rana and Kate Keahey OSG Edge Services Framework www.opensciencegrid.org
The Open Science Grid Consortium
VO Admin transporting/storing ES image to a remote Site..
..Deploying ES using image stored in Site’s local repository
![Page 15: Abhishek Singh Rana UC San Diego | USCMS | DISUN rana@fnal](https://reader036.vdocuments.pub/reader036/viewer/2022081514/568140cf550346895dac9abb/html5/thumbnails/15.jpg)
15
Joint OSG and EGEE Operations Workshop RAL UK September 27 2005
Abhishek Singh Rana and Kate Keahey OSG Edge Services Framework www.opensciencegrid.org
The Open Science Grid Consortium
ESF - Phase 1
ESF
SECE
Site
CMS
Role=VO Admin
![Page 16: Abhishek Singh Rana UC San Diego | USCMS | DISUN rana@fnal](https://reader036.vdocuments.pub/reader036/viewer/2022081514/568140cf550346895dac9abb/html5/thumbnails/16.jpg)
16
Joint OSG and EGEE Operations Workshop RAL UK September 27 2005
Abhishek Singh Rana and Kate Keahey OSG Edge Services Framework www.opensciencegrid.org
The Open Science Grid Consortium
ESF - Phase 1
ESF
SECE
Site
CMS
Role=VO Admin
![Page 17: Abhishek Singh Rana UC San Diego | USCMS | DISUN rana@fnal](https://reader036.vdocuments.pub/reader036/viewer/2022081514/568140cf550346895dac9abb/html5/thumbnails/17.jpg)
17
Joint OSG and EGEE Operations Workshop RAL UK September 27 2005
Abhishek Singh Rana and Kate Keahey OSG Edge Services Framework www.opensciencegrid.org
The Open Science Grid Consortium
ESF - Phase 1
ESF
SECE
Site
Role=VO Admin
![Page 18: Abhishek Singh Rana UC San Diego | USCMS | DISUN rana@fnal](https://reader036.vdocuments.pub/reader036/viewer/2022081514/568140cf550346895dac9abb/html5/thumbnails/18.jpg)
18
Joint OSG and EGEE Operations Workshop RAL UK September 27 2005
Abhishek Singh Rana and Kate Keahey OSG Edge Services Framework www.opensciencegrid.org
The Open Science Grid Consortium
ESF - Phase 1
ESF
SECE
Site
Role=VO Admin
![Page 19: Abhishek Singh Rana UC San Diego | USCMS | DISUN rana@fnal](https://reader036.vdocuments.pub/reader036/viewer/2022081514/568140cf550346895dac9abb/html5/thumbnails/19.jpg)
19
Joint OSG and EGEE Operations Workshop RAL UK September 27 2005
Abhishek Singh Rana and Kate Keahey OSG Edge Services Framework www.opensciencegrid.org
The Open Science Grid Consortium
ESF - Phase 1
ESF
SECE
Site
CMS
Role=VO Admin
![Page 20: Abhishek Singh Rana UC San Diego | USCMS | DISUN rana@fnal](https://reader036.vdocuments.pub/reader036/viewer/2022081514/568140cf550346895dac9abb/html5/thumbnails/20.jpg)
20
Joint OSG and EGEE Operations Workshop RAL UK September 27 2005
Abhishek Singh Rana and Kate Keahey OSG Edge Services Framework www.opensciencegrid.org
The Open Science Grid Consortium
ESF - Phase 1
ESF
SECE
Site
CMS
Role=VO Admin
![Page 21: Abhishek Singh Rana UC San Diego | USCMS | DISUN rana@fnal](https://reader036.vdocuments.pub/reader036/viewer/2022081514/568140cf550346895dac9abb/html5/thumbnails/21.jpg)
21
Joint OSG and EGEE Operations Workshop RAL UK September 27 2005
Abhishek Singh Rana and Kate Keahey OSG Edge Services Framework www.opensciencegrid.org
The Open Science Grid Consortium
ESF - Phase 1
ESF
SECE
Site
CMS
Role=VO Admin
![Page 22: Abhishek Singh Rana UC San Diego | USCMS | DISUN rana@fnal](https://reader036.vdocuments.pub/reader036/viewer/2022081514/568140cf550346895dac9abb/html5/thumbnails/22.jpg)
22
Joint OSG and EGEE Operations Workshop RAL UK September 27 2005
Abhishek Singh Rana and Kate Keahey OSG Edge Services Framework www.opensciencegrid.org
The Open Science Grid Consortium
A VO User using ES..
![Page 23: Abhishek Singh Rana UC San Diego | USCMS | DISUN rana@fnal](https://reader036.vdocuments.pub/reader036/viewer/2022081514/568140cf550346895dac9abb/html5/thumbnails/23.jpg)
23
Joint OSG and EGEE Operations Workshop RAL UK September 27 2005
Abhishek Singh Rana and Kate Keahey OSG Edge Services Framework www.opensciencegrid.org
The Open Science Grid Consortium
ESF - Phase 1
ESF
SECE
Site
CMS
Role=VO User
![Page 24: Abhishek Singh Rana UC San Diego | USCMS | DISUN rana@fnal](https://reader036.vdocuments.pub/reader036/viewer/2022081514/568140cf550346895dac9abb/html5/thumbnails/24.jpg)
24
Joint OSG and EGEE Operations Workshop RAL UK September 27 2005
Abhishek Singh Rana and Kate Keahey OSG Edge Services Framework www.opensciencegrid.org
The Open Science Grid Consortium
ESF - Phase 1
ESF
SE
Site
CMS
Role=VO User
CE
![Page 25: Abhishek Singh Rana UC San Diego | USCMS | DISUN rana@fnal](https://reader036.vdocuments.pub/reader036/viewer/2022081514/568140cf550346895dac9abb/html5/thumbnails/25.jpg)
25
Joint OSG and EGEE Operations Workshop RAL UK September 27 2005
Abhishek Singh Rana and Kate Keahey OSG Edge Services Framework www.opensciencegrid.org
The Open Science Grid Consortium
ESF - Phase 1
ESF
SECE
Site
CMS
Role=VO User
![Page 26: Abhishek Singh Rana UC San Diego | USCMS | DISUN rana@fnal](https://reader036.vdocuments.pub/reader036/viewer/2022081514/568140cf550346895dac9abb/html5/thumbnails/26.jpg)
26
Joint OSG and EGEE Operations Workshop RAL UK September 27 2005
Abhishek Singh Rana and Kate Keahey OSG Edge Services Framework www.opensciencegrid.org
The Open Science Grid Consortium
ESF - Phase 1
ESF
SECE
Site
CMS
Role=VO User
![Page 27: Abhishek Singh Rana UC San Diego | USCMS | DISUN rana@fnal](https://reader036.vdocuments.pub/reader036/viewer/2022081514/568140cf550346895dac9abb/html5/thumbnails/27.jpg)
27
Joint OSG and EGEE Operations Workshop RAL UK September 27 2005
Abhishek Singh Rana and Kate Keahey OSG Edge Services Framework www.opensciencegrid.org
The Open Science Grid Consortium
ESF - future direction
![Page 28: Abhishek Singh Rana UC San Diego | USCMS | DISUN rana@fnal](https://reader036.vdocuments.pub/reader036/viewer/2022081514/568140cf550346895dac9abb/html5/thumbnails/28.jpg)
28
Joint OSG and EGEE Operations Workshop RAL UK September 27 2005
Abhishek Singh Rana and Kate Keahey OSG Edge Services Framework www.opensciencegrid.org
The Open Science Grid Consortium
ESF - future direction
• Same concept. • ES Wafers to be deployed as an ESF cluster and be fully schedulable by any OSG VO.
![Page 29: Abhishek Singh Rana UC San Diego | USCMS | DISUN rana@fnal](https://reader036.vdocuments.pub/reader036/viewer/2022081514/568140cf550346895dac9abb/html5/thumbnails/29.jpg)
29
Joint OSG and EGEE Operations Workshop RAL UK September 27 2005
Abhishek Singh Rana and Kate Keahey OSG Edge Services Framework www.opensciencegrid.org
The Open Science Grid Consortium
ESF - future direction
ESF
Site
Brokering and Scheduling byEdge Services Framework
Dynamically deployed ES Wafers for many VOs
Cluster of ES Slots with different properties
ATLAS1CMS ATLAS2
CDF
![Page 30: Abhishek Singh Rana UC San Diego | USCMS | DISUN rana@fnal](https://reader036.vdocuments.pub/reader036/viewer/2022081514/568140cf550346895dac9abb/html5/thumbnails/30.jpg)
30
Joint OSG and EGEE Operations Workshop RAL UK September 27 2005
Abhishek Singh Rana and Kate Keahey OSG Edge Services Framework www.opensciencegrid.org
The Open Science Grid Consortium
![Page 31: Abhishek Singh Rana UC San Diego | USCMS | DISUN rana@fnal](https://reader036.vdocuments.pub/reader036/viewer/2022081514/568140cf550346895dac9abb/html5/thumbnails/31.jpg)
31
Joint OSG and EGEE Operations Workshop RAL UK September 27 2005
Abhishek Singh Rana and Kate Keahey OSG Edge Services Framework www.opensciencegrid.org
The Open Science Grid Consortium
Xen overview
Hardware
Virtual Machine Monitor (VMM)
Public Network
Private Network
![Page 32: Abhishek Singh Rana UC San Diego | USCMS | DISUN rana@fnal](https://reader036.vdocuments.pub/reader036/viewer/2022081514/568140cf550346895dac9abb/html5/thumbnails/32.jpg)
32
Joint OSG and EGEE Operations Workshop RAL UK September 27 2005
Abhishek Singh Rana and Kate Keahey OSG Edge Services Framework www.opensciencegrid.org
The Open Science Grid Consortium
Plan for Phase 1 on OSG
![Page 33: Abhishek Singh Rana UC San Diego | USCMS | DISUN rana@fnal](https://reader036.vdocuments.pub/reader036/viewer/2022081514/568140cf550346895dac9abb/html5/thumbnails/33.jpg)
33
Joint OSG and EGEE Operations Workshop RAL UK September 27 2005
Abhishek Singh Rana and Kate Keahey OSG Edge Services Framework www.opensciencegrid.org
The Open Science Grid Consortium
Plan for Phase 1 on OSG
• ATLAS & CMS procure one piece of hardware at their Sites on OSG that runs ESF (called ESF node).– Dual CPU.– 4GB RAM (No PAE support in Xen2, we will exploit only 4GB until
we migrate to Xen3).
• Site administrators install: – Xen (We will go for Xen 2.0.7).– GT4 Workspace Service.
• VO administrators use ESF to fire-up Xen VMs that instantiate VO Services – Edge Services in an ES Wafer.
• A single ESF node hosts ES Wafers for both ATLAS & CMS.
![Page 34: Abhishek Singh Rana UC San Diego | USCMS | DISUN rana@fnal](https://reader036.vdocuments.pub/reader036/viewer/2022081514/568140cf550346895dac9abb/html5/thumbnails/34.jpg)
34
Joint OSG and EGEE Operations Workshop RAL UK September 27 2005
Abhishek Singh Rana and Kate Keahey OSG Edge Services Framework www.opensciencegrid.org
The Open Science Grid Consortium
Site Administrator Responsibilities
• Start with FC4 and deploy:– Xen (We will go for Xen 2.0.7).– Custom kernel for domain 0 (grub required).– Custom kernel for domain U.– GT4.– GT4 Workspace Service.
• Provision:– One public IP, One private IP per VM.– Host certificates per VM.– Disk space per VM.
• Declare available ES Slots and their properties to ESF.
![Page 35: Abhishek Singh Rana UC San Diego | USCMS | DISUN rana@fnal](https://reader036.vdocuments.pub/reader036/viewer/2022081514/568140cf550346895dac9abb/html5/thumbnails/35.jpg)
35
Joint OSG and EGEE Operations Workshop RAL UK September 27 2005
Abhishek Singh Rana and Kate Keahey OSG Edge Services Framework www.opensciencegrid.org
The Open Science Grid Consortium
VO Administrator Responsibilities
• Prepare (freeze) ES Wafer instance as disk image.• Prepare image into file for transport.• SRMCP the image to remote Site’s SE.• Use ESF to fire-up Xen VM with VO-Services (ES Wafer)
at remote Site, from image file in remote SE, using role based authorization (OSG-RBAC).
• Advertise the running Edge Services as needed.
![Page 36: Abhishek Singh Rana UC San Diego | USCMS | DISUN rana@fnal](https://reader036.vdocuments.pub/reader036/viewer/2022081514/568140cf550346895dac9abb/html5/thumbnails/36.jpg)
36
Joint OSG and EGEE Operations Workshop RAL UK September 27 2005
Abhishek Singh Rana and Kate Keahey OSG Edge Services Framework www.opensciencegrid.org
The Open Science Grid Consortium
Status
• Xen3 on testbed.• GT4 Workspace Service being used.• Prototype 0 of ESF.
Next Steps
• Revert back to Xen2.• Develop VO-Service images.• Verify performance, functionality, robustness.
![Page 37: Abhishek Singh Rana UC San Diego | USCMS | DISUN rana@fnal](https://reader036.vdocuments.pub/reader036/viewer/2022081514/568140cf550346895dac9abb/html5/thumbnails/37.jpg)
37
Joint OSG and EGEE Operations Workshop RAL UK September 27 2005
Abhishek Singh Rana and Kate Keahey OSG Edge Services Framework www.opensciencegrid.org
The Open Science Grid Consortium
Thank You.