moisés hernández duarte unam fes cuautitlán
DESCRIPTION
GENIUS Grid portal Hands on. Moisés Hernández Duarte UNAM FES Cuautitlán Tutorial on grid, visualization and high performance calculation Mexico City, October 23 – 26, 2007 Based on Luciano Díaz presentation, ICN-UNAM. Outline. Useful information Exercises - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: Moisés Hernández Duarte UNAM FES Cuautitlán](https://reader036.vdocuments.pub/reader036/viewer/2022062300/56812c8b550346895d913c94/html5/thumbnails/1.jpg)
FP6−2004−Infrastructures−6-SSA-026409
www.eu-eela.org
E-infrastructure shared between Europe and Latin America
Moisés Hernández DuarteUNAM FES CuautitlánTutorial on grid, visualization and high performance calculationMexico City, October 23 – 26, 2007Based on Luciano Díaz presentation, ICN-UNAM
GENIUS Grid portalHands on
![Page 2: Moisés Hernández Duarte UNAM FES Cuautitlán](https://reader036.vdocuments.pub/reader036/viewer/2022062300/56812c8b550346895d913c94/html5/thumbnails/2.jpg)
Users Tutorial, Mexico City, 23 - 24 October 2007FP6−2004−Infrastructures−6-SSA-026409
E-infrastructure shared between Europe and Latin America
Outline
• Useful information• Exercises
1. GENIUS logging in and base settings
2. Launch a job described by a JDL which already exists in the UI
3. Prepare a job described by a JDL and store it on the UI
4. Submit the job described by the JDL created in the previous exercise
5. Preparing a job described by the JDL with a file to ship in the input sandbox
6. Submitting the job prepared in the previous exercise
![Page 3: Moisés Hernández Duarte UNAM FES Cuautitlán](https://reader036.vdocuments.pub/reader036/viewer/2022062300/56812c8b550346895d913c94/html5/thumbnails/3.jpg)
Users Tutorial, Mexico City, 23 - 24 October 2007 3FP6−2004−Infrastructures−6-SSA-026409
E-infrastructure shared between Europe and Latin America
Useful information
• GENIUS Tutorial website: • https://glite-tutor2.ct.infn.it
• Tutorial accounts on glite-tutor:• Username: mexicocityXX where XX goes from 01 to 40• Password: GridMEXxx where xx goes from 01 to 40• When issuing the myproxy-init command:• Myproxy password: MEXICOCITY for all the accounts
![Page 4: Moisés Hernández Duarte UNAM FES Cuautitlán](https://reader036.vdocuments.pub/reader036/viewer/2022062300/56812c8b550346895d913c94/html5/thumbnails/4.jpg)
Users Tutorial, Mexico City, 23 - 24 October 2007 4FP6−2004−Infrastructures−6-SSA-026409
E-infrastructure shared between Europe and Latin America
Introduction: the two-layers Authentication
• 1. Authentication with the User Interface
• 2. Authentication to the Grid.
Input password of the proxy (specified when you shall execute myproxy-init)
Input password of the user account: mexicocityXX
![Page 5: Moisés Hernández Duarte UNAM FES Cuautitlán](https://reader036.vdocuments.pub/reader036/viewer/2022062300/56812c8b550346895d913c94/html5/thumbnails/5.jpg)
Users Tutorial, Mexico City, 23 - 24 October 2007 5FP6−2004−Infrastructures−6-SSA-026409
E-infrastructure shared between Europe and Latin America
Exercise 1
GENIUS logging in and base settings
![Page 6: Moisés Hernández Duarte UNAM FES Cuautitlán](https://reader036.vdocuments.pub/reader036/viewer/2022062300/56812c8b550346895d913c94/html5/thumbnails/6.jpg)
Users Tutorial, Mexico City, 23 - 24 October 2007 6FP6−2004−Infrastructures−6-SSA-026409
E-infrastructure shared between Europe and Latin America
Outline of the exercise 1/2
• Login at your UI account (passwd: GridMEXxx)
• Store a proxy on a remote Myproxy Server machine with the command (using the passphrase MEXICOCITY):
• >myproxy-init --voms gilda
• Retrieve a local proxy from MyProxy server:• > myproxy-get-delegation (must use your new
MyProxy passphrase)
![Page 7: Moisés Hernández Duarte UNAM FES Cuautitlán](https://reader036.vdocuments.pub/reader036/viewer/2022062300/56812c8b550346895d913c94/html5/thumbnails/7.jpg)
Users Tutorial, Mexico City, 23 - 24 October 2007 7FP6−2004−Infrastructures−6-SSA-026409
E-infrastructure shared between Europe and Latin America
Outline of the exercise 2/2
• Verify your new local proxy: • >voms-proxy-info --all
• Destroy your local proxy with the command and then inspect it
• >voms-proxy-destroy
• Go on the https://glite-tutor2.ct.infn.it with your browser, put your Myproxy passphrase.
• Come back on the terminal and execute • >voms-proxy-info --all
![Page 8: Moisés Hernández Duarte UNAM FES Cuautitlán](https://reader036.vdocuments.pub/reader036/viewer/2022062300/56812c8b550346895d913c94/html5/thumbnails/8.jpg)
Users Tutorial, Mexico City, 23 - 24 October 2007 8FP6−2004−Infrastructures−6-SSA-026409
E-infrastructure shared between Europe and Latin America
>myproxy-init --voms gilda
[mexicocity20@eela-132 mexicocity20]$ myproxy-init --voms gildaCannot find file or dir: /home/mexicocity20/.glite/vomsesYour identity: /C=IT/O=GILDA/OU=Personal Certificate/L=MEXICOCITY/CN=MEXICOCITY20/[email protected] GRID pass phrase:verify OKCreating temporary proxy ................................................... DoneContacting voms.ct.infn.it:15001 [/C=IT/O=GILDA/OU=Host/L=INFN Catania/CN=voms.ct.infn.it/[email protected]] "gilda" DoneCreating proxy ........................................ DoneYour proxy is valid until Sun Sep 3 06:35:26 2006Enter MyProxy pass phrase:Verifying password - Enter MyProxy pass phrase:A proxy valid for 168 hours (7.0 days) for user mexicocity20 now exists on grid001.ct.infn.it.[mexicocity20@eela-132 mexicocity20]$
Password: MEXICOCITY
Choose a new password;This password will be referred
later as myproxy password
![Page 9: Moisés Hernández Duarte UNAM FES Cuautitlán](https://reader036.vdocuments.pub/reader036/viewer/2022062300/56812c8b550346895d913c94/html5/thumbnails/9.jpg)
Users Tutorial, Mexico City, 23 - 24 October 2007 9FP6−2004−Infrastructures−6-SSA-026409
E-infrastructure shared between Europe and Latin America
Get credentials from the MyProxy server
• >myproxy-get-delegation• >voms-proxy-info -all
[mexicocity20@eela-132 mexicocity20]$ myproxy-get-delegation Enter MyProxy pass phrase:A proxy has been received for user mexicocity20 in /tmp/x509up_u519[mexicocity20@eela-132 mexicocity20]$ voms-proxy-info -allsubject : /C=IT/O=GILDA/OU=Personal Certificate/L=MEXICOCITY/CN=MEXICOCITY20/[email protected]/CN=proxy/CN=proxy/CN=proxyissuer : /C=IT/O=GILDA/OU=Personal Certificate/L=MEXICOCITY/CN=MEXICOCITY20/[email protected]/CN=proxy/CN=proxyidentity : /C=IT/O=GILDA/OU=Personal Certificate/L=MEXICOCITY/CN=MEXICOCITY20/[email protected]/CN=proxy/CN=proxytype : unknownstrength : 512 bitspath : /tmp/x509up_u519timeleft : 11:51:33=== VO gilda extension information ===VO : gildasubject : /C=IT/O=GILDA/OU=Personal Certificate/L=MEXICOCITY/CN=MEXICOCITY20/[email protected] : /C=IT/O=GILDA/OU=Host/L=INFN Catania/CN=voms.ct.infn.it/[email protected] : /gilda/Role=NULL/Capability=NULLtimeleft : 11:34:59[mexicocity20@eela-132 mexicocity20]$
![Page 10: Moisés Hernández Duarte UNAM FES Cuautitlán](https://reader036.vdocuments.pub/reader036/viewer/2022062300/56812c8b550346895d913c94/html5/thumbnails/10.jpg)
Users Tutorial, Mexico City, 23 - 24 October 2007 10
FP6−2004−Infrastructures−6-SSA-026409
E-infrastructure shared between Europe and Latin America
Destroying local voms proxy
• >voms-proxy-destroy• >voms-proxy-info -all
[mexicocity20@eela-132 mexicocity20]$ voms-proxy-destroy [mexicocity20@eela-132 mexicocity20]$ voms-proxy-info -all
Couldn't find a valid proxy.
[mexicocity20@eela-132 mexicocity20]$
![Page 11: Moisés Hernández Duarte UNAM FES Cuautitlán](https://reader036.vdocuments.pub/reader036/viewer/2022062300/56812c8b550346895d913c94/html5/thumbnails/11.jpg)
Users Tutorial, Mexico City, 23 - 24 October 2007 11
FP6−2004−Infrastructures−6-SSA-026409
E-infrastructure shared between Europe and Latin America
The Genius Home Page
![Page 12: Moisés Hernández Duarte UNAM FES Cuautitlán](https://reader036.vdocuments.pub/reader036/viewer/2022062300/56812c8b550346895d913c94/html5/thumbnails/12.jpg)
Users Tutorial, Mexico City, 23 - 24 October 2007 12
FP6−2004−Infrastructures−6-SSA-026409
E-infrastructure shared between Europe and Latin America
…then authenticating on GENIUS using myproxy passwd…
• GRID authentication• The password is the one set when
issued the myproxy-init command
Myproxy password set before
![Page 13: Moisés Hernández Duarte UNAM FES Cuautitlán](https://reader036.vdocuments.pub/reader036/viewer/2022062300/56812c8b550346895d913c94/html5/thumbnails/13.jpg)
Users Tutorial, Mexico City, 23 - 24 October 2007 13
FP6−2004−Infrastructures−6-SSA-026409
E-infrastructure shared between Europe and Latin America
Exercise 2
• Launch a job described by a JDL which already exists in the UI
• We suppose to have the JDL file and all the other required data (input sandbox files) on the UI and we
shall try to submit the job on the GRID
![Page 14: Moisés Hernández Duarte UNAM FES Cuautitlán](https://reader036.vdocuments.pub/reader036/viewer/2022062300/56812c8b550346895d913c94/html5/thumbnails/14.jpg)
Users Tutorial, Mexico City, 23 - 24 October 2007 14
FP6−2004−Infrastructures−6-SSA-026409
E-infrastructure shared between Europe and Latin America
Authentication with MyProxy
![Page 15: Moisés Hernández Duarte UNAM FES Cuautitlán](https://reader036.vdocuments.pub/reader036/viewer/2022062300/56812c8b550346895d913c94/html5/thumbnails/15.jpg)
Users Tutorial, Mexico City, 23 - 24 October 2007 15
FP6−2004−Infrastructures−6-SSA-026409
E-infrastructure shared between Europe and Latin America
GRID Settings
![Page 16: Moisés Hernández Duarte UNAM FES Cuautitlán](https://reader036.vdocuments.pub/reader036/viewer/2022062300/56812c8b550346895d913c94/html5/thumbnails/16.jpg)
Users Tutorial, Mexico City, 23 - 24 October 2007 16
FP6−2004−Infrastructures−6-SSA-026409
E-infrastructure shared between Europe and Latin America
Set VO/VOMS
![Page 17: Moisés Hernández Duarte UNAM FES Cuautitlán](https://reader036.vdocuments.pub/reader036/viewer/2022062300/56812c8b550346895d913c94/html5/thumbnails/17.jpg)
Users Tutorial, Mexico City, 23 - 24 October 2007 17
FP6−2004−Infrastructures−6-SSA-026409
E-infrastructure shared between Europe and Latin America
Selecting jdl file
![Page 18: Moisés Hernández Duarte UNAM FES Cuautitlán](https://reader036.vdocuments.pub/reader036/viewer/2022062300/56812c8b550346895d913c94/html5/thumbnails/18.jpg)
Users Tutorial, Mexico City, 23 - 24 October 2007 18
FP6−2004−Infrastructures−6-SSA-026409
E-infrastructure shared between Europe and Latin America
Specify the CE Resource
![Page 19: Moisés Hernández Duarte UNAM FES Cuautitlán](https://reader036.vdocuments.pub/reader036/viewer/2022062300/56812c8b550346895d913c94/html5/thumbnails/19.jpg)
Users Tutorial, Mexico City, 23 - 24 October 2007 19
FP6−2004−Infrastructures−6-SSA-026409
E-infrastructure shared between Europe and Latin America
Job successfully submitted
![Page 20: Moisés Hernández Duarte UNAM FES Cuautitlán](https://reader036.vdocuments.pub/reader036/viewer/2022062300/56812c8b550346895d913c94/html5/thumbnails/20.jpg)
Users Tutorial, Mexico City, 23 - 24 October 2007 20
FP6−2004−Infrastructures−6-SSA-026409
E-infrastructure shared between Europe and Latin America
Job completed successfully
![Page 21: Moisés Hernández Duarte UNAM FES Cuautitlán](https://reader036.vdocuments.pub/reader036/viewer/2022062300/56812c8b550346895d913c94/html5/thumbnails/21.jpg)
Users Tutorial, Mexico City, 23 - 24 October 2007 21
FP6−2004−Infrastructures−6-SSA-026409
E-infrastructure shared between Europe and Latin America
Retrieving Job results 1/3
![Page 22: Moisés Hernández Duarte UNAM FES Cuautitlán](https://reader036.vdocuments.pub/reader036/viewer/2022062300/56812c8b550346895d913c94/html5/thumbnails/22.jpg)
Users Tutorial, Mexico City, 23 - 24 October 2007 22
FP6−2004−Infrastructures−6-SSA-026409
E-infrastructure shared between Europe and Latin America
Retrieving Job results 2/3
![Page 23: Moisés Hernández Duarte UNAM FES Cuautitlán](https://reader036.vdocuments.pub/reader036/viewer/2022062300/56812c8b550346895d913c94/html5/thumbnails/23.jpg)
Users Tutorial, Mexico City, 23 - 24 October 2007 23
FP6−2004−Infrastructures−6-SSA-026409
E-infrastructure shared between Europe and Latin America
Retrieving job results 3/3
![Page 24: Moisés Hernández Duarte UNAM FES Cuautitlán](https://reader036.vdocuments.pub/reader036/viewer/2022062300/56812c8b550346895d913c94/html5/thumbnails/24.jpg)
Users Tutorial, Mexico City, 23 - 24 October 2007 24
FP6−2004−Infrastructures−6-SSA-026409
E-infrastructure shared between Europe and Latin America
Exercise 3
• Prepare a job described by a JDL and store it on the UI
• In this exercise we are going to create a new file on the UI called helloworld.jdl describing a simple job
![Page 25: Moisés Hernández Duarte UNAM FES Cuautitlán](https://reader036.vdocuments.pub/reader036/viewer/2022062300/56812c8b550346895d913c94/html5/thumbnails/25.jpg)
Users Tutorial, Mexico City, 23 - 24 October 2007 25
FP6−2004−Infrastructures−6-SSA-026409
E-infrastructure shared between Europe and Latin America
First step: create the JDL file
[ JobType = "Normal"; Executable = "/bin/echo"; Arguments = "Hello World !"; StdOutput = "std.out"; StdError = "std.err"; OutputSandbox = {"std.out","std.err"}; ]
![Page 26: Moisés Hernández Duarte UNAM FES Cuautitlán](https://reader036.vdocuments.pub/reader036/viewer/2022062300/56812c8b550346895d913c94/html5/thumbnails/26.jpg)
Users Tutorial, Mexico City, 23 - 24 October 2007 26
FP6−2004−Infrastructures−6-SSA-026409
E-infrastructure shared between Europe and Latin America
The JDL is ready to be executed
![Page 27: Moisés Hernández Duarte UNAM FES Cuautitlán](https://reader036.vdocuments.pub/reader036/viewer/2022062300/56812c8b550346895d913c94/html5/thumbnails/27.jpg)
Users Tutorial, Mexico City, 23 - 24 October 2007 27
FP6−2004−Infrastructures−6-SSA-026409
E-infrastructure shared between Europe and Latin America
Inspecting our JDL
![Page 28: Moisés Hernández Duarte UNAM FES Cuautitlán](https://reader036.vdocuments.pub/reader036/viewer/2022062300/56812c8b550346895d913c94/html5/thumbnails/28.jpg)
Users Tutorial, Mexico City, 23 - 24 October 2007 28
FP6−2004−Infrastructures−6-SSA-026409
E-infrastructure shared between Europe and Latin America
Exercise 4
• Submit the job described by the JDL created in the previous exercise
• In this exercise we are going to submit the job described by the JDL file edited in the previous step
![Page 29: Moisés Hernández Duarte UNAM FES Cuautitlán](https://reader036.vdocuments.pub/reader036/viewer/2022062300/56812c8b550346895d913c94/html5/thumbnails/29.jpg)
Users Tutorial, Mexico City, 23 - 24 October 2007 29
FP6−2004−Infrastructures−6-SSA-026409
E-infrastructure shared between Europe and Latin America
Select JDL file 1/3
![Page 30: Moisés Hernández Duarte UNAM FES Cuautitlán](https://reader036.vdocuments.pub/reader036/viewer/2022062300/56812c8b550346895d913c94/html5/thumbnails/30.jpg)
Users Tutorial, Mexico City, 23 - 24 October 2007 30
FP6−2004−Infrastructures−6-SSA-026409
E-infrastructure shared between Europe and Latin America
Submitting the JDL 2/3
![Page 31: Moisés Hernández Duarte UNAM FES Cuautitlán](https://reader036.vdocuments.pub/reader036/viewer/2022062300/56812c8b550346895d913c94/html5/thumbnails/31.jpg)
Users Tutorial, Mexico City, 23 - 24 October 2007 31
FP6−2004−Infrastructures−6-SSA-026409
E-infrastructure shared between Europe and Latin America
Retrieving job results 3/3
![Page 32: Moisés Hernández Duarte UNAM FES Cuautitlán](https://reader036.vdocuments.pub/reader036/viewer/2022062300/56812c8b550346895d913c94/html5/thumbnails/32.jpg)
Users Tutorial, Mexico City, 23 - 24 October 2007 32
FP6−2004−Infrastructures−6-SSA-026409
E-infrastructure shared between Europe and Latin America
Exercise 5
• Preparing a job described by the JDL with a file to ship in the input sandbox
• In this exercise we are going prepare the JDL description for a job which executes a shell script. The .sh file will be shipped to the CE through the input sandbox
![Page 33: Moisés Hernández Duarte UNAM FES Cuautitlán](https://reader036.vdocuments.pub/reader036/viewer/2022062300/56812c8b550346895d913c94/html5/thumbnails/33.jpg)
Users Tutorial, Mexico City, 23 - 24 October 2007 33
FP6−2004−Infrastructures−6-SSA-026409
E-infrastructure shared between Europe and Latin America
Step 1: Create the shell script
#!/bin/sh MY_NAME="Your name" WORKER_NODE_NAME=glite-tutor.ct.infn.it echo "Hello $MY_NAME, from $WORKER_NODE_NAME" ls -a echo "This job is running on this CE: " /opt/edg/bin/edg-brokerinfo getCE
![Page 34: Moisés Hernández Duarte UNAM FES Cuautitlán](https://reader036.vdocuments.pub/reader036/viewer/2022062300/56812c8b550346895d913c94/html5/thumbnails/34.jpg)
Users Tutorial, Mexico City, 23 - 24 October 2007 34
FP6−2004−Infrastructures−6-SSA-026409
E-infrastructure shared between Europe and Latin America
Step2: create the JDL file
[ Executable = "startScript.sh"; StdOutput = "std.out"; StdError = "std.err"; VirtualOrganisation = "gilda"; InputSandbox = {"startScript.sh"}; OutputSandbox = {"std.out","std.err",".BrokerInfo"}; RetryCount = 7; ]
![Page 35: Moisés Hernández Duarte UNAM FES Cuautitlán](https://reader036.vdocuments.pub/reader036/viewer/2022062300/56812c8b550346895d913c94/html5/thumbnails/35.jpg)
Users Tutorial, Mexico City, 23 - 24 October 2007 35
FP6−2004−Infrastructures−6-SSA-026409
E-infrastructure shared between Europe and Latin America
Exercise 6
• Submitting the job prepared in the previous exercise
• In this exercise we are going submit the job which executes a shell script, prepared in the previous exercise. The .sh file will be shipped to the CE through the input sandbox
![Page 36: Moisés Hernández Duarte UNAM FES Cuautitlán](https://reader036.vdocuments.pub/reader036/viewer/2022062300/56812c8b550346895d913c94/html5/thumbnails/36.jpg)
Users Tutorial, Mexico City, 23 - 24 October 2007 36
FP6−2004−Infrastructures−6-SSA-026409
E-infrastructure shared between Europe and Latin America
Submitting job
![Page 37: Moisés Hernández Duarte UNAM FES Cuautitlán](https://reader036.vdocuments.pub/reader036/viewer/2022062300/56812c8b550346895d913c94/html5/thumbnails/37.jpg)
Users Tutorial, Mexico City, 23 - 24 October 2007 37
FP6−2004−Infrastructures−6-SSA-026409
E-infrastructure shared between Europe and Latin America
Retrieving the results