tutorial, leiden august 2008 introduction
DESCRIPTION
Tutorial, Leiden August 2008 Introduction. Gijs Verdoes Kleijn OmegaCEN / Kapteyn Institute Groningen. Astro nomical W ide-field I maging S ystem for E urope. Tutors Ewout Helmich John McFarland Gijs Verdoes Kleijn Erik Deul. Main objective Astro -WISE A-to- Ω Survey Environment. - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: Tutorial, Leiden August 2008 Introduction](https://reader034.vdocuments.pub/reader034/viewer/2022051316/56814992550346895db6d711/html5/thumbnails/1.jpg)
Tutorial, Leiden 18-20 August 2008
![Page 2: Tutorial, Leiden August 2008 Introduction](https://reader034.vdocuments.pub/reader034/viewer/2022051316/56814992550346895db6d711/html5/thumbnails/2.jpg)
Tutorial, Leiden August 2008
IntroductionGijs Verdoes Kleijn
OmegaCEN / Kapteyn InstituteGroningen
![Page 3: Tutorial, Leiden August 2008 Introduction](https://reader034.vdocuments.pub/reader034/viewer/2022051316/56814992550346895db6d711/html5/thumbnails/3.jpg)
Tutorial, Leiden 18-20 August 2008
Astronomical Wide-field Imaging System for
Europe
• Tutors– Ewout Helmich– John McFarland– Gijs Verdoes Kleijn– Erik Deul
![Page 4: Tutorial, Leiden August 2008 Introduction](https://reader034.vdocuments.pub/reader034/viewer/2022051316/56814992550346895db6d711/html5/thumbnails/4.jpg)
Tutorial, Leiden 18-20 August 2008
Main objective Astro-WISEA-to-Ω Survey Environment
• For astronomical surveys facilitate:– Handling – Calibration– Quality control– Pipelining– User tuned research– Archiving– Disseminating
• All collaborators working in same environment:– WHERE EVER they & the hardware+software are– WHAT EVER kind of data and size
![Page 5: Tutorial, Leiden August 2008 Introduction](https://reader034.vdocuments.pub/reader034/viewer/2022051316/56814992550346895db6d711/html5/thumbnails/5.jpg)
Tutorial, Leiden 18-20 August 2008
The Astro-WISE paradigmTARGET diagram: “raw to redshifts”
…and “redshifts to raw”
![Page 6: Tutorial, Leiden August 2008 Introduction](https://reader034.vdocuments.pub/reader034/viewer/2022051316/56814992550346895db6d711/html5/thumbnails/6.jpg)
Tutorial, Leiden 18-20 August 2008
Classes: Astro-WISE’s building blocks
• Classes: building blocks for objects, tasks, recipes– persistency: stored in database– hierarchy
• The pros of freedom versus the pros of standards: MOLP vs Surveys
Creation_dateverify()
make()
inspect() process_params
DATE_OBS
RawScienceFrame BiasFrame MasterFlatFrame
ReducedScienceFrame
mymethod() myattribute
…
…()
…
![Page 7: Tutorial, Leiden August 2008 Introduction](https://reader034.vdocuments.pub/reader034/viewer/2022051316/56814992550346895db6d711/html5/thumbnails/7.jpg)
Tutorial, Leiden 18-20 August 2008
The Astro-Wise Environment User
Python prompt (awe>)Web interfaces
Database•METADATA•Contains ALL input/output
COMPUTE CLUSTERS
Codebase
DATASERVERS
![Page 8: Tutorial, Leiden August 2008 Introduction](https://reader034.vdocuments.pub/reader034/viewer/2022051316/56814992550346895db6d711/html5/thumbnails/8.jpg)
Tutorial, Leiden 18-20 August 2008
Leiden
The federated Astro-Wise Environment
![Page 9: Tutorial, Leiden August 2008 Introduction](https://reader034.vdocuments.pub/reader034/viewer/2022051316/56814992550346895db6d711/html5/thumbnails/9.jpg)
Tutorial, Leiden 18-20 August 2008
Paradigm in action 1: workflow tracking
![Page 10: Tutorial, Leiden August 2008 Introduction](https://reader034.vdocuments.pub/reader034/viewer/2022051316/56814992550346895db6d711/html5/thumbnails/10.jpg)
Tutorial, Leiden 18-20 August 2008
Paradigm in action 2: visualizing extreme data lineage
![Page 11: Tutorial, Leiden August 2008 Introduction](https://reader034.vdocuments.pub/reader034/viewer/2022051316/56814992550346895db6d711/html5/thumbnails/11.jpg)
Tutorial, Leiden 18-20 August 2008
Paradigm in action 3: intelligent processing
![Page 12: Tutorial, Leiden August 2008 Introduction](https://reader034.vdocuments.pub/reader034/viewer/2022051316/56814992550346895db6d711/html5/thumbnails/12.jpg)
Tutorial, Leiden 18-20 August 2008
What can be ingested into Astro-WISE
• Imaging: 15 instruments currently: – Optical: [email protected], MDM8K@MDM, ACS@HST*,
MEGACAM@CFHT, OCAM@VST, SUPRIMECAM@SUBARU, LBCBLUE/RED@LBT, MONICA@WENDELSTEIN, WFC@INT, PDS@ESO
– Infrared: WFCAM@UKIRT, ISAAC**– Radio: WENSS@WSRT*, LOFAR@LOFAR**
• Tabular data in general
![Page 13: Tutorial, Leiden August 2008 Introduction](https://reader034.vdocuments.pub/reader034/viewer/2022051316/56814992550346895db6d711/html5/thumbnails/13.jpg)
Tutorial, Leiden 18-20 August 2008
The Astro-WISE paradigmTARGET diagram: “raw to redshifts”
…and “redshifts to raw”
![Page 14: Tutorial, Leiden August 2008 Introduction](https://reader034.vdocuments.pub/reader034/viewer/2022051316/56814992550346895db6d711/html5/thumbnails/14.jpg)
Tutorial, Leiden 18-20 August 2008
What can be created in Astro-WISE…..
…and also retrieved (fits/csv/html/png/xml/python pickle …)
![Page 15: Tutorial, Leiden August 2008 Introduction](https://reader034.vdocuments.pub/reader034/viewer/2022051316/56814992550346895db6d711/html5/thumbnails/15.jpg)
Tutorial, Leiden 18-20 August 2008
Ordering the sea of data 1
• Projects, privileges and context– Data subdivided into projects
• Public projects: members are all Astro-WISE users (including anonymous)
• Private projects: members are subset of Astro-WISE users• within a project each object has a visibility privilege
1. only visible for the creator 2. visible for everyone in the project 3. visible for whole Astro-WISE 4. visible for the whole world 5. visible in the virtual observatory as well
• Context= project PLUS public data from all projects
![Page 16: Tutorial, Leiden August 2008 Introduction](https://reader034.vdocuments.pub/reader034/viewer/2022051316/56814992550346895db6d711/html5/thumbnails/16.jpg)
Tutorial, Leiden 18-20 August 2008
Ordering the sea of data 2
• Default behavior: ‘Newest version is best’• Calibration timestamps
time
![Page 17: Tutorial, Leiden August 2008 Introduction](https://reader034.vdocuments.pub/reader034/viewer/2022051316/56814992550346895db6d711/html5/thumbnails/17.jpg)
Tutorial, Leiden 18-20 August 2008
Tutorial programme: hands-on
• Ultimate goal tutorial– Launch Astro-WISE user community in Leiden – Erik central figure: local Astro-WISE contact
![Page 18: Tutorial, Leiden August 2008 Introduction](https://reader034.vdocuments.pub/reader034/viewer/2022051316/56814992550346895db6d711/html5/thumbnails/18.jpg)
Tutorial, Leiden 18-20 August 2008
LET’S DO IT