how cyberinfrastructure is helping hurricane mitigation students javier delgado (fiu) [presenter]...

25
How Cyberinfrastructure is Helping Hurricane Mitigation Students Javier Delgado (FIU) [presenter] Zhao Juan (CNIC) [presenter] Bi Shuren (CNIC) Silvio Luiz Stanzani (UniSantos) Mark Eirik Scortegagna Joselli (UFF) Javier Figueroa (FIU/UM) Advisors S. Masoud Sadjadi Heidi Alvarez Universidade de São Paulo Chinese American Networking Symposium. Oct. 20 – 22, 2008

Upload: reina-dillingham

Post on 02-Apr-2015

216 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: How Cyberinfrastructure is Helping Hurricane Mitigation Students Javier Delgado (FIU) [presenter] Zhao Juan (CNIC) [presenter] Bi Shuren (CNIC) Silvio

How Cyberinfrastructure is Helping Hurricane

Mitigation

StudentsJavier Delgado (FIU) [presenter]

Zhao Juan (CNIC) [presenter]Bi Shuren (CNIC)

Silvio Luiz Stanzani (UniSantos)Mark Eirik Scortegagna Joselli (UFF)

Javier Figueroa (FIU/UM)

AdvisorsS. Masoud Sadjadi

Heidi Alvarez

Universidade de São Paulo

Chinese American Networking Symposium. Oct. 20 – 22, 2008

Page 2: How Cyberinfrastructure is Helping Hurricane Mitigation Students Javier Delgado (FIU) [presenter] Zhao Juan (CNIC) [presenter] Bi Shuren (CNIC) Silvio

Outline

Background and Motivation Role of Cyber-infrastructure Project Overview Project Status Cyber-infrastructure Contributions Conclusion

Page 3: How Cyberinfrastructure is Helping Hurricane Mitigation Students Javier Delgado (FIU) [presenter] Zhao Juan (CNIC) [presenter] Bi Shuren (CNIC) Silvio

Background of Global CyberBridges

Improves technology training for international collaboration Software usage

Logistical issues (e.g. time zones, holidays, etc.)

Collaborate for the purpose of scientific advancement Visualization Modalities

Weather Prediction

Bioinformatics

Page 4: How Cyberinfrastructure is Helping Hurricane Mitigation Students Javier Delgado (FIU) [presenter] Zhao Juan (CNIC) [presenter] Bi Shuren (CNIC) Silvio

Hurricane Mitigation Background

Computationally Intensive

Improvement requires cross-disciplinary expertise

High Performance Computing Meta-scheduling

Resource Allocation

Work flow Management

Weather Modeling Weather Research and

Forecasting (WRF)Image Source: http://mls.jpl.nasa.gov

Page 5: How Cyberinfrastructure is Helping Hurricane Mitigation Students Javier Delgado (FIU) [presenter] Zhao Juan (CNIC) [presenter] Bi Shuren (CNIC) Silvio

Motivation

Hurricanes cost coastal regions financial and personal damage

Damage can be mitigated, but Impact area prediction is inaccurate Simulation using commodity computers

is not precise

Alarming Statistics 40% of (small-medium sized)

companies shut down within 36 months, if forced closed for 3 or more days after a hurricane

Local communities lose jobs and hundreds of millions of dollars to their economy If 5% of businesses in South Florida

recover one week earlier, then we can prevent $219,300,000 in non-property economic losses

Hurricane Andrew, Florida 1992 Katrina, New Orleans 2005 Ike, Cuba 2008

Page 6: How Cyberinfrastructure is Helping Hurricane Mitigation Students Javier Delgado (FIU) [presenter] Zhao Juan (CNIC) [presenter] Bi Shuren (CNIC) Silvio

Why Apply Cyberinfrastructure to Research & Learning?

Preparation for a globalized workforce

Innovation is now driven by global collaboration

Diverse (and complementary) expertise Enable transparent cyberinfrastructure In Global CyberBridges, students are the

bridges

Page 7: How Cyberinfrastructure is Helping Hurricane Mitigation Students Javier Delgado (FIU) [presenter] Zhao Juan (CNIC) [presenter] Bi Shuren (CNIC) Silvio

Hurricane Mitigation Project Overview

Goals High-resolution forecasts with guaranteed

simulation execution times

Human-friendly portal

High-resolution visualization modality

Page 8: How Cyberinfrastructure is Helping Hurricane Mitigation Students Javier Delgado (FIU) [presenter] Zhao Juan (CNIC) [presenter] Bi Shuren (CNIC) Silvio

High Resolution Hurricane Forecasting

We create: A distributed software model that can run on

heterogeneous computing nodes at multiple sites simultaneously to improve

Speed of results Resolution of the numerical model Scalability of requests by interested parties

In other words, we need to grid-enable WRF

WRF Information: http://wrf-model.org/index.php

Page 9: How Cyberinfrastructure is Helping Hurricane Mitigation Students Javier Delgado (FIU) [presenter] Zhao Juan (CNIC) [presenter] Bi Shuren (CNIC) Silvio
Page 10: How Cyberinfrastructure is Helping Hurricane Mitigation Students Javier Delgado (FIU) [presenter] Zhao Juan (CNIC) [presenter] Bi Shuren (CNIC) Silvio

WRF Portal

Page 11: How Cyberinfrastructure is Helping Hurricane Mitigation Students Javier Delgado (FIU) [presenter] Zhao Juan (CNIC) [presenter] Bi Shuren (CNIC) Silvio

WRF Portal

Page 12: How Cyberinfrastructure is Helping Hurricane Mitigation Students Javier Delgado (FIU) [presenter] Zhao Juan (CNIC) [presenter] Bi Shuren (CNIC) Silvio

Modeling WRF Behavior

An Incremental

Process

Paradox of computationally-intensive jobs: Underestimated execution time = killed job

Overestimated execution time = prohibitive queue time

Grid computing drawbacks Less reliable than cluster computing

No built in quality assurance mechanism

Hurricane prediction is time-sensitive, so it needs to work around this

Page 13: How Cyberinfrastructure is Helping Hurricane Mitigation Students Javier Delgado (FIU) [presenter] Zhao Juan (CNIC) [presenter] Bi Shuren (CNIC) Silvio

Modeling WRF Behavior

Meta-scheduler addresses the quality assurance issue

To predict execution time, model the software Pick a representative simulation domain

Execute it on various platforms with various configurations

Devise a model for execution time prediction and implement it in software

Test model

Adjust until prediction accuracy is within 10 percent

Page 14: How Cyberinfrastructure is Helping Hurricane Mitigation Students Javier Delgado (FIU) [presenter] Zhao Juan (CNIC) [presenter] Bi Shuren (CNIC) Silvio

Modeling WRF Behavior

Mathematical Modeling

ProfilingCode Inspection & Modeling

An Incremental

Process

Parameter Estimation

Page 15: How Cyberinfrastructure is Helping Hurricane Mitigation Students Javier Delgado (FIU) [presenter] Zhao Juan (CNIC) [presenter] Bi Shuren (CNIC) Silvio

Current Execution Prediction Accuracy

Adequate accuracy on multiple platforms Cross-cluster:

8-node, 32-bit Intel Cluster

16-node, 64-bit Intel Cluster

Different (simulated) CPU speed and number-of-node executions

Inter-cluster on MareNostrum Supercomputer of Barcelona Supercomputing Center Up to 128-nodes

MareNostrum Info: http://www.top500.org/system/8242

Page 16: How Cyberinfrastructure is Helping Hurricane Mitigation Students Javier Delgado (FIU) [presenter] Zhao Juan (CNIC) [presenter] Bi Shuren (CNIC) Silvio

Visualization Platform

Collaboration e-Learning

Cross-disciplinary video conferencing

Desktop sharing

High-resolution Visualization Built on top of the Scalable Adaptive Graphics

Environment (SAGE)

SAGE is developed by the cavern group at the Electronic Visualization Laboratory. # SCI-0225642# ANI-0225642

http://www.evl.uic.edu/cavern/sage/index.php

Page 17: How Cyberinfrastructure is Helping Hurricane Mitigation Students Javier Delgado (FIU) [presenter] Zhao Juan (CNIC) [presenter] Bi Shuren (CNIC) Silvio

Case in point – High resolution visualization

Page 18: How Cyberinfrastructure is Helping Hurricane Mitigation Students Javier Delgado (FIU) [presenter] Zhao Juan (CNIC) [presenter] Bi Shuren (CNIC) Silvio
Page 19: How Cyberinfrastructure is Helping Hurricane Mitigation Students Javier Delgado (FIU) [presenter] Zhao Juan (CNIC) [presenter] Bi Shuren (CNIC) Silvio

SAGE

Scalable Hundreds of Screens can be used

Built with high-performance applications in mind

Extensible Provides API for creating custom SAGE

applications

But this is also a problem Porting an application is not trivial There's a lot of applications out there!

Page 20: How Cyberinfrastructure is Helping Hurricane Mitigation Students Javier Delgado (FIU) [presenter] Zhao Juan (CNIC) [presenter] Bi Shuren (CNIC) Silvio

Enhancements to SAGE

Porting the Mozilla Firefox Web browser Many emerging applications are web-based The web browser is the platform Native SAGE Web Browser would give optimal

performance Remote Desktop Enhancement

A responsive remote desktop modality is essential for collaboration and e-Learning

Users can share their display for all collaborators to see

Non-portable applications can be displayed also

Page 21: How Cyberinfrastructure is Helping Hurricane Mitigation Students Javier Delgado (FIU) [presenter] Zhao Juan (CNIC) [presenter] Bi Shuren (CNIC) Silvio

Enhancements to SAGE (cont.)

Wii Remote input interface A traditional mouse makes it difficult to work with a

large display

Page 22: How Cyberinfrastructure is Helping Hurricane Mitigation Students Javier Delgado (FIU) [presenter] Zhao Juan (CNIC) [presenter] Bi Shuren (CNIC) Silvio

Global CyberBridges Overall Contributions

Weather Forecasting Students in different scientific fields from 3 different

continents exposed to the problem through a remote class

Grid-computing related methodologies for addressing these problems have been presented

Collaborative publications in progress

Visualization Based on the difficulties we had in the class, we are trying to

implement a cutting-edge e-Learning environment based on SAGE

We are working together to publish this work

Page 23: How Cyberinfrastructure is Helping Hurricane Mitigation Students Javier Delgado (FIU) [presenter] Zhao Juan (CNIC) [presenter] Bi Shuren (CNIC) Silvio

Conclusion

e-Learning is difficult, Primitive nature of videoconferencing software

Different time zones

Holiday and Vacation periods

Global collaboration Learning to work with people around the world is

essential. This has been the most valuable lesson

We have done important research in the process

Page 24: How Cyberinfrastructure is Helping Hurricane Mitigation Students Javier Delgado (FIU) [presenter] Zhao Juan (CNIC) [presenter] Bi Shuren (CNIC) Silvio

Acknowledgments

Global CyberBridges NSF CI-TEAM OCI-0636031

MareNostrum Supercomputer support NSF-PIRE OISE-0730065

Scalable Adaptive Graphics Environment (SAGE) NSF SCI-0225642, ANI-0225642

NSF research assistance grants: HRD-0833093, CNS-0426125, CNS-052081, CNS-0540592, IIS-0308155

Page 25: How Cyberinfrastructure is Helping Hurricane Mitigation Students Javier Delgado (FIU) [presenter] Zhao Juan (CNIC) [presenter] Bi Shuren (CNIC) Silvio

Thank You!

Any Questions?

Heidi Alvarez. Director, Center for Internet Augmented Research and Assessment. FIU ([email protected] )

S. Masoud Sadjadi. Professor and Co-PI of Global Cyberbridges ([email protected])

Javier Delgado, Research Assistant, FIU ([email protected])

Zhao Juan, Research Assistant, CNIC ([email protected])

Javier Figueroa, Research Assistant, FIU ([email protected])

Shuren Bi, Research Assistant, CNIC([email protected])

Mark Joselli, Research Assistant, UFF ([email protected])

Silvio Luiz Stanzani, Research Assistant, USP ([email protected])