Visualization TechnologyBasic

Masaki Hayashi

Nov.12, 2013Visualization of 3D CG

Lecture assigning

I will focus on the technical aspect of visualization.

• What, how and why is visualization? Steven Bachelder

• 3D CG basic and a tool usage Jonatan Österberg

• Technical issue of visualization Masaki Hayashi

Today’s lecture

Overview of visualization method

• Key issue of 3DCG visualization• Available technologies of visualization• Some show cases

(I will introduce the principles behind the technologies as much as possible)

Principle behind the technology

It is important to know the technical issue even if you are not a technical person.

TOOLInput Output

So that you can use the tool efficiently. Not to be cheated by a technician.

eg. Photoshop

Visualization

Very wide meaning

Creative visualizationFlow visualizationGeovisualizationIllustrationInformation graphicsvisual representations of informationInformation visualizationInteractive visualizationMusic visualizationScientific visualizationSoftware visualizationVisualization (computer graphics)

Visualization with 3DCG

To make a model Using CG tool (by Jonatan)

To digitize a real thing Digitization technique (by me)

1 Acquisition

Storage&

Network&

Computer

User interface

2 Representation

3 DisseminationDigitization, modeling

Display, Web

Three phases of visualization

Acquisition

• Filming Photograph

• Laser scanning Measurement by laser beam

• Photogrammetry Reconstruct geometry from multiple pictures

Filming

• Digital camera Resolution, White balance, Focal length, RAW data, Lighting

• Image scannerResolution, Color depth

• Panoramic image

Laser scanning

• Range: Small object, statue, ruin to city landscape

+ Aerial• Output: 3D point cloud x, y, z, + (i, r, g, b)• Multiple measurements:

Compensation of the shadow

IMView

ILRIS  Intelligent Laser Ranging and Imaging Systems3m – 1000m (Optech)

Peru (landscape), Hampson museum (artifact)

Minolta-Konica Vivid 9iExample: ScanView (CMU)

Photogrammetry

• Digital camera Multiple filming and software reconstruction• Range:

Same as scanner• Output:

3D point cloud + color x, y, z, r, g, b

• Compensation of shadow

Example: PhotoScan (Agisoft)

Acute3D

Representation

Device: PC Monitor Screen projection Head-mounted display

Images: 2D picture 2D panoramic image 3D CG

Virtual Museum

Real spaceImmersive VRBig displayAR

Web serviceFloor map navigationPanorama walkthroughArt work viewing3DCG walkthrough

Immersive display

HMD (Head Mounted Display)

Classic

Latest

Immersive display

CAVE (Cave Automatic Virtual Environment)

Comes with head tracking, stereoscopy, wand, multiple loudspeakers

Immersive display

ImmersaDesk

Comes with head tracking, stereoscopy, wand, stereo sound

Big display

4K / 8K

4K LCD Monitor (Astrodesign)60-inch

8K PDP Monitor (Panasonic)145-inch

8K projector (NHK)

Big display

Multi-display

Curved screen with 3 projectors (22m x 6m)(Toppan)

Big display

Cleveland Museum (12m x 1.5m)23 times HDTV with touch panel

Multi-display

AR ( Augmented Reality )

AR information service Google glass

Real image + CG

AR ( Augmented Reality )

A board with marker

Real image + CG

CG is composited in real-time

Panoramic display

Google Art Project

PERISCOPE ( DNP )

Panoramic movie

Web service

360-degree image, floor plan navigation, information display

Louvre Virtual Tourshttp://musee.louvre.fr/visite-louvre/index.html?defaultView=rdc.s46.p01&lang=ENG

Web service

Panorama view, view point transition, information display

Smithsonian National Museum of Natural History

http://www.mnh.si.edu/vtp/1-desktop/

Web service

Google Art Project

Panorama view + view point transition(same technique used in Street View)

http://www.google.com/culturalinstitute/collection/van-gogh-museum?projectId=art-project&source=maps.sv

Web service

Google Art Project

Detail observation mode + related information

Web service

3DCG walkthrough

GRAPHTWERK

http://3dstellwerk.com/en/

( UNITY based 3D walkthrough )

Web service

http://www.3dancientwonders.com/index.php

3D Ancient Wonders (Shockwave Player, UNITY )

3DCG walkthrough

Web service

http://hampson.cast.uark.edu/

The Virtual Hampson Museum ( VRML, PDF, OBJ data )

3DCG object handing

Dissemination

There is not so many technical issueRather cultural issue

• Devices for users: PC, Tablet, Smartphone, etc.

• Ways of reaching: Web, Internet, Mobile, etc.

• User interactions: Keyboard, Touch screen, Voice control, Haptic device, etc.

Dissemination

Some keywords

Links Tagging Rating (likes) Keyword searching Personalization Community SNS

Example of social tagging(from Steve Project)

Dissemination

http://www.getty.edu/mygetty/The J. paul Getty Museum“My Getty” Bookmarks

Examples of virtual museum

http://www.culture.gouv.fr/documentation/joconde/fr/

JocondePortal collections of museums in France500,000 objects

Artefacts Canada 3,000,000 objects

http://www.pro.rcip-chin.gc.ca/artefact/index-eng.jsp

http://tagger.steve.museum/Steve Project“Steve tagger” social tagging