hci 입문 graphics lab. @ korea university hci system 2005 년 2 학기 김 창 헌

HCI HCI 입문입문

http://kucg.korea.ac.krhttp://kucg.korea.ac.kr Graphics Lab. @ Korea UniversityGraphics Lab. @ Korea University

HCI SystemHCI System

20052005 년 년 22 학기학기

김 창 헌김 창 헌

KUCG

22http://kucg.korea.ac.krhttp://kucg.korea.ac.kr Graphics Lab. @ Korea UniversityGraphics Lab. @ Korea University

Contents

Graphical Input DevicesGraphical Input Devices

VR System AnatomyVR System Anatomy

VR ApplicationsVR Applications

ProblemsProblems

KUCG


Contents




ProblemsProblems

KUCG


Graphical Input Devices

Logical Input Logical Input

DevicesDevices

3D Input Devices3D Input Devices

KUCG


Logical Input Device Types (1 / 2)

KeyboardKeyboard Returns keys with specific meaningsReturns keys with specific meanings

KUCG


Logical Input Device Types (2 / 2)

ValuatorValuator Returns a value for somethingReturns a value for something

LocatorLocator Returns the location of the screen cursorReturns the location of the screen cursor Display-to-Input ratioDisplay-to-Input ratio

KUCG


Graphical Input Devices

Logical Input DevicesLogical Input Devices

3D Input Devices3D Input Devices

KUCG


3D Input Devices

Position trackersPosition trackers GlovesGloves OthersOthers

KUCG


Position Trackers (1 / 2)

Body parts to be trackedBody parts to be tracked Hand, fingerHand, finger EyeEye HeadHead Whole bodyWhole body

KUCG


Position Trackers (2 / 2)

Performance specificationsPerformance specifications Static accuracyStatic accuracy Dynamic accuracyDynamic accuracy LatencyLatency Update rateUpdate rate Signal to noise ratio (SNR)Signal to noise ratio (SNR) RegistrationRegistration

KUCG


Tracking Methods

MechanicalMechanical MagneticMagnetic OpticalOptical

Stereo, multiple camerasStereo, multiple cameras Time-of-flight, phaseTime-of-flight, phase Structured lightStructured light

AcousticAcoustic GPSGPS Research issuesResearch issues

Tracking and predictionTracking and prediction Sensor fusionSensor fusion

KUCG


Force Feedback in 3D (1 / 2)

KUCG


Force Feedback in 3D (2 / 2)

KUCG


Force Feedback in 2D

KUCG


Contents




ProblemsProblems

KUCG


Functional Diagram

Displaying

VWAuthoring

Sensing VirtualPerception

Interaction

Simulation

Rendering

VWDB

KUCG


Modules

SensingSensing Virtual perceptionVirtual perception InteractionInteraction SimulationSimulation RenderingRendering DisplayingDisplaying Virtual world DBVirtual world DB

KUCG


Sensing and virtual perception

Displaying

VWAuthoring


Interaction

Simulation

Rendering

VWDB

KUCG


Sensing and virtual perception

SensingSensing Physical sensors of the conceptual modelPhysical sensors of the conceptual model

Virtual perceptionVirtual perception Transition from the physical sensors to the Transition from the physical sensors to the

logical sensorslogical sensors

KUCG


Sensing and virtual perception (con’t)

Image processor

Speech recognition

Facial/face expressionrecognition

Body gesturerecognition

Hand gesturerecognition

Controller

Image processor

Video camera

Signal processorMicrophone

Video camera

Glove

Sensing Virtual Perception

KUCG


Interaction

Displaying

VWAuthoring


Interaction

Simulation

Rendering

VWDB

KUCG


Simulation (1 / 2)

Displaying

VWAuthoring


Interaction

Simulation

Rendering

VWDB

KUCG


Simulation (2 / 2)

Change the virtual worldChange the virtual world According to the interactionAccording to the interaction

Kinematic simulationKinematic simulation Dynamic simulationDynamic simulation

KUCG


Displaying

VWAuthoring


Interaction

Simulation

Rendering

VWDB

Rendering (1 / 2)

KUCG


Rendering (2 / 2)

Rendering the simulated Rendering the simulated resultsresults

PerceptualizationPerceptualization

Image renderingImage rendering Sound renderingSound rendering Haptic renderingHaptic rendering

OthersOthers

Flat

Gouraud

Phong

KUCG


Displaying (1 / 2)

Displaying

VWAuthoring


Interaction

Simulation

Rendering

VWDB

KUCG


Displaying (2 / 2)

Stereo ImageDisplay

Headphone

Haptic Display

Stereo ImageGeneration

3D SoundGeneration

Haptic SignalGeneration

KUCG


Virtual World DB (1 / 2)

Displaying

VWAuthoring


Interaction

Simulation

Rendering

VWDB

KUCG


Virtual World DB (2 / 2)

Representation of virtual worldsRepresentation of virtual worlds Scene graphScene graph

Big issueBig issue Expressiveness vs. efficiencyExpressiveness vs. efficiency

KUCG


Contents




ProblemsProblems

KUCG


Some VR Applications

EntertainmentEntertainment Augmented RealityAugmented Reality TrainingTraining Remote RoboticsRemote Robotics Distributed Distributed

collaborationcollaboration VisualizationVisualization

KUCG


Entertainment

Definitely the biggest Definitely the biggest marketmarket

The main force for driving The main force for driving down prices on VR down prices on VR hardwarehardware ex) Game with other ex) Game with other

computers / playerscomputers / players

KUCG


Augmented Reality (1 / 4)

Bridging virtual environment and real Bridging virtual environment and real worldworld

RealEnvironment

VirtualEnvironment

Augmented Reality

AugmentedVirtuality

KUCG



Display virtual object on real backgroundDisplay virtual object on real background

KUCG



Ultra sound ApplicationVirtual Surgery

Augmented-reality displays will overlay computer-generated graphics onto the real world

KUCG



Agent-augmented RealityLocation-aware Interactive Navigation/Guidance system

KUCG


Training (1 / 2)

When the cost of a mistake in real world is When the cost of a mistake in real world is very highvery high ex) Aircraft simulators, pilot training systems, ex) Aircraft simulators, pilot training systems,

surgery simulatorsurgery simulator

KUCG


Training (2 / 2)

Flight simulator

KUCG


Remote Robotics

Remote Robotics in Remote Robotics in Hazardous Hazardous

EnvironmentEnvironment

KUCG


Distributed Collaboration (1 / 2)

More collaborativeMore collaborative Than by telephone or video conferencingThan by telephone or video conferencing

Virtual Conferencing

KUCG


Virtual Battles Collaborative Design

Distributed Collaboration (2 / 2)

KUCG


Visualization (1 / 4)

VR as a visualization research toolVR as a visualization research tool

KUCG



KUCG


Contents




ProblemsProblems

KUCG


Problems

CostCost

What’s it good for?What’s it good for? None of the existing systems can solve None of the existing systems can solve

common everyday problemscommon everyday problems

Display resolutionDisplay resolution

Update speedUpdate speed

hci 입문 graphics lab. @ korea university hci system 2005 년 2 학기 김 창 헌

Documents