Question: What is HCI ?1.How Can I?2.Help Crime Increase3.Host Controller Interface4.Human Computer Interaction5.Hya~ Cho~ hosiii~ I-Pad!!

Chat

Law

Network

Software

?????

InteractionHCI -Human Computer InteractionUser Interaction DesignHuman ModelingUser Interface & DevicesHuman Computer InteractionUser Interface & Devices

InteractionUser Interaction DesignHuman ModelingUser Interface & DevicesCUI - Character User Interface

MS DOSLinuxGUI - Graphical User Interface

WIMP interaction=Window Icon Menu PointerMS WindowsMax OSX WindowUser Interface & Devices

http://www.saunalahti.fi/janij/blog/images/2008_nov_windows_1_0.pngMS Windows 1.01 (1985~)GUI, Multi-tasking User Interface & Deviceshttp://osxbook.com/book/bonus/ancient/vpc/images/win21.gif

MS Windows 2.1 (1988~)Overlaps of windows, Mini-Maximum buttons User Interface & DevicesQuestion: Which looks Pressed ?User Interface & Devices1.OK2.OKhttp://catb.org/~esr/writings/taouu/html/graphics/win30progman.png

MS Windows 3.0 (1990~)16 colors, Multimedia support (CD-ROM, sound) User Interface & Deviceshttp://cybernetnews.com/wp-content/uploads/2006/10/Windows95.jpg

MS Windows 95 (1995~)Start menu, Task bar, Desktop folder User Interface & DevicesTrue-color, Drop shadows, Soften appearancehttp://www.winsupersite.com/images/reviews/wxp_rtm_home_004.gif

MS Windows XP (2001~)User Interface & Deviceshttp://www.otterbein.edu/ITS/images/vista-screen.jpg

MS Windows Vista (2007~)Aero interface, Side bar &GadgetsUser Interface & Deviceshttp://screenshots.winfuture.de/Windows-7-Build-6.1.7048-1235994358.jpgMS Windows 7 (2009~)

Peek, Shake, Snap, Windows TouchUser Interface & DevicesPUI - Perceptual User InterfaceSignlanguageDGTech VHand (Data Glove)

EyetrackingNAC EMR9

Hands are the new remote controlhttp://news.bbc.co.uk/1/hi/programmes/click_online/7820866.stmVoiceMS Speech

User Interface & DevicesTUI - Tangible User InterfaceWUI Web User Interface

BUILD-IT, Morten Fjeld et al.

IE, Firefox etc.

User Interface & Devices15BMI - Brain Machine InterfaceBrain waves

Monkey's brain controls armhttp://news.bbc.co.uk/2/hi/science/nature/7426822.stmUser Interface & DevicesImmersive EnvironmentCAVE SystemeMagin Z800 3DVisor (Head-mounted display)

Wikipediahttp://en.wikipedia.org/wiki/Cave_Automatic_Virtual_EnvironmentRemote Impact game in actionhttp://news.bbc.co.uk/go/em/fr/-/2/hi/uk_news/scotland/7423404.stmUser Interface & DevicesCurrent trendsMR - Mixed Realitymixture between reality and virtualityUniversal Accesskidsyoung peopleelderly peoplepeople with special needsUser Interface & DevicesAugmented reality apps for mobile phoneshttp://news.bbc.co.uk/2/hi/programmes/click_online/8424412.stm

InteractionUser Interaction DesignHuman ModelingUser Interface & DevicesUser Interaction Designa keyboard andscreen1D DataEx. CharactersIn the past,Information SpaceCUIInteractionIS+ a mouse2D~ DataEx. images, music, movies, 3D movies etc.InteractionGUI(WIMP)ISPUI, TUI,BMI, CAVE,HMD etc.User Interaction DesignNowadays,???Got Lost !Get-Lost ProblemQuestion: Do you know how to use it ?1.

User Interaction DesignQuestion: Do you know how to use it ?2.

User Interaction DesignQuestion: Do you know how to use it ?3.

User Interaction DesignAffordance a perceptual manifestation of what users can do by using the object or technique.Constraints a perceptual manifestation of what users cannot do by using the object or technique.User Interaction Design

from D. A. Bowman et al. , 3D User Interface ~theory and practice~, Addison-WesleyCurrent trends (1/4)User (Experience)-centered designintuitive to use. Ex. doors, light switches, glasses, mouseuse of metaphor. Ex. desktop metaphor

Hierarchical Data ViewerDrawer Metaphor,Mr. Ueno, FIT, 2007

Network Nodes Viewer,Natto Metaphor, Dr. Shiozawa et al., 1997Mobile Control PanelWavelet Metaphor, Dr. Francone et al., 2010

User Interaction Design

HMDCurrent trends (2/4)

Word processor

SpreadsheetCAVE!=Task-centered design!=Equipment-centered designuses the advantage of equipment.Ex. CAVE Immersive env. Viewing 3D volumetric data Ex. HMD Stereo Working in a 3D env.User Interaction DesignUser friendly design (~ Universal Access)easy to useEx. systems designed for kids, young people and elderly people Current trends (3/4)A touch screen system (~multi-touch)where you touch is where you pointdirect manipulationUser Interaction DesignApple's iPad touchscreen computerhttp://news.bbc.co.uk/2/hi/technology/8484823.stmThe good and the bad of the new iPadhttp://news.bbc.co.uk/2/hi/programmes/click_online/8487728.stmQuestion: What is your gesture ?1.User Interaction DesignBefore After from Prof. D. Wigdor (Microsoft) as Invited talk, AVI2010, Roma, Italy28Question: What is your gesture ?2.User Interaction DesignBefore After from Prof. D. Wigdor (Microsoft) as Invited talk, AVI2010, Roma, Italy29Question: What is your gesture ?3.User Interaction DesignBefore After from Prof. D. Wigdor (Microsoft) as Invited talk, AVI2010, Roma, Italy30Augmented cognitionadapts the user interface to the state of peopleCurrent trends (4/4)

>java >java

User Interaction Design

InteractionUser Interaction DesignHuman ModelingUser Interface & DevicesHuman Modeling

Human factorunderstands peoples abilityPeople Finite capacity of short-term memoryChildren Short attention spansNovices Lack on knowledgePeople with special needs Point of view of what works

Human ModelingHuman ModelingCurrent trends (1/2)Cognitive Psychologystudies how people mentally represent informationEx. graph and set representation etc.Ex. flow chart, Gantt chart, arrow diagram etc. Human ModelingCognitive Ergonomicsanalyses the process of thinking, understandinghelps people perform cognitive tasks (describing making-decision)Ex.Current trends (2/2)Make decisionClarify problemConsider optionsPositivesWhich outweighs which?Negatives

My Research WorkExperience-centered design

M. Ishihara et al, Porthole: A spatial interface to provide scrolling, zooming-in, and zooming-out, 2005Window Metaphor ~ ScrollWindow Metaphor ~ Zoom

My Research WorkUser friendly design & Direct manipulationM. Ishihara et al, Fingertip-shadow for click, db-click, and drag on a wall, 2005Map Viewer on ProjectionMS Paint on Projection

Poster session

Oral session

International Conf.Demo

Spherical DisplayMicrosoft ResearchUIST2008, Monterey, CA, USASMART TableSMART TechnologiesUIST2008, Monterey, CA, USAExhibitionInternational Conf.

Banquets

Ethnic dance and musicEthnic danceBanquets, IASTED, Innsbruck, AustriaInternational Conf.

Palatine HillThe ColloseumInternational Conf.

GlacierInternational Conf.

VenetiaSwarovski CrystalAircraft carrierMIDWAY

Innsbruck townPhysical realityAugmented realityAugmented virtualityVirtual reality

Mixed reality

Buildings

Quake IMixed RealityPhotos from ARQuake project, Wearable Computer Lab, University of South Australia

Mixed RealityAR ToolkitSoftware library to build an AR environment.FreewareC, OpenGLG

overlayDemo