1

Combing 3D gesture with touch interface on mobile devices

指導教授：洪一平、余能豪學生：資工所碩二　吳　歡

2

Outline Problem Related works Our goal Experiment design

3

Problem: Touch Accuracy Fat finger / Occlusion Problem

Text selection Pins selection

5

Related works (1/3) Shift: A Technique for Operating Pen-Based

Interfaces Using Touch (CHI 2007, Daniel Vogel, Patrick Baudisch)

6

Related works (2/3) Back-of-Device Interaction Allows Creating

Very Small Touch Devices (CHI 2009, Patrick Baudisch)

7

Related works (3/3) Vision-based 3D Input Interface Technologies

(IDW 2010, Takashi Komuro)

9

In-air selecting technique1. move finger above the screen (orthogonal

mode)2. move finger w/ precision control (perspective

mode)

10

Methodology finger tracking:

x,y… how z-depth… how

air-tapping how

Apparutas iPhone 4S w/ front camera

11

Hypothesis The completion time of in-air selection is

shorter than that of Shift (baseline)

The error-rate of in-air selection is lessthan that of Shift

User preference? orthogonal or perspective mode

12

Experiment design Text editor – copy & paste

First-line selection *3 Middle-line selection *3 Across-page selection *3 Each has orthogonal / perspective mode

* show example pict

13

Thank you!