Integrated Development Environment of

Software design and Space design.

Yasuto NakanishiKeio University / JST Presto

中西 泰人慶應義塾大学/ 科学技術振興機構

Research Area

• Interaction Design at Mobile / Ubiquitous / Urban Computing, and Interactive Art

• as System of Systems : Information Systems ＊ Space

Operation, Action, Inter-action

Space(City, Architecture)

Information Systems( Computer, Network, Smart Phone etc.)

Integration of Software Design and Space Design

Research Area

Operation, Action, Inter-action

Space(City, Architecture)

Information Systems( Computer, Network, Smart Phone etc.)

Interaction Design

Creative Work Support

CityCompiler

EnhancedDesk/Table/Movie（1998 - ）• Augmented desk interface system using Finger Tracking System

• Direct operation of digital objects

• Integration real objects and virtual objects

EnhancedDesk/Table/Movie（1998 - ）• Using Larger space

• Using a table : from Personal tool to Group tool

• Using a Larger desk : moving an arm as an input

EnhancedTable EnhancedMovie

Same Technology, Different Space : Different Interaction

Finger TrackingSystem

Personal Desk

EnhancedDesk

Finger TrackingSystem

Large Desk(for movie editing)

EnhancedMovie

Finger TrackingSystem

Table

EnhancedTable

EnhancedWall（2002 -）• Perceptual User Interface using Face Tracking System

• tracking 3D position and orientation of a user’s face

• using the face as a pointing device

EnhancedWall（2002 -）• Using Larger Space

• 19 inch -> 100 inch

• from Personal tool to Public tool

Same Technology, Different Space : Different Interaction

Head TrackingSystem

19 inch Display

19 inch Enhanced Wall

Head TrackingSystem

100 inch Screen

100 inch EnhancedWall

on a Desk

on a Wall

Afterglow• a laser drawing system designed by takram design• It consists of a projector, a camera, a laser pointer,• enables to drawing a illustration on a projected image.• http://takram.com/#/portfolio/Afterglow

LaserTag• a laser drawing system designed by Graffiti Research Laboratory• It consists of a projector, a camera, a laser pointer,• enables to drawing a illustration on a projected image.• http://graffitiresearchlab.com/

•

Same Technology, Different Space : Different Interaction

Laser, Camera,Projector, Image Processing

LaserTag

Laser, Camera,Projector, Image Processing

a Screen

Afterglow

a Wall

in a Room

of a Building

View

Controller

Model

5. 出力

1.入力

３. 呼び出し

4. 参照

2. 命令

• Spatial Information Systems: Model View＊Space Controller Model

Spatial Information SystemSoftware design ＊ Space Design• WMP systems with GUI : Model View Controller Model

View

Model

5. 出力

1.入力

３. 呼び出し

4. 参照

2. 命令Controller

CityCompiler : Overview

Google Sketch Up

A(t+1)Cs(1)

Ci(1)

Cs(2)

Ci(2)Compile編集

Ci(3)

Cs(3)

SoftwareDesign

SpaceDesign

Model, View・Space, Controller

Java Monkey Engine

A(t+1)

C(1.5)

E(t+1)

an integrated environment for iteration-based development of spatial interactive systems

installation into the real world

Processing

CityCompiler : Class Diagram

CityCompiler

SimpleGame

DisplayTest

SensorManager

Camera DistanceSensor

SensorDisplay ProjectorModel

Node

Class Library of CityCompiler

PApplet

3D model

NodeController

CityCompiler : Demo• Beijing National Aquatics Center, Water Cube, 北京国家游泳中心

• Blue Big Bubbles

• Light Up at night.

• Projecting of more bubbles in CityCompiler.

GreenPix The Zero energy Media wall by by Simone Giostra & Partners and Arup

• a media wall in Beijing

• http://www.greenpix.org/

• each pixel : LED + solar battery

• integration of sustainable technology and media technology

Operation, Action, Inter-action

Space(City, Architecture)

Information Systems( Computer, Network, Smart Phone etc.)

Integration of Software Design and Space Design

Model, View, ControllerSpace

Space

CityCompiler