Agenda Microsoft Research im Überblick Bildungsrelevante Forschungsbereiche:• Taktiles Lernen• Mensch-Maschine Interaktion• Lernen ohne Sprachbarriere Ausblick

Research Areas

Programming Principles & ToolsFormal Methods. Programme Structures.

Programming Systems. Constructive Security.

Constraint Reasoning.

Systems & NetworkingDistributed Systems. Networking. Operating

Systems.

Computational ScienceBiological Computation. Computational Ecology

& Environmental Sciences.

Human Experience and DesignIntegrated Systems. Interaction Design.

Devices and Applications.

Machine Learning & PerceptionComputer Vision. Machine Learning.

Online Services & Advertising. Economics

& Algorithms.

MSR TechnologiesInteractive 3D. Sensors and Devices.

Microsoft Research Outreach

• Doktorandenstipendien

• Kollaborative Forschungszentren

• Sommer Schule für Doktoranden und andere Ereignisse

• Unterstützung für Akademiker und Konferenzen

• Microsoft Auszeichnungen

• Azure4Research Programm

•

•

•

•

Joint Research Centres in EMEA

Microsoft Research INRIA

Joint Centre, France

Software Security

Formal Methods

Microsoft Research EPFL-ETHZ

Joint Research Centre, Switzerland

Computer Science

• Moscow State University

• IMDEA

• Barcelona Supercomputing Centre

• University of Trento – COSBi

• Koҫ University

••••

1.

2.

3.

4.

5.

6.

7.

http://www.msr-inria.fr/

1.

2.

3.

4.

5.

6.

7.

8.

9.

10.

11.

Four research areas1. Computer Vision and Medical Imaging

2. Formal Methods for Mathematics, Distributed

Systems and Security

3. Machine Learning and Big Data

4. Social Information Networks and Privacy

• A rapid prototyping platform for small electronic

devices

• “Low threshold” – easy to get started

• “High ceiling” – can do complex things too

What is .NET Gadgeteer?

Modular Hardware

Software Tools

Physical Design

The .NET Gadgeteer Platform

Programming your hardware

Cardboard enclosure (digital camera)

Cardboard enclosure (toy bear)

Laser-cut enclosure (digital camera)

3D-printed enclosure (toy bear)

.NET Gadgeteer in the classroom

Five pilot studies

2011/12 school year

2x UK, 11-17 year-olds

– 16x 2ndary schools

– Extra-curricular

– Groups of 3-4

– ~8 hours of structured activity

– 2-4 hours open-ended

.NET Gadgeteer in the classroom

.NET Gadgeteer in the classroom

Greneway walking stick

Excepted from The Daily Telegraph 28 Feb 2013:

Demonstrated by Fujitsu at Mobile World Congress in Barcelona, the ‘Next Generation Cane’ can sense whether it is being held, sounding an alert or sending an email if it is unexpectedly dropped.

The walking stick can be located online. Other sensors monitor heart rate, temperature and humidity.

Photos from Pocket Lint

+

=

Instant Inkjet Circuits: Lab-based Inkjet

Printing to Support Rapid Prototyping of

UbiComp Devices, in UbiComp '13. Best

paper award.

0

0.5

1

1.5

2

2.5

10 sec 10 min 10hSh

eet

Re

sist

ance

(O

hm

/sq

)

Resitance Change After Printing

Mitsubishi (1mm x 50mm)

Mitsubishi (0.5mm x 50mm)

Mitsubishi (0.25mm x 50mm)

Kodak (1mm x 50mm)

Kodak (0.5mm x 50mm)

Kodak (0.25mm x 50mm)

Printed Pattern

Sheet resistance change after printing

+ =

Circuit Stickers: Peel-and-Stick Construction

of Interactive Electronic Prototypes, in CHI 2014.

Building Functional Pervasive Computing Prototypes

using Conductive Inkjet Printing,

to appear in IEEE Pervasive Computing magazine

• A project to create a set of tactile

programming blocks for children

ages 7 – 11 inclusive of those with

visual impairment.

• An application that uses the

blocks to program live musical

compositions as a way of learning

basic programming concepts.

• A focus on collaborative coding.

Project

Torino

Learning to see the human form – why is it hard?

configuration shape

size appearance clutter

top view

side view

depth image

(camera view)

The Kinect camera

Tracking

slow movement

time (t+1)time t time (t+2)

faster movement

?

Smooth, realistic output

Initialisation

Prone to catastrophic failure

Our solution: body part recognition

• Local pose estimate of parts each pixel & each body joint treated

independently

reduced training data and computation time

• No temporal information frame-by-frame

• Very fast simple depth image features

parallel decision forest classifier

right

elbow

right hand left

shoulderneck

infer

body parts

per pixelcluster pixels

predictions

into body joint

hypotheses

The Kinect pose estimation pipeline

capture

depth image

fit skeleton

Fast depth image features

• Depth comparisons very fast to compute

input

depth

image

desired

body parts

xΔ

xΔ

xΔx

Δ

x

Δ

x

Δ

Background pixelsd = large constant

Learned body tracking

front view top viewside viewinput depth inferred body parts

Kinect – vision systems that learn

From GUIS to NUIs to Ubiquitous Computing

o Multi-touch and gesture-based interaction

paradigms bring computing out of the desktop

and into the world

o Extension of the input space (could include voice,

eye gaze, even brain waves…)

o Changing our choices about how we interact with

computers

Gestural Interaction in Surgery

(St Thomas’ hospital, London; Kings College, London; Lancaster University; Microsoft Research)

Visualising medical images using touchless interaction

Multiple Interfaces in Medical Practice

o Getting the interaction right

o Defining a good vocabulary and ergonomically sound system

o Design to distinguish gestures for the system from ordinary gesturing

o Designing for teamwork

o Distinguishing gestures for collaboration from

gestures for control

o Hierarchies hold

o Multiple input zones mean multiple interfaces

Multi-touch Research (2005-2007)

Multi-touch Research (2005-2007)

3D Surface Computing (2008-2009)

[Hilliges, Kim, Izadi, Weiss, Wilson. CHI’12.]

Holodesk

3D Room Scanning (2010-)

KinEtre

Chen, Izadi, Fitzgibbon, Animating the world with your body, UIST 2012

Translation solutionwww.bing.com/translator

Web widget

Customers and

partners

• Translation Memory ISVs

• Social: Facebook, Twitter…

• E-commerce: eBay, Rakuten…

• Enterprise customers: Financial, IT,

Pharma, industrial…

Translation as a feature

Bing Bar for IE

Translate

Bookmarklet

Skype Translator in eduction

SchlusswortTechnologien, die Einfluss haben könnten auf

• Was man lernt Im Informatikunterricht, aber auch im Sprachunterricht

• Wie man lernt “Ubiquitous Computing” und “Internet of Things”

• Wie wird sich der Arbeits-/Schulalltag verändern?

• Wir wird sich unsere Wahrnehmung der physischen und digitalen Welt verändern?

• Was sind die längerfristigen Folgen?

“There are large challenges in scaling the

performance of software now. The question is:

‘What’s next?’“

“We took a bet on programmable hardware.”

Doug Burger,

Microsoft Research

2x

Microsoft Azure for Research

www.azure4research.com

Microsoft Azure for Research Group

@azure4research & #azureresearch

Award Programfor a free year

of Azure services

Online videos for quick,

on-demand training

Technical papers with in-depth

instructions

Case studiesshowing how researchers

use Azure today

Hands-on training from specialized

Azure experts