the trends of ar/vr industry and technology - 職業訓練局 · pdf file• reports said...

Copyright 2016

All Rights Reserved

CHUN-YUN HOU(Alex Hou,侯鈞元)

Project Manger of IEK

Industrial Technology and Research Institute

2016/10/15

The Trends of AR/VR Industry and Technology

THE RISE IN VR&AR TECHNOLOGY

eA 2016

1 1 Copyright 2016

All Rights Reserved

What are VR/AR/MR ?

Think of MR, if the virtual avatar is……

– controlled by a real man remotely.

– an AI robot (Siri ? The Matrix ?)

source：Magic Leap(2015)

MR Mixed Reality

2 2 Copyright 2016

All Rights Reserved

Is Pokémon a AR or MR game ?

3 3 Copyright 2016

All Rights Reserved

Types of AR/VR HMD

Phone-based HMD Wireless HMD Tethered HMD

Microsoft HoloLens(AR/MR)

Intel Project Alloy(VR/MR)

HTC Vive (VR)

source：ITRI-IEK(2016)

Non

See-Through

HMD

Optical

See-Through

HMD

Digital

See-Through

HMD

Samsung Gear VR

Phone-based MR ?

4 4 Copyright 2016

All Rights Reserved

3 Groups HMD = 3 Market Segment

source：ITRI-IEK(2016)

效能

成本/價格

Wireless HMD

HoloLens $3000

Tethered HMD HTC Vive $799 (+$1000 PC)

almost free

about ~$30 Low-end HMD

High-end HMD

about $100

Phone-based HMD

Intel Project Alloy(VR) (about $800~1000)

5 5 Copyright 2016

All Rights Reserved

(Maybe All) Smart Phone Vendors will

provide Phone-Tethered VR HMD

• Mid and high-end smart phone makers provide VR HMD as a accessory

that only fitting their phones.

• But there is no obvious evidence of VR accessories can rise the sales.

• We believe that phone vendors will keep providing VR HMD in the

future as a differentiation.

LG G5 and LG 360 VR Samsung S7 and Gear VR

6 6 Copyright 2016

All Rights Reserved

The Biggest Problem of Tethered HMD

is PC ?

• 40M users can play Sony VR games on their PS4.

• Only 1% PCs (13M) can run Oculus Rift well.

• PC-Tethered VR requires about 7 times the graphics processing power

compared to traditional 3D applications and games

Source：Sony(2016),Bloomberg,NVidia(2016)

Sony PlayStation 4 has sold 40 million units Only 1% PCs in the world can run HTC Vive

7 7 Copyright 2016

All Rights Reserved

Wireless HMD faces many challenges trade-off between performance and battery

Source：AMD(2016),Microsoft(2016)

Sulon Q VR Microsoft HoloLens AR

• Runs Windows10

• AMD FX-8800P GPU

• 256GB SSD

• 2560X1440 Display

• Battery time ?

• Price ?

• Performance ?

• Runs Windows10

• CPU：Intel Atom x5-z8100

• HPU (holographic processing

unit)

• 2GB RAM

• 64GB SSD

• Battery：16.5Wh

• Battery time：2hr

Lack of outside tracking system

VR performance is lower than

tethered VR.

8 8 Copyright 2016

All Rights Reserved

Facebook：All interactions can be VR

Social VR= Multi-User VR • Now we know why Facebook bought Oculus.

• Facebook believe that all social interactions can be happen wherever

they are by using VR technology.

• Oculus and Vive are one person VR, and next Oculus will be MULTI-

USER VR.

• Facebook are working at technologies that capturing people into VR.

Source：Facebook(2016)

One user VR

Cooking by himself.

Multi-user VR

Traveling with friends remotely.

9 9 Copyright 2016

All Rights Reserved

MS HoloLens focus on Enterprise Market

very high price

• HoloLens is a complete AR ecosystem based on Windows 10.

• The platform name is Windows Holographic，runs AR apps such as

HoloStudio、HoloBuilder、Skype。

• HoloLens is the first hardware for Windows Holographic.

• HoloLens will be shipped in 2016, priced at $3000.

• Due to the high cost of HoloLens and the fail of Google Glass,

Microsoft will focus on B2B markets first.

Windows Holographic

Windows 10

HoloLens

HoloStudio HoloBuilder

others

apps

Other makers

Microsoft HoloLens

B2B Market

B2C Market

Source：Microsoft (2016)

?

10 10 Copyright 2016

All Rights Reserved

the same as Google Glass (wait, where is Google Glass?)

Google Glass at Work Solution Providers

Source：Google(2014)

telemedicine, live-surgery

demonstrations, and remote

medical training

hands-free, real-time

access to enterprise

data

brings real-time, hands-free

information to the deskless

workforce through tailored supply

chain, warehousing, logistics,

distribution, and retail solutions.

glass based Electronic Health

Record

provides breathtaking content for

live broadcasts and context-aware

applications for the sports,

entertainment, building/security,

and medical industries

for museums and cultural

institutions

a secure video

communication platform for

Glass used by healthcare

providers, medical device

companies, and large

enterprises to support front-

line staff

hands-free notifications

and tools to improve

business efficiency,

save time, and money.

workflow, communications, training, and

data access products

for energy, manufacturing, healthcare,

order picking,

manufacturing, quality

assurance, healthcare


All Rights Reserved

Technology Block Diagram of AR/VR

ENVIRONMENT

(local)

AR/VR

ENGINE USER

OUTPUT

INPUT SCAN

CREATE

Source：ITRI-IEK(2016)

TRACK

USER

(remote)

• Virtual Content

• Filmed by 360 camera AR/VR HMD

•controller

•hand gesture

•camera

•laser

• SLAM

• Motion capture

SLAM：simultaneous localization and mapping


All Rights Reserved

Input Tech Trends From Controller to Gesture

source：Leap Motion(2015),Kickstarter(2016)

Application-oriented controller Gesture-based input system

feedback

Hand controller can do

limited actions.(75%)

Not intuition for VR.


All Rights Reserved

Create Tech Trends

360 camera on phone?

Professional 360 camera

10~40 lens Handy 360 camera

2 lens

Mobile Phone 360

camera ?

2 lens ?

Lens ,Cost , Image Quality

?


All Rights Reserved

Output Tech Trends From 1K to 16K Display in VR

• Oculus Palmer Luckey said 8K per eye is enough for VR.

• AMD will aim at 16K resolution for VR.

• VR products shipped in 2016 are just 1K per eye.(1080x1080)

• Higher resolution brings more computing consumption.

• it’s difficult to rise resolution for near years.

16K

Source：Oculus,AMD(2016)

StarVR 5120 x 1440


All Rights Reserved

Scan Tech Trends 3D SLAM for HMD

AR/MR need 3D SLAM(Simultaneous localization and mapping) to build 3D model of

the room space. Thus virtual things can interact with the real world.

source：Microsoft,Magic Leap(2015)


All Rights Reserved

Scan Tech Trends

Capturing People into VR World=Teleporting

• Microsoft Research’s Interactive 3D Technologies (I3D) team has developed Holoportation with the HoloLens

• People in two difference places teleporting into the same room using HoloLens and interacting with each other

• Holoportation is a new type of 3D capture technology that allows high-quality 3D models of people to be reconstructed, compressed and transmitted anywhere in the world in real time.

Virtual meeting in sci-fi movies Microsoft Holoportation

Source：Microsoft(2016)


All Rights Reserved

Maybe the First VR Experience

in the world. Unplugged.

Source：Taoism

People can live forever in the VR world.

With Holoportation technology.

觀落陰


All Rights Reserved

Magic Leap：Biggest Unicorn in AR/VR

or even in the tech industry • There are 4 Unicorn Club in AR/VR industries. (Magic Leap(4.5B)、

Oculus(2B)、Blippar(1.5B)、 Mindmaze (1B) 。

• Magic Leap grabs more then half of all funding in AR/VR.

• There is no any product showing out from Magic Leap.

Source：Digi-Capital(2016)


All Rights Reserved

Light-Field dis- maybe the next gen of MR Dynamic Digitized Light field Signal

資料來源：Magic Leap(2015)

• Reports said Magic Leap is developing Light-Field display based AR System.

• 2 types of 3D display：stereoscopic(3D TV) and light-field(Magic Leap), The Later is real 3D.


All Rights Reserved

VR-Ready Economy

the new driving force of ICT market

High-end PC

CPU,GPU,RAM,SSD

New chips for AR/VR

2K~4K display

on mobile phone

• Holographic Processing Unit,HPU

• Movidius (Vision Processing Unit,VPU AR/VR

applications

360 camera ecosystem

3D Scan

Motion Capture

SLAM technology


All Rights Reserved

http://ieknet.iek.org.tw/

Given the rapid pace of change in cutting-edge technology and industry development, the timeliness and comprehensiveness of the information included in this presentation cannot be guaranteed by ITRI. Users of this presentation shall bear full liability for any injury or loss that may be sustained as a result. The Copyright of this presentation belongs to ITRI and none of this presentation, either in part or in whole, in any form, may be reproduced, publicly transmitted, modified or distributed or used by other means without permission from ITRI.

Thank you!

侯鈞元專案經理

Alex Hou

CHUN-YUAN HOU

03-5918311

[email protected]

以上簡報所提供之資訊，在尖端科技發展與產業變動中，無法保證資訊的時效性及完整性，使用者應自行承擔因使用本簡報資料可能產生之任何損害。著作權歸工研院所有，非經書面允許，不得以任何形式進行局部或全部之重製、公開傳輸、改作、散布或其他利用本簡報資料之行為。

the trends of ar/vr industry and technology - 職業訓練局 · pdf file• reports said...

Documents