the lola team lola in 10 minutes… lola together, on demand! low latency audio visual streaming...

15
The LOLA team LOLA in 10 minutes… w w w . c o n s e r v a t o r i o . t r i e s t e . i t LOLA Together, on demand! LOw LAtency Audio Visual Streaming System A LOW LATENCY, HIGH QUALITY AUDIO/VIDEO TRANSMISSION SYSTEM FOR NETWORK MUSICAL PERFORMANCES AND INTERACTION Massimo Parovel, Paolo Pachini, Nicola Buso, Carlo Drioli Claudio Allocchio Conservatorio G. Tartini Trieste

Upload: josiah-mattingly

Post on 01-Apr-2015

217 views

Category:

Documents


5 download

TRANSCRIPT

Page 1: The LOLA team LOLA in 10 minutes…  LOLA Together, on demand! LOw LAtency Audio Visual Streaming System A LOW LATENCY, HIGH

The LOLA teamLOLA in 10 minutes…

ww

w.co

nse

rvato

rio.trie

ste.it

LOLATogether, on demand!

LOw LAtency Audio Visual Streaming System

A LOW LATENCY, HIGH QUALITY AUDIO/VIDEO TRANSMISSION SYSTEM FOR NETWORK MUSICAL

PERFORMANCES AND INTERACTION

Massimo Parovel, Paolo Pachini, Nicola Buso, Carlo DrioliClaudio Allocchio

Conservatorio G. TartiniTrieste

Page 2: The LOLA team LOLA in 10 minutes…  LOLA Together, on demand! LOw LAtency Audio Visual Streaming System A LOW LATENCY, HIGH

The LOLA teamLOLA in 10 minutes…

ww

w.co

nse

rvato

rio.trie

ste.it

…a viola Masterclass with New World Symphony,at the GARR Conference 2005, in Pisa...

“To perform together, from distant locations...as if distance has vanished

in a click of a computer mouse”

The Dream…

http://www.garr.it/eventiGARR/conf_05/ram/Violista.ram 14:00

Page 3: The LOLA team LOLA in 10 minutes…  LOLA Together, on demand! LOw LAtency Audio Visual Streaming System A LOW LATENCY, HIGH

The LOLA teamLOLA in 10 minutes…

ww

w.co

nse

rvato

rio.trie

ste.it

• Audio Latency (RTT) below ~40-75ms (depends on music style)• Eye Contact to synchronize• Spatial Sound immersion for expression• Room Reverbering• Continuous Presence of all musicians• Non distracting environment• and art!

To play together you need…

Page 4: The LOLA team LOLA in 10 minutes…  LOLA Together, on demand! LOw LAtency Audio Visual Streaming System A LOW LATENCY, HIGH

The LOLA teamLOLA in 10 minutes…

ww

w.co

nse

rvato

rio.trie

ste.it

H.323/SIP

Audio/Video tools before LOLA…

DVTS

Conference XP Skype

Page 5: The LOLA team LOLA in 10 minutes…  LOLA Together, on demand! LOw LAtency Audio Visual Streaming System A LOW LATENCY, HIGH

The LOLA teamLOLA in 10 minutes…

ww

w.co

nse

rvato

rio.trie

ste.it

H.323/SIP

Audio/Video tools before LOLA…

DVTS

Conference XP Skype

Latency: 400msEcho

Latency: 200msAudio for voice

Auto echo cancellation

Latency: 350msEcho

Latency: > 300msAudio for voice

Auto echocancellation

Page 6: The LOLA team LOLA in 10 minutes…  LOLA Together, on demand! LOw LAtency Audio Visual Streaming System A LOW LATENCY, HIGH

The LOLA teamLOLA in 10 minutes…

ww

w.co

nse

rvato

rio.trie

ste.it

• To satisfy all requirements,• in all involved remote sites, • also without a skilled conductor,• and to play J. S. Bach, • with a piano!

But… we wanted…

Page 7: The LOLA team LOLA in 10 minutes…  LOLA Together, on demand! LOw LAtency Audio Visual Streaming System A LOW LATENCY, HIGH

The LOLA teamLOLA in 10 minutes…

ww

w.co

nse

rvato

rio.trie

ste.it

LOLA

Latency: 5msAudio for music

No echoVery Fast reliable networks

Hi-Speed camerasMachine Vision Grabbers

Good PC (i5/i7)…

New programming approach!

http://www.conts.it/artistica/lola-project/introducing-lola-workshop/

100 Mbps 500 Mbps30 fps 60 fps

2 ch 8 ch

Page 8: The LOLA team LOLA in 10 minutes…  LOLA Together, on demand! LOw LAtency Audio Visual Streaming System A LOW LATENCY, HIGH

The LOLA teamLOLA in 10 minutes…

ww

w.co

nse

rvato

rio.trie

ste.it

• Target applications:

• Network interactive musical tasks• musical rehearsing and performances• music education and training

... but also...

• Network interactive on stage performances• dance performances• drama performances• performing arts education and training• and beyond…• surgery, real time control…

LOLA Motivations and Goals

Page 9: The LOLA team LOLA in 10 minutes…  LOLA Together, on demand! LOw LAtency Audio Visual Streaming System A LOW LATENCY, HIGH

The LOLA teamLOLA in 10 minutes…

ww

w.co

nse

rvato

rio.trie

ste.it

Latency: •~25ms (one way) is the confort limit for most instruments

Discoveries with LOLA

Courtesy of Nathan Brock, UCSD

Sound rendering: • mixing different ambients;• reproducing acoustic instruments;

Page 10: The LOLA team LOLA in 10 minutes…  LOLA Together, on demand! LOw LAtency Audio Visual Streaming System A LOW LATENCY, HIGH

The LOLA teamLOLA in 10 minutes…

ww

w.co

nse

rvato

rio.trie

ste.it

Network Performing Arts Production Workshop: 23.11.2010 Tartini (Trieste) – IRCAM (Paris) 1300Km.

Network Performing Arts Production Workshop: 15.06.2011Tartini (Trieste) – Gran Teatre del Liceu (Barcelona) 2700Km.

Internet2 Fall Members Meeting: 04.10.2011 NIU (Chicago, IL) – Congress Center (Raleigh, NC) 1850km.

Network Performing Arts Production Workshop : 05.03.2012 NIU (Chicago, IL) – NWS (Miami, FL) 2400km.

LOLA public Events

Page 11: The LOLA team LOLA in 10 minutes…  LOLA Together, on demand! LOw LAtency Audio Visual Streaming System A LOW LATENCY, HIGH

The LOLA teamLOLA in 10 minutes…

ww

w.co

nse

rvato

rio.trie

ste.it

AEC Annual Meeting for International Coordinators: 15.09.2012 Tartini (Trieste) – SS. Marcellino & Festo (Naples) 1200Km.

LOLA First public Concert

Page 12: The LOLA team LOLA in 10 minutes…  LOLA Together, on demand! LOw LAtency Audio Visual Streaming System A LOW LATENCY, HIGH

The LOLA teamLOLA in 10 minutes…

ww

w.co

nse

rvato

rio.trie

ste.it

“We are in a new unexplored world: how can we adapt interpretation/composition to two different Concert Hall acoustic environment at the same time?”

“Your horizon expands from a city to a continent”

“You can talk, listen, make examples BUT ALSO you can PLAY TOGETHER”

“We won the CODECs challenge! ... the challenge is for the network now!”

“A powerful tool to analyze and refine your performance”

Comments by LOLA users

Page 13: The LOLA team LOLA in 10 minutes…  LOLA Together, on demand! LOw LAtency Audio Visual Streaming System A LOW LATENCY, HIGH

The LOLA teamLOLA in 10 minutes…

ww

w.co

nse

rvato

rio.trie

ste.it

• Northern Illinois University School of Music - DeKalb, IL, USA• CESNET - Czech Republic Research and Education Network - Praha, CZ• New World Symphony - America's Orchestral Academy – Miami, FL, USA• Internet2 networking consortium - Washington, DC, USA• Università degli Studi di Cassino e del Lazio Meridionale - Cassino, IT• JAnet - UK Education and Research Network - Oxford, Didcot, UK• Universidade de São Paulo - CMU, Departamento de Música - São Paulo, Brasil• Rensselaer Polytechnic Institute - Department of the Arts - Troy, NY, USA• MAGPI - Mid-Atlantic Gigapop - Multimedia Service - Philadelphia, PA, USA• Edinburgh Napier University, School of Arts and Creative Industries, Music dept. UK• University of North Carolina, School of Music, Greensboro, NC, USA• University of Virginia, School of Arts, Charlottesville, VA, USA• Royal Academy of Music, Aarhus, DK

Contact us at [email protected], get a free license for non commercial academic use, build you own PC and join the community!

LOLA: the community

Page 14: The LOLA team LOLA in 10 minutes…  LOLA Together, on demand! LOw LAtency Audio Visual Streaming System A LOW LATENCY, HIGH

The LOLA teamLOLA in 10 minutes…

ww

w.co

nse

rvato

rio.trie

ste.it

London-Edinburgh ~400miles

Page 15: The LOLA team LOLA in 10 minutes…  LOLA Together, on demand! LOw LAtency Audio Visual Streaming System A LOW LATENCY, HIGH

The LOLA teamLOLA in 10 minutes…

ww

w.co

nse

rvato

rio.trie

ste.it

http://www.conts.it/artistica/lola-project

[email protected]

Questions?