janus @ webrtc meetup stockholm

L. Miniero

WebRTCStandardization

JanusModules and APIs

Deploying

Troubleshooting

ExamplesA few examples

Next steps

Janus: an open source and general purposeWebRTC gateway (application) server

Lorenzo Miniero@elminiero

WebRTC Stockholm Meetup16th February 2017, Stockholm

L. Miniero

Deploying

Troubleshooting

Next steps

My 2nd time in Stockholm! (1st was IETF75, 2009)

L. Miniero

Deploying

Troubleshooting

Next steps

So many reasons to love Sweden...

L. Miniero

Deploying

Troubleshooting

Next steps

L. Miniero

Deploying

Troubleshooting

Next steps

L. Miniero

Deploying

Troubleshooting

Next steps

L. Miniero

Deploying

Troubleshooting

Next steps

L. Miniero

Deploying

Troubleshooting

Next steps

L. Miniero

Deploying

Troubleshooting

Next steps

Outline

1 A brief introduction

2 Some contextWebRTC and standardization activities

3 Janus: a general purpose WebRTC gateway (application) serverModular architecture: plugins and APIsDeploying Janus: a few possible topologiesMonitoring and troubleshooting

4 Some practical examplesWhat is Janus used for today, and by whom?

5 Next steps

L. Miniero

Deploying

Troubleshooting

Next steps

Who am I?

• Someone not used to this cold!• Born in Antwerp, Belgium• Too cold, so raised in sunny Sorrento, Italy ,• Now living (and working) in Napoli

• Current activities• Recently got my Ph.D @ UniNA• Co-founder @ Meetecho (and Chairman, if you can believe it...)

• Focus on real-time multimedia applications• Web conferencing only, at first• Then widened the scope to multimedia in general• Strong perspective on standardization and open source

• WebRTC rulez!

• Getting older but, unlike whisky, not getting any better• https://twitter.com/elminiero

L. Miniero

Deploying

Troubleshooting

Next steps

Who am I?

• WebRTC rulez!

L. Miniero

Deploying

Troubleshooting

Next steps

Who am I?

• WebRTC rulez!

L. Miniero

Deploying

Troubleshooting

Next steps

Who am I?

• WebRTC rulez!

L. Miniero

Deploying

Troubleshooting

Next steps

((*)This is what Napoli looks like in the Winter...)

L. Miniero

Deploying

Troubleshooting

Next steps

Ok, ok, enough about you... what’s WebRTC about?

• Real-time media in a browser• Up to some time ago, no standard solution!

• No interoperability• Plugins needed to be installed anyway

WebRTC = Joint standardization efforts• Internet Engineering Task Force (IETF)• World Wide Web Consortium (W3C)

• RTCWEB (IETF)• Real-Time Communication in WEB browsers WG• Defines protocols and formats to use

• WEBRTC (W3C)• Web Real-Time Communications WG• Defines UI and API to access devices

L. Miniero

Deploying

Troubleshooting

Next steps

L. Miniero

Deploying

Troubleshooting

Next steps

L. Miniero

Deploying

Troubleshooting

Next steps

WebRTC reference architecture

L. Miniero

Deploying

Troubleshooting

Next steps

The WebRTC protocol suite

L. Miniero

Deploying

Troubleshooting

Next steps

• Signalling (well, sort of) and Negotiation• Javascript Session Establishment Protocol (JSEP)• Session Description Protocol (SDP) adaptation

• Connection Establishment and NAT Traversal• Session Traversal Utilities for NAT (STUN)• Traversal Using Relay NAT (TURN)• Interactive Connectivity Establishment (ICE)

• Media Transport and Control• Real-time Transport (and Control) Protocol (RTP/RTCP)• Secure Extensions to RTP (SRTP)• Datagram Transport Layer Security (DTLS)

• Multimedia codecs• Opus audio codec (MTI, Mandatory-to-implement)• VP8 and H.264 video codecs (MTI, Mandatory-to-implement)

• Generic Data• WebRTC Data Channels (SCTP)

L. Miniero

Deploying

Troubleshooting

Next steps

• Signalling (well, sort of) and Negotiation• Javascript Session Establishment Protocol (JSEP)• Session Description Protocol (SDP) adaptation

• Connection Establishment and NAT Traversal• Session Traversal Utilities for NAT (STUN)• Traversal Using Relay NAT (TURN)• Interactive Connectivity Establishment (ICE)

• Media Transport and Control• Real-time Transport (and Control) Protocol (RTP/RTCP)• Secure Extensions to RTP (SRTP)• Datagram Transport Layer Security (DTLS)

• Multimedia codecs• Opus audio codec (MTI, Mandatory-to-implement)• VP8 and H.264 video codecs (MTI, Mandatory-to-implement)

• Generic Data• WebRTC Data Channels (SCTP)

L. Miniero

Deploying

Troubleshooting

Next steps

WebRTC reference architecture (again)

L. Miniero

Deploying

Troubleshooting

Next steps

Involving a gateway/server (and applications)

L. Miniero

Deploying

Troubleshooting

Next steps

Involving different technologies as well

“What is a WebRTC Gateway anyway?”• https://webrtchacks.com/webrtc-gw/

L. Miniero

Deploying

Troubleshooting

Next steps

Involving different technologies as well

“What is a WebRTC Gateway anyway?”• https://webrtchacks.com/webrtc-gw/

L. Miniero

Deploying

Troubleshooting

Next steps

Janus: a general purpose WebRTC gateway server

“In ancient Roman religion andmyth, Janus [..] is the god ofbeginnings and transitions, andthereby of gates, doors, passages,endings and time. He is usuallydepicted as having two faces, sincehe looks to the future and to thepast.”

— http://en.wikipedia.org/wiki/Janus

L. Miniero

Deploying

Troubleshooting

Next steps

Janus: a general purpose WebRTC gateway server

• A door between the communications past and future• Legacy technologies (the “past”)• WebRTC (the “future”)

JanusGeneral purpose, open source WebRTC gateway• https://github.com/meetecho/janus-gateway• Demos and documentation: https://janus.conf.meetecho.com• Community: https://groups.google.com/forum/#!forum/meetecho-janus

L. Miniero

Deploying

Troubleshooting

Next steps

Modular architecture

• The core only implements the WebRTC stack• JSEP/SDP, ICE, DTLS-SRTP, Data Channels, ...

• Plugins expose Janus API over different transports• Currently HTTP / WebSockets / RabbitMQ / Unix Sockets / MQTT (new!)

• “Application” logic implemented in plugins too• Users attach to plugins via the Janus core• The core handles the WebRTC stuff• Plugins route/manipulate the media/data

• Some plugins available out-of-the-box• Streaming (→ Plain RTP or RTSP to WebRTC!)• Video Room (→ Selective Forwarding Unit!)• Audio Bridge (→ Mixer/MCU!)• SIP Gateway (→ “Legacy” SIP!)• ...

L. Miniero

Deploying

Troubleshooting

Next steps

L. Miniero

Deploying

Troubleshooting

Next steps

L. Miniero

Deploying

Troubleshooting

Next steps

L. Miniero

Deploying

Troubleshooting

Next steps

Extensible Architecture and API

L. Miniero

Deploying

Troubleshooting

Next steps

Extensible Architecture and API

L. Miniero

Deploying

Troubleshooting

Next steps

Plugins as “bricks”

• Each plugin is a feature, not an application

• Application can be composed out of different features• Features as “bricks” for a complex scenario

• A few examples...• Multimedia conferencing with PSTN support

• Video Room (participants video & screen) + SIP (participants audio)

• Webinar with Q&A

• Video Room (screen) + Video Room (speakers) + Audio Bridge (questions)

• Social TV

• Streaming (TV channel) + Video Room (interaction)

• Contact center / Communication in social networks

• SIP plugin (calls) + Echo Test (diagnostics) + Record & Play (messaging)

L. Miniero

Deploying

Troubleshooting

Next steps

Plugins as “bricks”

• Each plugin is a feature, not an application

• Application can be composed out of different features• Features as “bricks” for a complex scenario

• A few examples...• Multimedia conferencing with PSTN support

• Video Room (participants video & screen) + SIP (participants audio)

• Webinar with Q&A

• Video Room (screen) + Video Room (speakers) + Audio Bridge (questions)

• Social TV

• Streaming (TV channel) + Video Room (interaction)

• Contact center / Communication in social networks

• SIP plugin (calls) + Echo Test (diagnostics) + Record & Play (messaging)

L. Miniero

Deploying

Troubleshooting

Next steps

Webinar with Q/A

L. Miniero

Deploying

Troubleshooting

Next steps

Social TV

L. Miniero

Deploying

Troubleshooting

Next steps

Deploying Janus: a few possible topologies

L. Miniero

Deploying

Troubleshooting

Next steps

L. Miniero

Deploying

Troubleshooting

Next steps

L. Miniero

Deploying

Troubleshooting

Next steps

L. Miniero

Deploying

Troubleshooting

Next steps

L. Miniero

Deploying

Troubleshooting

Next steps

L. Miniero

Deploying

Troubleshooting

Next steps

L. Miniero

Deploying

Troubleshooting

Next steps

Anything wrong? Check the Admin API!

• Requests/response API to interrogate Janus• Query server capabilities• Control some aspects (e.g., enable/disable debugging)• Inspect handles and WebRTC “internals”

• What about asynchronous events? More on that in a minute!

http://www.meetecho.com/blog/understanding-the-janus-admin-api/

L. Miniero

Deploying

Troubleshooting

Next steps

Admin API overview: polling for information

L. Miniero

Deploying

Troubleshooting

Next steps

An asynchronous approach to monitoring/troubleshooting

• Admin API is cool, but is request/response...

• Needs constant polling, and data is unavailable after the session ends

• What about an asynchronous approach?

• A new mechanism: Event Handlers

• Core and plugins generate events• Custom modules can subscribe to and handle them

• e.g., save to DB, send to external service, CDR, etc.

• “Sample Event Handler” forwards JSON events via HTTP

• Learning more with practical examples (node.js + DB)

• http://www.meetecho.com/blog/event-handlers-a-practical-example/

• http://www.meetecho.com/blog/correlating-janus-event-handlers/

• https://fosdem.org/2017/schedule/event/janus/

L. Miniero

Deploying

Troubleshooting

Next steps

L. Miniero

Deploying

Troubleshooting

Next steps

L. Miniero

Deploying

Troubleshooting

Next steps

Event Handlers overview: routing and managing async events

L. Miniero

Deploying

Troubleshooting

Next steps

A first real integration: HEPIC (Homer++)

https://fosdem.org/2017/schedule/event/homer/

L. Miniero

Deploying

Troubleshooting

Next steps

Stressing Janus: Jattack!

• Jattack = Janus Attack (or J’attaque ,)• Controllable (via WebSockets) WebRTC client stack• Allows dynamic creation/monitoring of tons of WebRTC PeerConnections

• Still improving it, but already in a usable state• Can receive (and optionally record) media• Can also send media, if you provide an RTP source yourself• Live events on everything that happens

• Originally conceived as a homemade tool for stressing Janus• Might actually be used with other servers as well• All the logic (signalling included) is in the controller

• Presented at IPTComm in Chicago just a few months ago!• https://prezi.com/krg1esxoa6ug/jattack/• https://www.youtube.com/watch?v=UwNq8p0m1js

L. Miniero

Deploying

Troubleshooting

Next steps

L. Miniero

Deploying

Troubleshooting

Next steps

L. Miniero

Deploying

Troubleshooting

Next steps

L. Miniero

Deploying

Troubleshooting

Next steps

L. Miniero

Deploying

Troubleshooting

Next steps

L. Miniero

Deploying

Troubleshooting

Next steps

What is Janus used for today, and by whom?

• We use it ourselves for many things (obviously)• Web conferencing and Webinars• WebRTC-to-SIP gateway• Streaming of live events (e.g., IETF meetings, stay tuned!)

• Many folks/companies also using it in creative ways!• E-learning• Coworking• Contact centers• TV broadcasting and Social TV• Surveillance systems• E-health• Home automation & Internet of Things• Mobile devices, Raspberry Pis, drones, etc.

• New third-party tools are starting to come out• https://janus.conf.meetecho.com/docs/resources

L. Miniero

Deploying

Troubleshooting

Next steps

L. Miniero

Deploying

Troubleshooting

Next steps

L. Miniero

Deploying

Troubleshooting

Next steps

A “silly” use case: The Jumping Sumo!

https://www.youtube.com/watch?v=isGSnMlKcss

L. Miniero

Deploying

Troubleshooting

Next steps

A “silly” use case: The Jumping Sumo!

https://www.youtube.com/watch?v=isGSnMlKcss

L. Miniero

Deploying

Troubleshooting

Next steps

“Matrix wins Best of Show at WebRTC World!”

https://www.youtube.com/watch?v=OMzDklvDS3c

L. Miniero

Deploying

Troubleshooting

Next steps

“Matrix wins Best of Show at WebRTC World!”

https://www.youtube.com/watch?v=NpBStIIq6fM

L. Miniero

Deploying

Troubleshooting

Next steps

Jangouts (for "Janus Hangouts" ,)

https://github.com/jangouts/jangouts

L. Miniero

Deploying

Troubleshooting

Next steps

SylkServer (SIP/XMPP Application Server)

http://sylkserver.com/

L. Miniero

Deploying

Troubleshooting

Next steps

SylkServer (SIP/XMPP Application Server)

http://sylkserver.com/

L. Miniero

Deploying

Troubleshooting

Next steps

Slack (team co-working)

https://webrtchacks.com/dear-slack/https://webrtchacks.com/slack-webrtc-slacking/

https://slack.engineering/calls-is-it-you-or-is-it-me-f5d36749e8edhttps://webrtchacks.com/slack-video/

L. Miniero

Deploying

Troubleshooting

Next steps

Mattermost (team co-working)

https://docs.mattermost.com/deployment/webrtc.htmlhttps://github.com/mattermost/mattermost-webrtc

L. Miniero

Deploying

Troubleshooting

Next steps

Beam (videogame streaming)

https://beam.pro/https://github.com/WatchBeam/ftl-sdk

L. Miniero

Deploying

Troubleshooting

Next steps

Lenovo’s AirClass (e-learning)

https://www.airclass.com

L. Miniero

Deploying

Troubleshooting

Next steps

Sqwiggle / Speak.io (team co-working)

https://www.sqwiggle.comhttps://speak.io

L. Miniero

Deploying

Troubleshooting

Next steps

Sqwiggle / Speak.io (team co-working)

https://www.sqwiggle.comhttps://speak.io

L. Miniero

Deploying

Troubleshooting

Next steps

Veeting rooms (web conferencing)

https://www.veeting.com

L. Miniero

Deploying

Troubleshooting

Next steps

AliceX (let’s call it “virtual reality” ,)

https://www.alicex.com

L. Miniero

Deploying

Troubleshooting

Next steps

What to do next?

• Finalize the WebRTC implementation

• Work on effective renegotiation (ICE restarts almost ready)

• Implement multistream (Unified Plan)

• Keep on improving and fixing things

• Code cleanup, reference counters, new modules, ...

• A monitoring/troubleshooting framework on top of Event Handlers

• Test Test Test!

• Jattack will greatly help here

Help us improve this!• Play with it, more testing is important• Write your own applications/wrappers/plugins!

L. Miniero

Deploying

Troubleshooting

Next steps

What to do next?

• Test Test Test!

L. Miniero

Deploying

Troubleshooting

Next steps

What to do next?

• Test Test Test!

L. Miniero

Deploying

Troubleshooting

Next steps

What to do next?

• Test Test Test!

L. Miniero

Deploying

Troubleshooting

Next steps

Questions?

@elminiero@meetecho

janus @ webrtc meetup stockholm

Technology