multimedia an introduction - montclair state universitygutierre/ctlect01.pdf · ze-nian li &...

Multimedia – An Introduction

Angel Gutierrez

http://www.csam.montclair.edu/~gutierre

gutierreza@mail.montclair.edu

1Multimedia Computing (CSIT410)

To discuss…

Course IssuesMultimedia – DefinitionsMultimedia SystemData Stream & Continuous mediaS i M diStreaming MediaMultimedia - Applications

Multimedia Computing (CSIT410)

2

Course IssuesCourse Issues

C HCourse Home– Check the Blackboard site for the course

Text Books

Ze Nian Li & Mark S Drew "Fundamentals of Multimedia"Ze-Nian Li & Mark S. Drew, Fundamentals of Multimedia , Pearson Education, 2004

Additional readings & the class notes will be posted on the course page on a regular basis.

Check the page regularly.

Multimedia Computing (CSIT410)

3

p g g y

Course IssuesCourse Issues

Coverage

Topics Number of Lectures

Introduction to Multimedia  5

Compression and Standards on Image, Video Audio Need for compression

3Video, Audio. Need for compression

Multimedia OS, Multimedia Database Synchronization, Multimedia C i ti S t t

5

Communication Systems, etc..

Future Directions 1

Multimedia Computing (CSIT410)

4

Course IssuesCourse Issues

E l tiEvaluationTest-1 - 25%Final - 40%Lab / Assignments /Project – 35% (no makeup) (Open Book)/ g / j % ( p) ( p )

Office hoursOffice : RI -319Check the website:http://pages.csam.montclair.edu/~gutierre/Email : gutierreza@mail.montclair.edu

Notices:Notices:Blackboard & Course Web site

Multimedia Computing (CSIT410)

5

Multimedia- DefinitionsMultimedia Definitions

M l i h l i lMulti - many; much; multipleMedium - a substance regarded as the means of transmission of a force or effect; a channel or system of communication, information, or entertainment

(Merriam-Webster Dictionary )

So, Multimedia???The terms Multi & Medium don’t seem fit wellTerm Medium needs more clarification !!!

Multimedia Computing (CSIT410)

6

Multimedia- DefinitionsMultimedia Definitions

Perception

MediumMeans for distribution and

Presentation Representation

presentation of information

Classification based on Criteria for the

classification of mediumperception (text, audio, video) is appropriate for defining multimedia

c ss c o o ed u

Storage Transmission

Information Exchange

Multimedia Computing (CSIT410)

7

Exchange

Multimedia- DefinitionsMultimedia Definitions

Ti l k di i i h di iTime always takes separate dimension in the media representationBased on time-dimension in the representation space, media can be

Time-independent (Discrete)Text, Graphics

Time dependent (Continuous)Audio, VideoVideo, sequence of frames (images) presented to the user periodically.Time dependent aperiodic media is not continuous!!

Discrete & Continuous here has no connection with internal representation !! (relates to the viewers impression…)

Multimedia Computing (CSIT410)

8

Multimedia- DefinitionsMultimedia Definitions

Multimedia is any combination of digitally manipulated textMultimedia is any combination of digitally manipulated text, art, sound, animation and video.A more strict version of the definition of multimedia do not allow just any combination of media.It requires

Both continuous & discrete media to be utilizedBoth continuous & discrete media to be utilizedSignificant level of independence between media being used

The less stricter version of the definition is used in practice:l d d l f b fDevelopment, integration and delivery of any combination of text,

graphics, animation, sound, or video through a computer.

Multimedia Computing (CSIT410)

9

Multimedia- DefinitionsMultimedia Definitions

d dMultimedia elements are composed into a project using authoring tools.

Multimedia Authoring tools are those programs that provide the capability for creating a complete p p y g pmultimedia presentations by linking together objects such as a paragraph of text (song), an illustration, an audio with appropriate interactive user controlaudio, with appropriate interactive user control.

Multimedia Computing (CSIT410)

10

Multimedia- DefinitionsMultimedia Definitions

B d fi i th bj t ' l ti hi t h thBy defining the objects' relationships to each other, and by sequencing them in an appropriate order, authors (those who use authoring tools) can produce attractive and useful graphical applicationsattractive and useful graphical applications. To name a few authoring tools

Macromedia FlashM di DiMacromedia DirectorAuthorware

The hardware and the software that govern the limits f h t h lti di pl tf i tof what can happen are multimedia platform or environment

Multimedia Computing (CSIT410)

11

Multimedia- DefinitionsMultimedia Definitions

d h h d dMultimedia is interactive when the end-user is allowed to control what and when the elements are delivered.

Interactive Multimedia is Hypermedia, when the end-user is provided with the structure of linked elements pthrough which he/she can navigate.

Multimedia Computing (CSIT410)

12

Multimedia- DefinitionsMultimedia Definitions

M lti di i li h it i t i t ti d thMultimedia is linear, when it is not interactive and the users just sit and watch as if it is a movie.

Multimedia is nonlinear, when the users are given the navigational control and can browse the contents at will.

Multimedia Computing (CSIT410)

13

Multimedia SystemMultimedia System

h d d f l dFollowing the dictionary definitions, Multimedia system is any system that supports more than a single kind of media

Implies any system processing text and image will be aImplies any system processing text and image will be a multimedia system!!!Note, the definition is quantitative. A qualitative definition would be more appropriatewould be more appropriate.The kind of media supported should be considered, rather the number of media

Multimedia Computing (CSIT410)

14

Multimedia SystemMultimedia System

A d h d bA multimedia system is characterized by computer-controlled, integrated production, manipulation, storage and communication of independent g pinformation, which is encoded at least through a continuous (time-dependent) and a discrete (time-i d d t) diindependent) medium.

Multimedia Computing (CSIT410)

15

Data streamsData streams

f d d kData Stream is any sequence of individual packets transmitted in a time-dependent fashion

Packets can carry information of either continuous orPackets can carry information of either continuous or discrete media

Transmission modesAsynchronous

Packets can reach receiver as fast as possible.Suited for discrete mediaAdditional time constraints must be imposed for continuous media

Multimedia Computing (CSIT410)

16

Data streamsData streams

hSynchronous Defines maximum end-to-end delayPackets can be received at an arbitrarily earlier timePackets can be received at an arbitrarily earlier timeFor retrieving uncompressed video at data rate 140Mbits/s & maximal end-to-end delay 1 second the

i h ld h 17 5 Mbreceiver should have temporary storage 17.5 MbytesIsochronous

Defines maximum & minimum end-to-end delayDefines maximum & minimum end to end delayStorage requirements at the receiver are reduced

Multimedia Computing (CSIT410)

17

Characterizing continuous media streamsCharacterizing continuous media streams

P i di iPeriodicityStrongly periodic

PCM coded speech in telephony behaves this way.W kl P ri diWeakly PeriodicAperiodic

Cooperative applications with shared windowsVariation of consecutive packet sizeVariation of consecutive packet size

Strongly RegularUncompressed digital data transmission

Weakly regularWeakly regularMpeg standard frame size I:P:B is 10:1:2

Irregular

Multimedia Computing (CSIT410)

18

Characterizing continuous media streamsCharacterizing continuous media streams

kContiguous packetsAre contiguous packets are transmitted directly one after another/ any delay?y yCan be seen as the utilization of resourceConnected / unconnected data streams

Multimedia Computing (CSIT410)

19

Streaming MediaStreaming Media

P l h i di h iPopular approach to continuous media over the internetPlayback at users computer is done while the media is being transferred (no waiting till complete download!!!)g ( g p )You can find streaming in

Internet radio stationsDi t l iDistance learningCricket Live!!!Movie Trailers

Multimedia Computing (CSIT410)

20

Streaming MediaStreaming Media

Multimedia Computing (CSIT410)

21

Multimedia- ApplicationsMultimedia Applications

Multimedia plays major role in following areasInstructionB iBusiness

AdvertisementsTraining materialsP iPresentationsCustomer support services

EntertainmentInteractive Games

Multimedia Computing (CSIT410)

22

Multimedia- ApplicationsMultimedia Applications

Enabling TechnologyAccessibility to web based materialsT h l d bl d h ld d lTeaching-learning disabled children & adults

Fine Arts & HumanitiesMuseum toursArt exhibitionsPresentations of literature

Multimedia Computing (CSIT410)

23

Multimedia- ApplicationsMultimedia Applications

In MedicineIn Medicine

Source: Cardiac Imaging,YALE centre for advanced cardiacadvanced cardiac imaging

Multimedia Computing (CSIT410)

24

Multimedia- ApplicationsMultimedia Applications

In training

Multimedia Computing (CSIT410)

25

Multimedia- ApplicationsMultimedia Applications

Public awareness campaign

SourceSourceInteractive Multimedia Project Department of food science& nutrition, Colorado State Univ

Multimedia Computing (CSIT410)

26

ReferencesChapter 1

Multimedia Computing (CSIT410)

27