mosaic based characterization of video sequences using fuzzy inferencing publish publish...

Mosaic Based Characterization of Mosaic Based Characterization of Video Sequences using Video Sequences using

Fuzzy InferencingFuzzy Inferencing

PublishPublish International Conference on Multimedia Processing and Systems AuthorsAuthors Pranav Bhushan,R.S.Jadon,Santanu Chaudhury Present byPresent by Rong-Chung Chen MembersMembers Yu-Yun Chou( 周雨韻 9214608),Yi-Jean Chu( 邱怡珍 9214638) DateDate 2004/01/06

Yu-Yun Chou,Yi-Jean Chu2

OutlineOutline

Introduction

Approach

Fuzzy Application

Commentfuzzy application


IntroductionIntroduction

To characterize and categorize of video sequences

The characterization of video sequencesFrame Based-Dynamic & Static video analyze

Mosaic Based-Static video analyze

The classification of video sequencesFuzzy Inferencing

Examples-Cricket,Golf,Football

Mosaic Based-Static video analyze


Frame BasedFrame Based

Frame basedThe representation of video in terms of r-frames

Original frames

Current frameReference frame

Original current frame-Encoded previous frame=Motion Vector(MV)

Previous frame+MV


Mosaic BasedMosaic Based

Collection of overlapping images To put together with coordinate transforms relating the different image

frame Mosaic


The classification of video sequencesThe classification of video sequences

ExtractionContent extraction form Mosaics

ClassificationUsing fuzzy Inferencing to classify the video sequences


ExtractionExtraction

RGB HSI

Red,Green,Blue Hue,Saturation,Intensity


ClassificationClassification

To classify the video sequences

Fuzzy InferencingFuzzy Attribute

Fuzzy rule


Fuzzy AttributeFuzzy Attribute

Green ScoreCounting all the green color pixels having hue value near to 120 degrees

Pitch ScoreCounting the color and the rectangular shape match of the image regions

Player ScoreCounting the elliptical blob surrounded by green grass


Fuzzy Set LevelFuzzy Set Level

Green-ScoreSmallMediumHigh

Pitch-ScoreNegligibleMediumLarge

Man-ScoreSingleMany


Fuzzy RuleFuzzy RuleAttribute Green-Score(G);Pitch-Score(P);Man-Score(M)

Golf If (G is high) and (P is negligible) and (M is single) then the match may be a GOLF sequence

If (G is medium) and (P is negligible) and (M is single) then the match may be a GOLF sequence

Football If (G is high) and (P is negligible) and (M is many) then the match may be a FOOTBALL sequence

If (G is medium) and (P is negligible) and (M is many) then the match may be a FOOTBALL sequence

If (G is small) and (P is negligible) and (M is many) then the match may be a FOOTBALL sequence

Cricket If (G is high) and (P is large) and (M is single) then the match may be a CRICKET sequence

If (G is high) and (P is large) and (M is many) then the match may be a CRICKET sequence

If (G is high) and (P is medium) and (M is single) then the match may be a CRICKET sequence

If (G is high) and (P is medium) and (M is many) then the match may be a CRICKET sequence

If (G is medium) and (P is large) and (M is many) then the match may be a CRICKET sequence


Classical PartitionClassical Partition

F(5) F(4) F(3)

G(2) G(1)

Green-Score

Pitch-Score

Man-Scorehighmediumsmall

large

medium

negligible

many

single

C(9)

C(8)

C(10) C(7)

C(6)

F(5) F(4) F(3)

G(2) G(1)

C(9)

C(8)

C(10) C(7)

C(6)


ResultResult

After frame based processing membership score increases to 0.7012

Fuzzy Scores of Mosaics Based

File Name Cricket Golf Football

c1.ppm 0.608050 0.466407 0.280638

c2.ppm 0.949325 0.230734 0.438150

c3.ppm 0.590072 0.283898 0.272341

c4.ppm 0.678893 0.329069 0.313321

c5.ppm 0.907895 0.397286 0.483226

c6.ppm 0.604081 0.452852 0.278806

c7.ppm 0.419162 0.452209 0.193460

g1.ppm 0.354282 0.783548 0.163515

g2.ppm 0.510706 0.783637 0.441208

fb3.ppm 0.399765 0.556414 0.184507


CommentComment

The list of analyzing fuzzy application

If not using fuzzy applicationComplex Classification

Hard to computing

Advantage Simple Classification

Fast computation

Disadvantage Increase in error rate

The fuzzy application only suitable for extremely different motion

Thank for your Thank for your listeninglistening


RGBRGB


HSIHSI

mosaic based characterization of video sequences using fuzzy inferencing publish publish...

Documents