h.264 and dis

H.264 and DIS

指導教授：楊士萱　老師學生：鄭馥銘

Outline

Introduction of DIS Combine DIS and H.264 Some problem for combination issue Future work

Outline

Introduction of DIS Combine DIS and H.264 Some problem for combination issue Future work

Introduction

Why use DIS in video-footage deviceVideo footage from hand-held camera is typic

ally jerky due to small,unwanted camera movements.

We present a video stabilization algorithm aimed to produce a compensated video sequence so that the camera’s undesirable shake or jiggle can be removed.

Categories of DIS

Mechanical-Optical system Mechanical-Digital system Fully Digital system

Architecture of DIS - 1

Pre-processing

Diadv ： Need additional memory 、 sensor 、 chip

Stabilization Video-Encoder Video-Decoderinput output

Architecture of DIS - 2

Post-processing

Adv ： No motion estimation computation

Disadv ： Coding efficiency can not be increased

Stabilization

Video-Encoder Video-Decoderinput output

Architecture of DIS - 3

Combine-Encoder

Adv ： Save memory 、 sensor 、 chip 、 Coding efficiency can be increased 。

Disdv ：？

Stabilization

Video-Encoder Video-Decoderinput output

Summarize the goal of DIS-system

Combine DIS and H.264 EncoderOur DIS using block-base ME is suited with

encoder so that DIS can immediate get MV form encoder.

Coding efficiency can be increasedJitter can be removed

Outline

Introduction of DIS Combine DIS and H.264 Some problem for combination issue Future work

H.264 Baseline Profile

Free to use Tools

I Slice P SliceCAVLCSlice GroupRedundant Slice

Review of DIS systemBlock-Blased Motion

Estimation

MV Validation

MVs

FMV Generation

Hand – shake Estimation

Motion correction

LMVs

FMV

SMV , HMV , AMV

H.264 Encoder Architecture

Review of DIS systemBlock-Blased Motion

Estimation

MV Validation

MVs

FMV Generation

Hand – shake Estimation

Motion correction

LMVs

FMV

SMV , HMV , AMV

H.264 Encoder Architecture

ME - In DIS system

MB Size

ME - In DIS system

ME - In DIS system

Reference picture management Short termLong term

ME - In DIS system

Pixel ResolutionFull pixelHalf pixelQuarter pixel

ME - In DIS system

H.264 Main profileB Slice

ME - In DIS system

H.264 Main profile Interlaced

ME - In DIS system

Slice groupEx 1 ： interlace

Ex 2 ： foreground &

background

Combine DIS system and H.264

Block-Blased Motion Estimation

MV Validation

MVs

FMV Generation

Hand – shake Estimation

Motion correction

LMVs

FMV

SMV , HMV , AMV

Block-Blased Motion Estimation

Hand – shake Estimation

Motion correction

MVs

SMV , HMV , AMV

H.264 Encoder Architecture

HE

Combine DIS system and H.264

Block-Blased Motion Estimation

Hand – shake Estimation

Motion correction

MVs

SMV , HMV , AMV

H.264 Encoder Architecture

HE

Motion Correction

?

Outline

Introduction of DIS Combine DIS and H.264 Some problem for combination issue Future work

Some problem of combination issue

Where to place Motion Correction module What we need

MV bufferDelay residual coding

DIS-H.264 system architecture-1

HE

Motion Correction

MV Buffer

Some problem of combination issue

DIS-H.264 system architecture-1Maybe jitter can be removed But it does not increase coding efficiency

Remark of combination issue

Shifting frame to stable position （ Motion Correction ） before motion estimation, in order to increase coding efficiency.

Shifting frame to stable position （ Motion Correction ） before motion estimation ,Because the size of reference frame is smaller than current frame.

Zoran DIS-MPEG4 system

Future work

Ability to modify reference software program

To assess the effects of DIS-H.264 system