digital image stabilization
DESCRIPTION
Digital Image Stabilization. 教師 : 楊士萱 老師 學生 : 鄭馥銘. Outline. Introduction of DIS DIS work flow chart Current work Experiment result Future work. Introduction of DIS. Video footage from hand-held DV is typically jerky due to small, unwanted DV movement. Introduction of DIS. - PowerPoint PPT PresentationTRANSCRIPT
1
Digital Image Stabilization
教師 : 楊士萱 老師學生 : 鄭馥銘
2
Outline
Introduction of DIS DIS work flow chart Current work Experiment result Future work
3
Introduction of DIS
Video footage from hand-held DV is typically jerky due to small, unwanted DV movement
4
Introduction of DIS
5
Introduction of DIS
A DIS system aims to produce a compensated video sequence so that the image motion due to the camera’s undesirable shake or jiggles can be removed
6
DIS work flow chart
Block-Blased Motion Estimation
Do DIS?
MV Validation
MVs
LMVs
7
DIS flow chart
FMV Generation
Hand – shake Estimation
Motion correction
LMVs
FMVs
SMV , HMV , AMV
8
Current work - ME
Block-Blased Motion Estimation
Do DIS?
MV Validation
MVs
9
Current work - ME
Block-based motion estimation– Using Y in YCBCr ,MAD as the distortion measure– MB size = 16 * 16– Pixel depth = 8– Resolution = ½– Search range = 32 or 64– Full search
10
Current work – do DIS?
Block-Blased Motion Estimation
Do DIS?
MV Validation
MVs
Not yet
11
Current work – MV Validation
Block-Blased Motion Estimation
Do DIS?
MV Validation
LMVs
MVs
12
Current work – MV Validation
Eliminate the Motion Vectors that effect to obtain frame Motion Vector(FMV).– Repeated pattern– Moving object
13
Current work – FMV Generation
FMV Generation
Hand – Shake Estimation
Motion Correction
LMVs
FMV
14
Current work – FMV Generation
Compute the FMV form LMVs– Median of LMVs– Mean of LMVs– Majority of LMVs that had counted amount of
direction
15
Current work – Hand Shake Est
FMV Generation
Hand – Shake Estimation
Motion Correction
LMVs
FMV
SMV , HMV , AMV
16
Current work – Hand Shake Est
FMV = SMV(steady motion vector) + HMV(Hand Shake)
SMV– Mean of post FMVs in buffer– Motion Vector Integration
( SMV(n) = αSMV(n-1) + βFMV(n) ) HMV(n) = FMV(n) – SMV(n) AMV(n) = AMV(n-1) + HMV(n)
17
Current work – Motion Correction
FMV Generation
Hand – Shake Estimation
Motion Correction
LMVs
FMV
SMV , HMV , AMV
AMV
18
Experiment result1 – sport videoSMV = Mean of post FMVs in buffer
19
Experiment result1 – sport videoHMV(n) = FMV(n) – SMV(n)
20
Experiment result1 – sport videoFrequency response of FMV & SMV
21
Experiment result2 – sport videoSMV(n) = αSMV(n-1) + βFMV(n)
22
Experiment result2 – sport videoHMV(n) = FMV(n) – SMV(n)
23
Experiment result2 – sport videoFrequency response of FMV & SMV
24
Future work
Block-Blased Motion Estimation
Do DIS?
MV Validation
25
Future work
FMV Generation
verify mean & median & majority result MV Validation
– MVI method SMV(n) = αSMV(n-1) + βFMV(n) How to choose α and β. ?
Spare MBs for foreground and background ?
26
Future work
Finding or making video suit with DIS testing Implement DIS system in DM270