0 by: navid einackchi isfahan university of technology electrical and computer department spring...
TRANSCRIPT
![Page 1: 0 By: Navid Einackchi Isfahan University of Technology Electrical and Computer Department Spring 2007 Image alignment and stitching using Object Recognition](https://reader035.vdocuments.pub/reader035/viewer/2022070307/551aed1455034606048b5ef9/html5/thumbnails/1.jpg)
1
By: Navid EinackchiBy: Navid Einackchi
Isfahan University of Isfahan University of TechnologyTechnology
Electrical and Computer Department
Spring 2007Spring 2007
Image alignment and stitching using Object Recognition MethodsImage alignment and stitching using Object Recognition Methods
Supervisors: Dr Rasoul Amirfattahi
Dr javad Askari
Advisor: Dr M. Saraee
Master Thesis of Computer Engineering- Artificial Intelligence and Robotic
به نام خدا
![Page 2: 0 By: Navid Einackchi Isfahan University of Technology Electrical and Computer Department Spring 2007 Image alignment and stitching using Object Recognition](https://reader035.vdocuments.pub/reader035/viewer/2022070307/551aed1455034606048b5ef9/html5/thumbnails/2.jpg)
By: Navid EinackchiBy: Navid Einackchi Spring 2007Spring 2007
Image alignment and stitching using object recognition methodsImage alignment and stitching using object recognition methods
Presentation ProcessPresentation Process
• IntroductionIntroduction– Definition– Aligning concepts– Stitching Concepts
• Object Recognition ProblemObject Recognition Problem– Salient Feature– What is Descriptor– Matching
• Proposed Method for AligningProposed Method for Aligning– Using Harris Detector– Using SIFT Detector– Stitching
• Concluding and SuggestionsConcluding and Suggestions
Some slides are fro
m other
Some slides are fro
m other
sources
sources
![Page 3: 0 By: Navid Einackchi Isfahan University of Technology Electrical and Computer Department Spring 2007 Image alignment and stitching using Object Recognition](https://reader035.vdocuments.pub/reader035/viewer/2022070307/551aed1455034606048b5ef9/html5/thumbnails/3.jpg)
By: Navid EinackchiBy: Navid Einackchi Spring 2007Spring 2007
Image alignment and stitching using object recognition methodsImage alignment and stitching using object recognition methods
Presentation ProcessPresentation Process
• IntroductionIntroduction– Definition– Aligning Concepts– Stitching Concepts
• Object Recognition ProblemObject Recognition Problem– Salient Feature– What is Descriptor– Matching
• Proposed Method for AligningProposed Method for Aligning– Using Harris Detector– Using SIFT Detector– Stitching
• Concluding and SuggestionsConcluding and Suggestions
![Page 4: 0 By: Navid Einackchi Isfahan University of Technology Electrical and Computer Department Spring 2007 Image alignment and stitching using Object Recognition](https://reader035.vdocuments.pub/reader035/viewer/2022070307/551aed1455034606048b5ef9/html5/thumbnails/4.jpg)
By: Navid EinackchiBy: Navid Einackchi Spring 2007Spring 2007
Image alignment and stitching using object recognition methodsImage alignment and stitching using object recognition methods
Presentation ProcessPresentation Process
• IntroductionIntroduction– Definition– Aligning Concepts– Stitching Concepts
• Object Recognition ProblemObject Recognition Problem– Salient Feature– What is Descriptor– Matching
• Proposed Method for AligningProposed Method for Aligning– Using Harris Detector– Using SIFT Detector– Stitching
• Concluding and SuggestionsConcluding and Suggestions
![Page 5: 0 By: Navid Einackchi Isfahan University of Technology Electrical and Computer Department Spring 2007 Image alignment and stitching using Object Recognition](https://reader035.vdocuments.pub/reader035/viewer/2022070307/551aed1455034606048b5ef9/html5/thumbnails/5.jpg)
By: Navid EinackchiBy: Navid Einackchi Spring 2007Spring 2007
Image alignment and stitching using object recognition methodsImage alignment and stitching using object recognition methods
Image Alignment and StitchingImage Alignment and Stitching
• DefinitionDefinition • ApplicationsApplications
– Mosaic Image
– Panorama
– Virtual Environment
– Robotic
تصوير حاصل
![Page 6: 0 By: Navid Einackchi Isfahan University of Technology Electrical and Computer Department Spring 2007 Image alignment and stitching using Object Recognition](https://reader035.vdocuments.pub/reader035/viewer/2022070307/551aed1455034606048b5ef9/html5/thumbnails/6.jpg)
By: Navid EinackchiBy: Navid Einackchi Spring 2007Spring 2007
Image alignment and stitching using object recognition methodsImage alignment and stitching using object recognition methods
Image Alignment and StitchingImage Alignment and Stitching
• DefinitionDefinition • ApplicationsApplications
– Mosaic Image
– Panorama
– Virtual Environment
– Robotic
![Page 7: 0 By: Navid Einackchi Isfahan University of Technology Electrical and Computer Department Spring 2007 Image alignment and stitching using Object Recognition](https://reader035.vdocuments.pub/reader035/viewer/2022070307/551aed1455034606048b5ef9/html5/thumbnails/7.jpg)
By: Navid EinackchiBy: Navid Einackchi Spring 2007Spring 2007
Image alignment and stitching using object recognition methodsImage alignment and stitching using object recognition methods
Image Alignment and StitchingImage Alignment and Stitching
• DefinitionDefinition• ApplicationsApplications
– Mosaic Image
– Panorama
– Virtual Environment
– Robotic
![Page 8: 0 By: Navid Einackchi Isfahan University of Technology Electrical and Computer Department Spring 2007 Image alignment and stitching using Object Recognition](https://reader035.vdocuments.pub/reader035/viewer/2022070307/551aed1455034606048b5ef9/html5/thumbnails/8.jpg)
By: Navid EinackchiBy: Navid Einackchi Spring 2007Spring 2007
Image alignment and stitching using object recognition methodsImage alignment and stitching using object recognition methods
Presentation ProcessPresentation Process
• IntroductionIntroduction– Definition– Aligning Concepts– Stitching Concepts
• Object Recognition ProblemObject Recognition Problem– Salient Feature– What is Descriptor– Matching
• Proposed Method for AligningProposed Method for Aligning– Using Harris Detector– Using SIFT Detector– Stitching
• Concluding and SuggestionsConcluding and Suggestions
![Page 9: 0 By: Navid Einackchi Isfahan University of Technology Electrical and Computer Department Spring 2007 Image alignment and stitching using Object Recognition](https://reader035.vdocuments.pub/reader035/viewer/2022070307/551aed1455034606048b5ef9/html5/thumbnails/9.jpg)
By: Navid EinackchiBy: Navid Einackchi Spring 2007Spring 2007
Image alignment and stitching using object recognition methodsImage alignment and stitching using object recognition methods
Aligning ConceptsAligning Concepts
• Image TransformationsImage Transformations– Applicable Transformations
• Find transformationsFind transformations– How many parameters?
– Calculating Parameters
![Page 10: 0 By: Navid Einackchi Isfahan University of Technology Electrical and Computer Department Spring 2007 Image alignment and stitching using Object Recognition](https://reader035.vdocuments.pub/reader035/viewer/2022070307/551aed1455034606048b5ef9/html5/thumbnails/10.jpg)
By: Navid EinackchiBy: Navid Einackchi Spring 2007Spring 2007
Image alignment and stitching using object recognition methodsImage alignment and stitching using object recognition methods
Image TransformationsImage Transformations
• TransitionTransition– Number of Parameters: 2
– Number of Points: 1
11
y
x
ihg
fed
cba
y
x
![Page 11: 0 By: Navid Einackchi Isfahan University of Technology Electrical and Computer Department Spring 2007 Image alignment and stitching using Object Recognition](https://reader035.vdocuments.pub/reader035/viewer/2022070307/551aed1455034606048b5ef9/html5/thumbnails/11.jpg)
By: Navid EinackchiBy: Navid Einackchi Spring 2007Spring 2007
Image alignment and stitching using object recognition methodsImage alignment and stitching using object recognition methods
Image TransformationsImage Transformations
• EuclideanEuclidean– Number of Parameters: 3
– Number of Points: 2
11
y
x
ihg
fed
cba
y
x
cossin
sincosR
![Page 12: 0 By: Navid Einackchi Isfahan University of Technology Electrical and Computer Department Spring 2007 Image alignment and stitching using Object Recognition](https://reader035.vdocuments.pub/reader035/viewer/2022070307/551aed1455034606048b5ef9/html5/thumbnails/12.jpg)
By: Navid EinackchiBy: Navid Einackchi Spring 2007Spring 2007
Image alignment and stitching using object recognition methodsImage alignment and stitching using object recognition methods
Image TransformationsImage Transformations
• SimilaritySimilarity– Number of Parameters: 4
– Number of Points: 2
11
y
x
ihg
fed
cba
y
x
cos.sin.
sin.cos.
ss
sssR
![Page 13: 0 By: Navid Einackchi Isfahan University of Technology Electrical and Computer Department Spring 2007 Image alignment and stitching using Object Recognition](https://reader035.vdocuments.pub/reader035/viewer/2022070307/551aed1455034606048b5ef9/html5/thumbnails/13.jpg)
By: Navid EinackchiBy: Navid Einackchi Spring 2007Spring 2007
Image alignment and stitching using object recognition methodsImage alignment and stitching using object recognition methods
Image TransformationsImage Transformations
• AffineAffine– Number of Parameters: 6– Number of Points: 3
11
y
x
ihg
fed
cba
y
x
![Page 14: 0 By: Navid Einackchi Isfahan University of Technology Electrical and Computer Department Spring 2007 Image alignment and stitching using Object Recognition](https://reader035.vdocuments.pub/reader035/viewer/2022070307/551aed1455034606048b5ef9/html5/thumbnails/14.jpg)
By: Navid EinackchiBy: Navid Einackchi Spring 2007Spring 2007
Image alignment and stitching using object recognition methodsImage alignment and stitching using object recognition methods
Image TransformationsImage Transformations
• PerspectivePerspective– Number of Parameters: 8– Number of Points: 4
11
y
x
ihg
fed
cba
y
x
1
![Page 15: 0 By: Navid Einackchi Isfahan University of Technology Electrical and Computer Department Spring 2007 Image alignment and stitching using Object Recognition](https://reader035.vdocuments.pub/reader035/viewer/2022070307/551aed1455034606048b5ef9/html5/thumbnails/15.jpg)
By: Navid EinackchiBy: Navid Einackchi Spring 2007Spring 2007
Image alignment and stitching using object recognition methodsImage alignment and stitching using object recognition methods
Image Transformation ComputationImage Transformation Computation
• DirectDirect– Mapping one image into another using different parameters– Define an Error Function based on pixel intensity difference
• Using Corresponding pointsUsing Corresponding points– Obtaining Corresponding points– Computing Transformation parameters using corresponding points
![Page 16: 0 By: Navid Einackchi Isfahan University of Technology Electrical and Computer Department Spring 2007 Image alignment and stitching using Object Recognition](https://reader035.vdocuments.pub/reader035/viewer/2022070307/551aed1455034606048b5ef9/html5/thumbnails/16.jpg)
By: Navid EinackchiBy: Navid Einackchi Spring 2007Spring 2007
Image alignment and stitching using object recognition methodsImage alignment and stitching using object recognition methods
Direct MethodDirect Method
Error Function
![Page 17: 0 By: Navid Einackchi Isfahan University of Technology Electrical and Computer Department Spring 2007 Image alignment and stitching using Object Recognition](https://reader035.vdocuments.pub/reader035/viewer/2022070307/551aed1455034606048b5ef9/html5/thumbnails/17.jpg)
By: Navid EinackchiBy: Navid Einackchi Spring 2007Spring 2007
Image alignment and stitching using object recognition methodsImage alignment and stitching using object recognition methods
Direct MethodDirect Method
Error Function
؟؟
![Page 18: 0 By: Navid Einackchi Isfahan University of Technology Electrical and Computer Department Spring 2007 Image alignment and stitching using Object Recognition](https://reader035.vdocuments.pub/reader035/viewer/2022070307/551aed1455034606048b5ef9/html5/thumbnails/18.jpg)
By: Navid EinackchiBy: Navid Einackchi Spring 2007Spring 2007
Image alignment and stitching using object recognition methodsImage alignment and stitching using object recognition methods
Direct MethodDirect Method
![Page 19: 0 By: Navid Einackchi Isfahan University of Technology Electrical and Computer Department Spring 2007 Image alignment and stitching using Object Recognition](https://reader035.vdocuments.pub/reader035/viewer/2022070307/551aed1455034606048b5ef9/html5/thumbnails/19.jpg)
By: Navid EinackchiBy: Navid Einackchi Spring 2007Spring 2007
Image alignment and stitching using object recognition methodsImage alignment and stitching using object recognition methods
Using Corresponding pointsUsing Corresponding points
![Page 20: 0 By: Navid Einackchi Isfahan University of Technology Electrical and Computer Department Spring 2007 Image alignment and stitching using Object Recognition](https://reader035.vdocuments.pub/reader035/viewer/2022070307/551aed1455034606048b5ef9/html5/thumbnails/20.jpg)
By: Navid EinackchiBy: Navid Einackchi Spring 2007Spring 2007
Image alignment and stitching using object recognition methodsImage alignment and stitching using object recognition methods
Using Corresponding pointsUsing Corresponding points
![Page 21: 0 By: Navid Einackchi Isfahan University of Technology Electrical and Computer Department Spring 2007 Image alignment and stitching using Object Recognition](https://reader035.vdocuments.pub/reader035/viewer/2022070307/551aed1455034606048b5ef9/html5/thumbnails/21.jpg)
By: Navid EinackchiBy: Navid Einackchi Spring 2007Spring 2007
Image alignment and stitching using object recognition methodsImage alignment and stitching using object recognition methods
Using Corresponding pointsUsing Corresponding points
![Page 22: 0 By: Navid Einackchi Isfahan University of Technology Electrical and Computer Department Spring 2007 Image alignment and stitching using Object Recognition](https://reader035.vdocuments.pub/reader035/viewer/2022070307/551aed1455034606048b5ef9/html5/thumbnails/22.jpg)
By: Navid EinackchiBy: Navid Einackchi Spring 2007Spring 2007
Image alignment and stitching using object recognition methodsImage alignment and stitching using object recognition methods
• How many points?How many points?
• How to select?How to select?– Using human
– Automatically
Using Corresponding pointsUsing Corresponding points
![Page 23: 0 By: Navid Einackchi Isfahan University of Technology Electrical and Computer Department Spring 2007 Image alignment and stitching using Object Recognition](https://reader035.vdocuments.pub/reader035/viewer/2022070307/551aed1455034606048b5ef9/html5/thumbnails/23.jpg)
By: Navid EinackchiBy: Navid Einackchi Spring 2007Spring 2007
Image alignment and stitching using object recognition methodsImage alignment and stitching using object recognition methods
Presentation ProcessPresentation Process
•IntroductionIntroduction–Definition
–Aligning Concepts–Stitching Concepts
•Object Recognition ProblemObject Recognition Problem–Salient Feature
–What is Descriptor–Matching
•Proposed Method for AligningProposed Method for Aligning–Using Harris Detector
–Using SIFT Detector–Stitching
•Concluding and SuggestionsConcluding and Suggestions
![Page 24: 0 By: Navid Einackchi Isfahan University of Technology Electrical and Computer Department Spring 2007 Image alignment and stitching using Object Recognition](https://reader035.vdocuments.pub/reader035/viewer/2022070307/551aed1455034606048b5ef9/html5/thumbnails/24.jpg)
By: Navid EinackchiBy: Navid Einackchi Spring 2007Spring 2007
Image alignment and stitching using object recognition methodsImage alignment and stitching using object recognition methods
StitchingStitching
• StitchingStitching• ChoicesChoices
– Final Plane
– Pixel weighting
![Page 25: 0 By: Navid Einackchi Isfahan University of Technology Electrical and Computer Department Spring 2007 Image alignment and stitching using Object Recognition](https://reader035.vdocuments.pub/reader035/viewer/2022070307/551aed1455034606048b5ef9/html5/thumbnails/25.jpg)
By: Navid EinackchiBy: Navid Einackchi Spring 2007Spring 2007
Image alignment and stitching using object recognition methodsImage alignment and stitching using object recognition methods
Presentation ProcessPresentation Process
•IntroductionIntroduction–Definition
–Aligning Concepts–Stitching Concepts
•Object Recognition ProblemObject Recognition Problem–Salient Feature
–What is Descriptor–Matching
•Proposed Method for AligningProposed Method for Aligning–Using Harris Detector
–Using SIFT Detector–Stitching
•Concluding and SuggestionsConcluding and Suggestions
![Page 26: 0 By: Navid Einackchi Isfahan University of Technology Electrical and Computer Department Spring 2007 Image alignment and stitching using Object Recognition](https://reader035.vdocuments.pub/reader035/viewer/2022070307/551aed1455034606048b5ef9/html5/thumbnails/26.jpg)
By: Navid EinackchiBy: Navid Einackchi Spring 2007Spring 2007
Image alignment and stitching using object recognition methodsImage alignment and stitching using object recognition methods
Object Recognition MethodsObject Recognition Methods
• Local Feature DetectionLocal Feature Detection– Edge– Corner– Hole
• Interest Regions MatchingInterest Regions Matching– Appearance Matching– Geometric Matching
• Finding Object Relations in ImageFinding Object Relations in Image
![Page 27: 0 By: Navid Einackchi Isfahan University of Technology Electrical and Computer Department Spring 2007 Image alignment and stitching using Object Recognition](https://reader035.vdocuments.pub/reader035/viewer/2022070307/551aed1455034606048b5ef9/html5/thumbnails/27.jpg)
By: Navid EinackchiBy: Navid Einackchi Spring 2007Spring 2007
Image alignment and stitching using object recognition methodsImage alignment and stitching using object recognition methods
Presentation ProcessPresentation Process
•IntroductionIntroduction–Definition
–Aligning Concepts–Stitching Concepts
•Object Recognition ProblemObject Recognition Problem–Salient Feature
–What is Descriptor–Matching
•Proposed Method for AligningProposed Method for Aligning–Using Harris Detector
–Using SIFT Detector–Stitching
•Concluding and SuggestionsConcluding and Suggestions
![Page 28: 0 By: Navid Einackchi Isfahan University of Technology Electrical and Computer Department Spring 2007 Image alignment and stitching using Object Recognition](https://reader035.vdocuments.pub/reader035/viewer/2022070307/551aed1455034606048b5ef9/html5/thumbnails/28.jpg)
By: Navid EinackchiBy: Navid Einackchi Spring 2007Spring 2007
Image alignment and stitching using object recognition methodsImage alignment and stitching using object recognition methods
Salient FeaturesSalient Features
• Features of Feature!Features of Feature!– Invariants against transformations– Ability to explain the image– Ability to being Matched (Repeatability)
• Selected FeaturesSelected Features– Corners– Holes
![Page 29: 0 By: Navid Einackchi Isfahan University of Technology Electrical and Computer Department Spring 2007 Image alignment and stitching using Object Recognition](https://reader035.vdocuments.pub/reader035/viewer/2022070307/551aed1455034606048b5ef9/html5/thumbnails/29.jpg)
By: Navid EinackchiBy: Navid Einackchi Spring 2007Spring 2007
Image alignment and stitching using object recognition methodsImage alignment and stitching using object recognition methods
Harris DetectorHarris Detector
PlainNo changes in every direction
EdgeHigh changes in Edge
Direction
CornerHigh changes in every
direction
![Page 30: 0 By: Navid Einackchi Isfahan University of Technology Electrical and Computer Department Spring 2007 Image alignment and stitching using Object Recognition](https://reader035.vdocuments.pub/reader035/viewer/2022070307/551aed1455034606048b5ef9/html5/thumbnails/30.jpg)
By: Navid EinackchiBy: Navid Einackchi Spring 2007Spring 2007
Image alignment and stitching using object recognition methodsImage alignment and stitching using object recognition methods
Harris DetectorHarris Detector(Continued)(Continued)
2
2,
( , ) x x y
x y x y y
I I IM w x y
I I I
Slow change
direction
Fast change Direction
(max)-1/2
(min)-1/2
![Page 31: 0 By: Navid Einackchi Isfahan University of Technology Electrical and Computer Department Spring 2007 Image alignment and stitching using Object Recognition](https://reader035.vdocuments.pub/reader035/viewer/2022070307/551aed1455034606048b5ef9/html5/thumbnails/31.jpg)
By: Navid EinackchiBy: Navid Einackchi Spring 2007Spring 2007
Image alignment and stitching using object recognition methodsImage alignment and stitching using object recognition methods
Harris DetectorHarris Detector(Continued)(Continued)
1
2
“Corner” 1, 2 both bigboth big
1 ~ 2
Edge1 >> 2
Edge2 >> 1
Plain
![Page 32: 0 By: Navid Einackchi Isfahan University of Technology Electrical and Computer Department Spring 2007 Image alignment and stitching using Object Recognition](https://reader035.vdocuments.pub/reader035/viewer/2022070307/551aed1455034606048b5ef9/html5/thumbnails/32.jpg)
By: Navid EinackchiBy: Navid Einackchi Spring 2007Spring 2007
Image alignment and stitching using object recognition methodsImage alignment and stitching using object recognition methods
Harris DetectorHarris Detector(Continued)(Continued)
•Harris measurementHarris measurement
2det traceR M k M
1 2
1 2
det
trace
M
M
![Page 33: 0 By: Navid Einackchi Isfahan University of Technology Electrical and Computer Department Spring 2007 Image alignment and stitching using Object Recognition](https://reader035.vdocuments.pub/reader035/viewer/2022070307/551aed1455034606048b5ef9/html5/thumbnails/33.jpg)
By: Navid EinackchiBy: Navid Einackchi Spring 2007Spring 2007
Image alignment and stitching using object recognition methodsImage alignment and stitching using object recognition methods
Harris DetectorHarris Detector(Continued)(Continued)
•Harris measurement responseHarris measurement response
1
2
“Corner”
“Edge”
“Edge”
“Plain”
R > 0
R < 0
R < 0|R| small
Local Maxim
um bigger than Threshold
Local Maxim
um bigger than Threshold
![Page 34: 0 By: Navid Einackchi Isfahan University of Technology Electrical and Computer Department Spring 2007 Image alignment and stitching using Object Recognition](https://reader035.vdocuments.pub/reader035/viewer/2022070307/551aed1455034606048b5ef9/html5/thumbnails/34.jpg)
By: Navid EinackchiBy: Navid Einackchi Spring 2007Spring 2007
Image alignment and stitching using object recognition methodsImage alignment and stitching using object recognition methods
Harris DetectorHarris Detector(Continued)(Continued)
• FeaturesFeatures– Invariant against rotation
– Invariant against intensity
R
x
Threshold
R
x
![Page 35: 0 By: Navid Einackchi Isfahan University of Technology Electrical and Computer Department Spring 2007 Image alignment and stitching using Object Recognition](https://reader035.vdocuments.pub/reader035/viewer/2022070307/551aed1455034606048b5ef9/html5/thumbnails/35.jpg)
By: Navid EinackchiBy: Navid Einackchi Spring 2007Spring 2007
Image alignment and stitching using object recognition methodsImage alignment and stitching using object recognition methods
Harris DetectorHarris Detector(Continued)(Continued)
•ExampleExample
![Page 36: 0 By: Navid Einackchi Isfahan University of Technology Electrical and Computer Department Spring 2007 Image alignment and stitching using Object Recognition](https://reader035.vdocuments.pub/reader035/viewer/2022070307/551aed1455034606048b5ef9/html5/thumbnails/36.jpg)
By: Navid EinackchiBy: Navid Einackchi Spring 2007Spring 2007
Image alignment and stitching using object recognition methodsImage alignment and stitching using object recognition methods
• Scale ProblemScale Problem
Scale InvariantScale Invariant
![Page 37: 0 By: Navid Einackchi Isfahan University of Technology Electrical and Computer Department Spring 2007 Image alignment and stitching using Object Recognition](https://reader035.vdocuments.pub/reader035/viewer/2022070307/551aed1455034606048b5ef9/html5/thumbnails/37.jpg)
By: Navid EinackchiBy: Navid Einackchi Spring 2007Spring 2007
Image alignment and stitching using object recognition methodsImage alignment and stitching using object recognition methods
Scale InvariantScale Invariant
Finding Appropriate Window Size
Finding Appropriate Window Size
![Page 38: 0 By: Navid Einackchi Isfahan University of Technology Electrical and Computer Department Spring 2007 Image alignment and stitching using Object Recognition](https://reader035.vdocuments.pub/reader035/viewer/2022070307/551aed1455034606048b5ef9/html5/thumbnails/38.jpg)
By: Navid EinackchiBy: Navid Einackchi Spring 2007Spring 2007
Image alignment and stitching using object recognition methodsImage alignment and stitching using object recognition methods
Scale SelectionScale Selection
• Using Differential of Gaussian FiltersUsing Differential of Gaussian Filters– Laplacian of Gaussian (LoG)– Difference of Gaussian (DoG)
- =Window thst m
aximize fil
ter
Window thst m
aximize fil
ter
![Page 39: 0 By: Navid Einackchi Isfahan University of Technology Electrical and Computer Department Spring 2007 Image alignment and stitching using Object Recognition](https://reader035.vdocuments.pub/reader035/viewer/2022070307/551aed1455034606048b5ef9/html5/thumbnails/39.jpg)
By: Navid EinackchiBy: Navid Einackchi Spring 2007Spring 2007
Image alignment and stitching using object recognition methodsImage alignment and stitching using object recognition methods
![Page 40: 0 By: Navid Einackchi Isfahan University of Technology Electrical and Computer Department Spring 2007 Image alignment and stitching using Object Recognition](https://reader035.vdocuments.pub/reader035/viewer/2022070307/551aed1455034606048b5ef9/html5/thumbnails/40.jpg)
By: Navid EinackchiBy: Navid Einackchi Spring 2007Spring 2007
Image alignment and stitching using object recognition methodsImage alignment and stitching using object recognition methods
Automatic Scale SelectionAutomatic Scale Selection
![Page 41: 0 By: Navid Einackchi Isfahan University of Technology Electrical and Computer Department Spring 2007 Image alignment and stitching using Object Recognition](https://reader035.vdocuments.pub/reader035/viewer/2022070307/551aed1455034606048b5ef9/html5/thumbnails/41.jpg)
By: Navid EinackchiBy: Navid Einackchi Spring 2007Spring 2007
Image alignment and stitching using object recognition methodsImage alignment and stitching using object recognition methods
Automatic Scale SelectionAutomatic Scale Selection
![Page 42: 0 By: Navid Einackchi Isfahan University of Technology Electrical and Computer Department Spring 2007 Image alignment and stitching using Object Recognition](https://reader035.vdocuments.pub/reader035/viewer/2022070307/551aed1455034606048b5ef9/html5/thumbnails/42.jpg)
By: Navid EinackchiBy: Navid Einackchi Spring 2007Spring 2007
Image alignment and stitching using object recognition methodsImage alignment and stitching using object recognition methods
SIFT Detector SIFT Detector
• Bulb DetectorBulb Detector• Invariant against scaleInvariant against scale• Using DoGUsing DoG
– Bulb detection
– Scale detection
مقیاس
x
y
DoG
DoG
![Page 43: 0 By: Navid Einackchi Isfahan University of Technology Electrical and Computer Department Spring 2007 Image alignment and stitching using Object Recognition](https://reader035.vdocuments.pub/reader035/viewer/2022070307/551aed1455034606048b5ef9/html5/thumbnails/43.jpg)
By: Navid EinackchiBy: Navid Einackchi Spring 2007Spring 2007
Image alignment and stitching using object recognition methodsImage alignment and stitching using object recognition methods
SIFT DetectorSIFT Detector
• Detecting Bulb and Scale SimultaneouslyDetecting Bulb and Scale Simultaneously– Bulb position = maximum in plain
– Scale = maximum in third dimension
Bulb position
Scale position
![Page 44: 0 By: Navid Einackchi Isfahan University of Technology Electrical and Computer Department Spring 2007 Image alignment and stitching using Object Recognition](https://reader035.vdocuments.pub/reader035/viewer/2022070307/551aed1455034606048b5ef9/html5/thumbnails/44.jpg)
By: Navid EinackchiBy: Navid Einackchi Spring 2007Spring 2007
Image alignment and stitching using object recognition methodsImage alignment and stitching using object recognition methods
![Page 45: 0 By: Navid Einackchi Isfahan University of Technology Electrical and Computer Department Spring 2007 Image alignment and stitching using Object Recognition](https://reader035.vdocuments.pub/reader035/viewer/2022070307/551aed1455034606048b5ef9/html5/thumbnails/45.jpg)
By: Navid EinackchiBy: Navid Einackchi Spring 2007Spring 2007
Image alignment and stitching using object recognition methodsImage alignment and stitching using object recognition methods
Presentation ProcessPresentation Process
•IntroductionIntroduction–Definition
–Aligning Concepts–Stitching Concepts
•Object Recognition ProblemObject Recognition Problem–Salient Feature
–What is Descriptor–Matching
•Proposed Method for AligningProposed Method for Aligning–Using Harris Detector
–Using SIFT Detector–Stitching
•Concluding and SuggestionsConcluding and Suggestions
![Page 46: 0 By: Navid Einackchi Isfahan University of Technology Electrical and Computer Department Spring 2007 Image alignment and stitching using Object Recognition](https://reader035.vdocuments.pub/reader035/viewer/2022070307/551aed1455034606048b5ef9/html5/thumbnails/46.jpg)
By: Navid EinackchiBy: Navid Einackchi Spring 2007Spring 2007
Image alignment and stitching using object recognition methodsImage alignment and stitching using object recognition methods
DescriptorDescriptor
• Vector which describes region of interest pointVector which describes region of interest point– Pixels– Histogram– Differential
• Feature of DescriptorFeature of Descriptor– Invariant against image distortion (view, angle, intensity)– Able to express similarities and differences
![Page 47: 0 By: Navid Einackchi Isfahan University of Technology Electrical and Computer Department Spring 2007 Image alignment and stitching using Object Recognition](https://reader035.vdocuments.pub/reader035/viewer/2022070307/551aed1455034606048b5ef9/html5/thumbnails/47.jpg)
By: Navid EinackchiBy: Navid Einackchi Spring 2007Spring 2007
Image alignment and stitching using object recognition methodsImage alignment and stitching using object recognition methods
SIFT DescriptorSIFT Descriptor
• Based on value and direction of gradientsBased on value and direction of gradients• 128 dimensional Vector128 dimensional Vector• ConstructionConstruction
1. Calculation of value and direction of gradient of each pixel
2. Making direction histogram of gradients
3. Rotating interest region based on dominant direction
4. Dividing the region into 16 region
5. Constructing direction histogram for each region
0
![Page 48: 0 By: Navid Einackchi Isfahan University of Technology Electrical and Computer Department Spring 2007 Image alignment and stitching using Object Recognition](https://reader035.vdocuments.pub/reader035/viewer/2022070307/551aed1455034606048b5ef9/html5/thumbnails/48.jpg)
By: Navid EinackchiBy: Navid Einackchi Spring 2007Spring 2007
Image alignment and stitching using object recognition methodsImage alignment and stitching using object recognition methods
Construction ExampleConstruction Example
![Page 49: 0 By: Navid Einackchi Isfahan University of Technology Electrical and Computer Department Spring 2007 Image alignment and stitching using Object Recognition](https://reader035.vdocuments.pub/reader035/viewer/2022070307/551aed1455034606048b5ef9/html5/thumbnails/49.jpg)
By: Navid EinackchiBy: Navid Einackchi Spring 2007Spring 2007
Image alignment and stitching using object recognition methodsImage alignment and stitching using object recognition methods
DescriptorDescriptor FeaturesFeatures
• Invariant againstInvariant against– Rotation– Position– Affine changes in intensity (I Ia + b)
![Page 50: 0 By: Navid Einackchi Isfahan University of Technology Electrical and Computer Department Spring 2007 Image alignment and stitching using Object Recognition](https://reader035.vdocuments.pub/reader035/viewer/2022070307/551aed1455034606048b5ef9/html5/thumbnails/50.jpg)
By: Navid EinackchiBy: Navid Einackchi Spring 2007Spring 2007
Image alignment and stitching using object recognition methodsImage alignment and stitching using object recognition methods
Presentation ProcessPresentation Process
• IntroductionIntroduction– Definition– Aligning Concepts– Stitching Concepts
• Object Recognition ProblemObject Recognition Problem– Salient Feature– What is Descriptor– Matching
• Proposed Method for AligningProposed Method for Aligning– Using Harris Detector– Using SIFT Detector– Stitching
• Concluding and SuggestionsConcluding and Suggestions
![Page 51: 0 By: Navid Einackchi Isfahan University of Technology Electrical and Computer Department Spring 2007 Image alignment and stitching using Object Recognition](https://reader035.vdocuments.pub/reader035/viewer/2022070307/551aed1455034606048b5ef9/html5/thumbnails/51.jpg)
By: Navid EinackchiBy: Navid Einackchi Spring 2007Spring 2007
Image alignment and stitching using object recognition methodsImage alignment and stitching using object recognition methods
MatchingMatching
• Appearance MatchingAppearance Matching– Comparing distance of each two descriptors– Euclidean Distance– K nearest neighbor
• Geometrical MatchingGeometrical Matching– Based on geometrical relations between points– Estimation of image transformation– Rejecting false corresponding points
![Page 52: 0 By: Navid Einackchi Isfahan University of Technology Electrical and Computer Department Spring 2007 Image alignment and stitching using Object Recognition](https://reader035.vdocuments.pub/reader035/viewer/2022070307/551aed1455034606048b5ef9/html5/thumbnails/52.jpg)
By: Navid EinackchiBy: Navid Einackchi Spring 2007Spring 2007
Image alignment and stitching using object recognition methodsImage alignment and stitching using object recognition methods
Example of Geometrical MatchingExample of Geometrical Matching
![Page 53: 0 By: Navid Einackchi Isfahan University of Technology Electrical and Computer Department Spring 2007 Image alignment and stitching using Object Recognition](https://reader035.vdocuments.pub/reader035/viewer/2022070307/551aed1455034606048b5ef9/html5/thumbnails/53.jpg)
By: Navid EinackchiBy: Navid Einackchi Spring 2007Spring 2007
Image alignment and stitching using object recognition methodsImage alignment and stitching using object recognition methods
Automatically image alignmentAutomatically image alignment
• Direct MethodDirect Method
• Based on interest pointsBased on interest points
![Page 54: 0 By: Navid Einackchi Isfahan University of Technology Electrical and Computer Department Spring 2007 Image alignment and stitching using Object Recognition](https://reader035.vdocuments.pub/reader035/viewer/2022070307/551aed1455034606048b5ef9/html5/thumbnails/54.jpg)
By: Navid EinackchiBy: Navid Einackchi Spring 2007Spring 2007
Image alignment and stitching using object recognition methodsImage alignment and stitching using object recognition methods
CompareCompare
Interest pointsInterest points Direct MethodDirect Method
LowLow (Order of number of interest (Order of number of interest
points)points)
HighHigh((order of number of pixelsorder of number of pixels))
Time and Memory Time and Memory orderorder
HighHighLowLow
((Based on pixel intensityBased on pixel intensity))Resisting against Resisting against intensity changesintensity changes
YesYes NoNoAbility to recognize Ability to recognize
corresponding corresponding imageimage
![Page 55: 0 By: Navid Einackchi Isfahan University of Technology Electrical and Computer Department Spring 2007 Image alignment and stitching using Object Recognition](https://reader035.vdocuments.pub/reader035/viewer/2022070307/551aed1455034606048b5ef9/html5/thumbnails/55.jpg)
By: Navid EinackchiBy: Navid Einackchi Spring 2007Spring 2007
Image alignment and stitching using object recognition methodsImage alignment and stitching using object recognition methods
Presentation ProcessPresentation Process
•IntroductionIntroduction–Definition
–Aligning Concepts–Stitching Concepts
•Object Recognition ProblemObject Recognition Problem–Salient Feature
–What is Descriptor–Matching
•Proposed Method for AligningProposed Method for Aligning–Using Harris Detector
–Using SIFT Detector–Stitching
•Concluding and SuggestionsConcluding and Suggestions
![Page 56: 0 By: Navid Einackchi Isfahan University of Technology Electrical and Computer Department Spring 2007 Image alignment and stitching using Object Recognition](https://reader035.vdocuments.pub/reader035/viewer/2022070307/551aed1455034606048b5ef9/html5/thumbnails/56.jpg)
By: Navid EinackchiBy: Navid Einackchi Spring 2007Spring 2007
Image alignment and stitching using object recognition methodsImage alignment and stitching using object recognition methods
Brown and Lowe AlgorithmBrown and Lowe Algorithm
O(nO(n44 m m44))
![Page 57: 0 By: Navid Einackchi Isfahan University of Technology Electrical and Computer Department Spring 2007 Image alignment and stitching using Object Recognition](https://reader035.vdocuments.pub/reader035/viewer/2022070307/551aed1455034606048b5ef9/html5/thumbnails/57.jpg)
By: Navid EinackchiBy: Navid Einackchi Spring 2007Spring 2007
Image alignment and stitching using object recognition methodsImage alignment and stitching using object recognition methods
Brown and Lowe AlgorithmBrown and Lowe Algorithm
![Page 58: 0 By: Navid Einackchi Isfahan University of Technology Electrical and Computer Department Spring 2007 Image alignment and stitching using Object Recognition](https://reader035.vdocuments.pub/reader035/viewer/2022070307/551aed1455034606048b5ef9/html5/thumbnails/58.jpg)
By: Navid EinackchiBy: Navid Einackchi Spring 2007Spring 2007
Image alignment and stitching using object recognition methodsImage alignment and stitching using object recognition methods
Brown and Lowe AlgorithmBrown and Lowe Algorithm
![Page 59: 0 By: Navid Einackchi Isfahan University of Technology Electrical and Computer Department Spring 2007 Image alignment and stitching using Object Recognition](https://reader035.vdocuments.pub/reader035/viewer/2022070307/551aed1455034606048b5ef9/html5/thumbnails/59.jpg)
By: Navid EinackchiBy: Navid Einackchi Spring 2007Spring 2007
Image alignment and stitching using object recognition methodsImage alignment and stitching using object recognition methods
Similarity Transform rather than perspectiveSimilarity Transform rather than perspective
• WhyWhy– Detector are unable to handle perspective – Small portion of each images is overlapped– Increasing the tolerance of true corresponding
• So We use Similarity TransformationSo We use Similarity Transformation
![Page 60: 0 By: Navid Einackchi Isfahan University of Technology Electrical and Computer Department Spring 2007 Image alignment and stitching using Object Recognition](https://reader035.vdocuments.pub/reader035/viewer/2022070307/551aed1455034606048b5ef9/html5/thumbnails/60.jpg)
By: Navid EinackchiBy: Navid Einackchi Spring 2007Spring 2007
Image alignment and stitching using object recognition methodsImage alignment and stitching using object recognition methods
Presentation ProcessPresentation Process
• IntroductionIntroduction– Definition– Aligning Concepts– Stitching Concepts
• Object Recognition ProblemObject Recognition Problem– Salient Feature– What is Descriptor– Matching
• Proposed Method for AligningProposed Method for Aligning– Using Harris Detector– Using SIFT Detector– Stitching
• Concluding and SuggestionsConcluding and Suggestions
![Page 61: 0 By: Navid Einackchi Isfahan University of Technology Electrical and Computer Department Spring 2007 Image alignment and stitching using Object Recognition](https://reader035.vdocuments.pub/reader035/viewer/2022070307/551aed1455034606048b5ef9/html5/thumbnails/61.jpg)
By: Navid EinackchiBy: Navid Einackchi Spring 2007Spring 2007
Image alignment and stitching using object recognition methodsImage alignment and stitching using object recognition methods
First Proposed AlgorithmFirst Proposed Algorithm
1.1. Detecting Interest points using Harris detectorDetecting Interest points using Harris detector
2.2. Defining descriptors for each pointDefining descriptors for each point
3.3. Finding corresponding points using appearanceFinding corresponding points using appearance• Comparing interest points with each other
• K Nearest Neighbor
4.4. Finding relation between 2 imagesFinding relation between 2 images• Using Similarity
• Based on voting
5.5. Rejecting wrong corresponding points based on geometrical relationsRejecting wrong corresponding points based on geometrical relations
![Page 62: 0 By: Navid Einackchi Isfahan University of Technology Electrical and Computer Department Spring 2007 Image alignment and stitching using Object Recognition](https://reader035.vdocuments.pub/reader035/viewer/2022070307/551aed1455034606048b5ef9/html5/thumbnails/62.jpg)
By: Navid EinackchiBy: Navid Einackchi Spring 2007Spring 2007
Image alignment and stitching using object recognition methodsImage alignment and stitching using object recognition methods
First Proposed AlgorithmFirst Proposed Algorithm
1.1. Detecting Interest points using Harris detectorDetecting Interest points using Harris detector
2.2. Defining descriptors for each pointDefining descriptors for each point
3.3. Finding corresponding points using appearanceFinding corresponding points using appearance• Comparing interest points with each other
• K Nearest Neighbor
4.4. Finding relation between 2 imagesFinding relation between 2 images• Using Similarity
• Based on voting
5.5. Rejecting wrong corresponding points based on geometrical relationsRejecting wrong corresponding points based on geometrical relations
![Page 63: 0 By: Navid Einackchi Isfahan University of Technology Electrical and Computer Department Spring 2007 Image alignment and stitching using Object Recognition](https://reader035.vdocuments.pub/reader035/viewer/2022070307/551aed1455034606048b5ef9/html5/thumbnails/63.jpg)
By: Navid EinackchiBy: Navid Einackchi Spring 2007Spring 2007
Image alignment and stitching using object recognition methodsImage alignment and stitching using object recognition methods
Voting MechanismVoting Mechanism
![Page 64: 0 By: Navid Einackchi Isfahan University of Technology Electrical and Computer Department Spring 2007 Image alignment and stitching using Object Recognition](https://reader035.vdocuments.pub/reader035/viewer/2022070307/551aed1455034606048b5ef9/html5/thumbnails/64.jpg)
By: Navid EinackchiBy: Navid Einackchi Spring 2007Spring 2007
Image alignment and stitching using object recognition methodsImage alignment and stitching using object recognition methods
100
0cossin
0sincos
ss
ss
similarityT
Voting MechanismVoting Mechanism
Sc
ale
Sc
ale
Angle
O(nO(n22 m m22)) از مرتبهاز مرتبه
3469
2255
![Page 65: 0 By: Navid Einackchi Isfahan University of Technology Electrical and Computer Department Spring 2007 Image alignment and stitching using Object Recognition](https://reader035.vdocuments.pub/reader035/viewer/2022070307/551aed1455034606048b5ef9/html5/thumbnails/65.jpg)
By: Navid EinackchiBy: Navid Einackchi Spring 2007Spring 2007
Image alignment and stitching using object recognition methodsImage alignment and stitching using object recognition methods
Applied Rotation
Estimated Rotation
Applied Scale
Estimated Scale
EvaluationEvaluation
![Page 66: 0 By: Navid Einackchi Isfahan University of Technology Electrical and Computer Department Spring 2007 Image alignment and stitching using Object Recognition](https://reader035.vdocuments.pub/reader035/viewer/2022070307/551aed1455034606048b5ef9/html5/thumbnails/66.jpg)
By: Navid EinackchiBy: Navid Einackchi Spring 2007Spring 2007
Image alignment and stitching using object recognition methodsImage alignment and stitching using object recognition methods
ConcludingConcluding
• Very good for rotationVery good for rotation• Good for little scalingGood for little scaling• Weak for big scalingWeak for big scaling
– Due to Harris detector weakness
![Page 67: 0 By: Navid Einackchi Isfahan University of Technology Electrical and Computer Department Spring 2007 Image alignment and stitching using Object Recognition](https://reader035.vdocuments.pub/reader035/viewer/2022070307/551aed1455034606048b5ef9/html5/thumbnails/67.jpg)
By: Navid EinackchiBy: Navid Einackchi Spring 2007Spring 2007
Image alignment and stitching using object recognition methodsImage alignment and stitching using object recognition methods
Presentation ProcessPresentation Process
•IntroductionIntroduction–Definition
–Aligning Concepts–Stitching Concepts
•Object Recognition ProblemObject Recognition Problem–Salient Feature
–What is Descriptor–Matching
•Proposed Method for AligningProposed Method for Aligning–Using Harris Detector–Using SIFT Detector
–Stitching
•Concluding and SuggestionsConcluding and Suggestions
![Page 68: 0 By: Navid Einackchi Isfahan University of Technology Electrical and Computer Department Spring 2007 Image alignment and stitching using Object Recognition](https://reader035.vdocuments.pub/reader035/viewer/2022070307/551aed1455034606048b5ef9/html5/thumbnails/68.jpg)
By: Navid EinackchiBy: Navid Einackchi Spring 2007Spring 2007
Image alignment and stitching using object recognition methodsImage alignment and stitching using object recognition methods
ImprovementImprovement
• Using less time order algorithmUsing less time order algorithm
• Using Scale Invariant Feature TransformUsing Scale Invariant Feature Transform
![Page 69: 0 By: Navid Einackchi Isfahan University of Technology Electrical and Computer Department Spring 2007 Image alignment and stitching using Object Recognition](https://reader035.vdocuments.pub/reader035/viewer/2022070307/551aed1455034606048b5ef9/html5/thumbnails/69.jpg)
By: Navid EinackchiBy: Navid Einackchi Spring 2007Spring 2007
Image alignment and stitching using object recognition methodsImage alignment and stitching using object recognition methods
Second proposed AlgorithmSecond proposed Algorithm
1.1. Detecting Interest pointsDetecting Interest points• SIFT Detector
2.2. Finding Corresponding pointsFinding Corresponding points• Based on appearance• Using k-d tree• Distance ratio threshold
3.3. Finding relation between imagesFinding relation between images• Voting on step 2 based on Appearance corresponding
4.4. Rejecting wrong corresponding pointsRejecting wrong corresponding points• Based on geometric relations between points
![Page 70: 0 By: Navid Einackchi Isfahan University of Technology Electrical and Computer Department Spring 2007 Image alignment and stitching using Object Recognition](https://reader035.vdocuments.pub/reader035/viewer/2022070307/551aed1455034606048b5ef9/html5/thumbnails/70.jpg)
By: Navid EinackchiBy: Navid Einackchi Spring 2007Spring 2007
Image alignment and stitching using object recognition methodsImage alignment and stitching using object recognition methods
Distance Ration ThresholdDistance Ration Threshold
• Find 1NN and its distance = D1Find 1NN and its distance = D1• Find 2NN and its distance = D2Find 2NN and its distance = D2• Find ratio of these distances (D1/D2 = ratio)Find ratio of these distances (D1/D2 = ratio)
– If Lower than threshold -> reject
– Else accept
![Page 71: 0 By: Navid Einackchi Isfahan University of Technology Electrical and Computer Department Spring 2007 Image alignment and stitching using Object Recognition](https://reader035.vdocuments.pub/reader035/viewer/2022070307/551aed1455034606048b5ef9/html5/thumbnails/71.jpg)
By: Navid EinackchiBy: Navid Einackchi Spring 2007Spring 2007
Image alignment and stitching using object recognition methodsImage alignment and stitching using object recognition methods
Distance Ration ThresholdDistance Ration ThresholdMy ImprovementMy Improvement
• Find 1NN and its distance = D1Find 1NN and its distance = D1• Multiply D1 by ratio = rangeMultiply D1 by ratio = range• Look for range in k-d treeLook for range in k-d tree
![Page 72: 0 By: Navid Einackchi Isfahan University of Technology Electrical and Computer Department Spring 2007 Image alignment and stitching using Object Recognition](https://reader035.vdocuments.pub/reader035/viewer/2022070307/551aed1455034606048b5ef9/html5/thumbnails/72.jpg)
By: Navid EinackchiBy: Navid Einackchi Spring 2007Spring 2007
Image alignment and stitching using object recognition methodsImage alignment and stitching using object recognition methods
Results of threshold on ratioResults of threshold on ratio
• Threshold Ratio = 0.5Threshold Ratio = 0.5
![Page 73: 0 By: Navid Einackchi Isfahan University of Technology Electrical and Computer Department Spring 2007 Image alignment and stitching using Object Recognition](https://reader035.vdocuments.pub/reader035/viewer/2022070307/551aed1455034606048b5ef9/html5/thumbnails/73.jpg)
By: Navid EinackchiBy: Navid Einackchi Spring 2007Spring 2007
Image alignment and stitching using object recognition methodsImage alignment and stitching using object recognition methods
Results of threshold on ratioResults of threshold on ratio
• Threshold Ratio = 0.7Threshold Ratio = 0.7
![Page 74: 0 By: Navid Einackchi Isfahan University of Technology Electrical and Computer Department Spring 2007 Image alignment and stitching using Object Recognition](https://reader035.vdocuments.pub/reader035/viewer/2022070307/551aed1455034606048b5ef9/html5/thumbnails/74.jpg)
By: Navid EinackchiBy: Navid Einackchi Spring 2007Spring 2007
Image alignment and stitching using object recognition methodsImage alignment and stitching using object recognition methods
Second proposed AlgorithmSecond proposed Algorithm
1.1. Detecting Interest pointsDetecting Interest points• SIFT Detector
2.2. Finding Corresponding pointsFinding Corresponding points• Based on appearance• Using k-d tree• Distance ratio threshold
3.3. Finding relation between imagesFinding relation between images• Voting on step 2 based on Appearance corresponding
4.4. Rejecting wrong corresponding pointsRejecting wrong corresponding points• Based on geometric relations between points
![Page 75: 0 By: Navid Einackchi Isfahan University of Technology Electrical and Computer Department Spring 2007 Image alignment and stitching using Object Recognition](https://reader035.vdocuments.pub/reader035/viewer/2022070307/551aed1455034606048b5ef9/html5/thumbnails/75.jpg)
By: Navid EinackchiBy: Navid Einackchi Spring 2007Spring 2007
Image alignment and stitching using object recognition methodsImage alignment and stitching using object recognition methods
• Each interest point hasEach interest point has– Dominant Direction
– Scale
• Use this information for votingUse this information for voting
Estimating Geometrical Estimating Geometrical RelationRelation
![Page 76: 0 By: Navid Einackchi Isfahan University of Technology Electrical and Computer Department Spring 2007 Image alignment and stitching using Object Recognition](https://reader035.vdocuments.pub/reader035/viewer/2022070307/551aed1455034606048b5ef9/html5/thumbnails/76.jpg)
By: Navid EinackchiBy: Navid Einackchi Spring 2007Spring 2007
Image alignment and stitching using object recognition methodsImage alignment and stitching using object recognition methods
Estimation HistogramEstimation Histogram
Using threshold methodUsing 3NN method
Sca
leS
cale
Direction
Sca
leS
cale
Direction
O(nm)O(nm)
O(n)O(n)
Maximum Maximum
![Page 77: 0 By: Navid Einackchi Isfahan University of Technology Electrical and Computer Department Spring 2007 Image alignment and stitching using Object Recognition](https://reader035.vdocuments.pub/reader035/viewer/2022070307/551aed1455034606048b5ef9/html5/thumbnails/77.jpg)
By: Navid EinackchiBy: Navid Einackchi Spring 2007Spring 2007
Image alignment and stitching using object recognition methodsImage alignment and stitching using object recognition methods
Percent of True Corresponding
True Corresponding Points
Potential Corresponding points
Method
487% 19 39 Distance Ratio t=0.5
46% 23 50 Distance Ratio t=0.6
333% 27 81 Distance Ratio t=0.7
17% 44 259 Distance Ratio t=0.9
0.06% 49 710 Distance Ratio t=1
0.07% 52 710*2→710 2 Nearest Neighbor
0.07% 53 710*3→710 3 Nearest Neighbor
0.08% 57 710*4→710 4 Nearest Neighbor
Comparing Knn and Ratio Threshold settingComparing Knn and Ratio Threshold settingBased on Number of true corresponding pointsBased on Number of true corresponding points
![Page 78: 0 By: Navid Einackchi Isfahan University of Technology Electrical and Computer Department Spring 2007 Image alignment and stitching using Object Recognition](https://reader035.vdocuments.pub/reader035/viewer/2022070307/551aed1455034606048b5ef9/html5/thumbnails/78.jpg)
By: Navid EinackchiBy: Navid Einackchi Spring 2007Spring 2007
Image alignment and stitching using object recognition methodsImage alignment and stitching using object recognition methods
Comparing Knn and Ratio Threshold settingComparing Knn and Ratio Threshold settingBased on Number of true corresponding pointsBased on Number of true corresponding points
Percent of True Corresponding
True Corresponding Points
Potential Corresponding points
Method
487% 19 39 Distance Ratio t=0.5
46% 23 50 Distance Ratio t=0.6
333% 27 81 Distance Ratio t=0.7
17% 44 259 Distance Ratio t=0.9
0.06% 49 710 Distance Ratio t=1
0.07% 52 710*2→710 2 Nearest Neighbor
0.07% 53 710*3→710 3 Nearest Neighbor
0.08% 57 710*4→710 4 Nearest Neighbor
![Page 79: 0 By: Navid Einackchi Isfahan University of Technology Electrical and Computer Department Spring 2007 Image alignment and stitching using Object Recognition](https://reader035.vdocuments.pub/reader035/viewer/2022070307/551aed1455034606048b5ef9/html5/thumbnails/79.jpg)
By: Navid EinackchiBy: Navid Einackchi Spring 2007Spring 2007
Image alignment and stitching using object recognition methodsImage alignment and stitching using object recognition methods
Ratio Difference 2nd Maximum 1st Maximum Method
8.57 26.5 3.5 30 Distance Ratio t=0.5
7.75 27 4 31 Distance Ratio t=0.6
6.85 30.75 5.25 36 Distance Ratio t=0.7
1.95 46 48 94 2 Nearest Neighbor
1.46 36 78 114 3 Nearest Neighbor
1.35 36 101 137 4 Nearest Neighbor
Comparing Knn and Ratio Threshold settingComparing Knn and Ratio Threshold setting(In Tolerating False Corresponding)(In Tolerating False Corresponding)
![Page 80: 0 By: Navid Einackchi Isfahan University of Technology Electrical and Computer Department Spring 2007 Image alignment and stitching using Object Recognition](https://reader035.vdocuments.pub/reader035/viewer/2022070307/551aed1455034606048b5ef9/html5/thumbnails/80.jpg)
By: Navid EinackchiBy: Navid Einackchi Spring 2007Spring 2007
Image alignment and stitching using object recognition methodsImage alignment and stitching using object recognition methods
Comparing Knn and Ratio Threshold settingComparing Knn and Ratio Threshold setting(In Tolerating False Corresponding)(In Tolerating False Corresponding)
Ratio Difference 2nd Maximum 1st Maximum Method
8.57 26.5 3.5 30 Distance Ratio t=0.5
7.75 27 4 31 Distance Ratio t=0.6
6.85 30.75 5.25 36 Distance Ratio t=0.7
1.95 46 48 94 2 Nearest Neighbor
1.46 36 78 114 3 Nearest Neighbor
1.35 36 101 137 4 Nearest Neighbor
![Page 81: 0 By: Navid Einackchi Isfahan University of Technology Electrical and Computer Department Spring 2007 Image alignment and stitching using Object Recognition](https://reader035.vdocuments.pub/reader035/viewer/2022070307/551aed1455034606048b5ef9/html5/thumbnails/81.jpg)
By: Navid EinackchiBy: Navid Einackchi Spring 2007Spring 2007
Image alignment and stitching using object recognition methodsImage alignment and stitching using object recognition methods
Applied Rotation
Estimated Rotation
Applied Scale
Estimated Scale
EvaluationEvaluation
![Page 82: 0 By: Navid Einackchi Isfahan University of Technology Electrical and Computer Department Spring 2007 Image alignment and stitching using Object Recognition](https://reader035.vdocuments.pub/reader035/viewer/2022070307/551aed1455034606048b5ef9/html5/thumbnails/82.jpg)
By: Navid EinackchiBy: Navid Einackchi Spring 2007Spring 2007
Image alignment and stitching using object recognition methodsImage alignment and stitching using object recognition methods
Presentation ProcessPresentation Process
• IntroductionIntroduction– Definition– Aligning Concepts– Stitching Concepts
• Object Recognition ProblemObject Recognition Problem– Salient Feature– What is Descriptor– Matching
• Proposed Method for AligningProposed Method for Aligning– Using Harris Detector– Using SIFT Detector– Stitching
• Concluding and SuggestionsConcluding and Suggestions
![Page 83: 0 By: Navid Einackchi Isfahan University of Technology Electrical and Computer Department Spring 2007 Image alignment and stitching using Object Recognition](https://reader035.vdocuments.pub/reader035/viewer/2022070307/551aed1455034606048b5ef9/html5/thumbnails/83.jpg)
By: Navid EinackchiBy: Navid Einackchi Spring 2007Spring 2007
Image alignment and stitching using object recognition methodsImage alignment and stitching using object recognition methods
StitchingStitching
• Pixel Weights based on their distancePixel Weights based on their distance
![Page 84: 0 By: Navid Einackchi Isfahan University of Technology Electrical and Computer Department Spring 2007 Image alignment and stitching using Object Recognition](https://reader035.vdocuments.pub/reader035/viewer/2022070307/551aed1455034606048b5ef9/html5/thumbnails/84.jpg)
By: Navid EinackchiBy: Navid Einackchi Spring 2007Spring 2007
Image alignment and stitching using object recognition methodsImage alignment and stitching using object recognition methods
StitchingStitching
![Page 85: 0 By: Navid Einackchi Isfahan University of Technology Electrical and Computer Department Spring 2007 Image alignment and stitching using Object Recognition](https://reader035.vdocuments.pub/reader035/viewer/2022070307/551aed1455034606048b5ef9/html5/thumbnails/85.jpg)
By: Navid EinackchiBy: Navid Einackchi Spring 2007Spring 2007
Image alignment and stitching using object recognition methodsImage alignment and stitching using object recognition methods
StitchingStitching
![Page 86: 0 By: Navid Einackchi Isfahan University of Technology Electrical and Computer Department Spring 2007 Image alignment and stitching using Object Recognition](https://reader035.vdocuments.pub/reader035/viewer/2022070307/551aed1455034606048b5ef9/html5/thumbnails/86.jpg)
By: Navid EinackchiBy: Navid Einackchi Spring 2007Spring 2007
Image alignment and stitching using object recognition methodsImage alignment and stitching using object recognition methods
Other examplesOther examples
• Adobe Photoshop could not stitch these imagesAdobe Photoshop could not stitch these images
![Page 87: 0 By: Navid Einackchi Isfahan University of Technology Electrical and Computer Department Spring 2007 Image alignment and stitching using Object Recognition](https://reader035.vdocuments.pub/reader035/viewer/2022070307/551aed1455034606048b5ef9/html5/thumbnails/87.jpg)
By: Navid EinackchiBy: Navid Einackchi Spring 2007Spring 2007
Image alignment and stitching using object recognition methodsImage alignment and stitching using object recognition methods
Other ExamplesOther Examples
![Page 88: 0 By: Navid Einackchi Isfahan University of Technology Electrical and Computer Department Spring 2007 Image alignment and stitching using Object Recognition](https://reader035.vdocuments.pub/reader035/viewer/2022070307/551aed1455034606048b5ef9/html5/thumbnails/88.jpg)
By: Navid EinackchiBy: Navid Einackchi Spring 2007Spring 2007
Image alignment and stitching using object recognition methodsImage alignment and stitching using object recognition methods
Other ExamplesOther Examples
![Page 89: 0 By: Navid Einackchi Isfahan University of Technology Electrical and Computer Department Spring 2007 Image alignment and stitching using Object Recognition](https://reader035.vdocuments.pub/reader035/viewer/2022070307/551aed1455034606048b5ef9/html5/thumbnails/89.jpg)
By: Navid EinackchiBy: Navid Einackchi Spring 2007Spring 2007
Image alignment and stitching using object recognition methodsImage alignment and stitching using object recognition methods
Presentation ProcessPresentation Process
•IntroductionIntroduction–Definition
–Aligning Concepts–Stitching Concepts
•Object Recognition ProblemObject Recognition Problem–Salient Feature
–What is Descriptor–Matching
•Proposed Method for AligningProposed Method for Aligning–Using Harris Detector
–Using SIFT Detector–Stitching
•Concluding and SuggestionsConcluding and Suggestions
![Page 90: 0 By: Navid Einackchi Isfahan University of Technology Electrical and Computer Department Spring 2007 Image alignment and stitching using Object Recognition](https://reader035.vdocuments.pub/reader035/viewer/2022070307/551aed1455034606048b5ef9/html5/thumbnails/90.jpg)
By: Navid EinackchiBy: Navid Einackchi Spring 2007Spring 2007
Image alignment and stitching using object recognition methodsImage alignment and stitching using object recognition methods
ConcludingConcluding
• IdeasIdeas– Using Harris and SIFT as a detector– Using Similarity transform as a general image transform– Using voting based on direction and scale of each interest points– Introducing Evaluation Method
• ResultsResults– Harris is more reliable but SIFT is much better in presence of scale transform– Similarity can handle prospective transform for human eyes– Voting can obtain similarity transform with much lower time order– Threshold ratio has a better behavior than Knn
![Page 91: 0 By: Navid Einackchi Isfahan University of Technology Electrical and Computer Department Spring 2007 Image alignment and stitching using Object Recognition](https://reader035.vdocuments.pub/reader035/viewer/2022070307/551aed1455034606048b5ef9/html5/thumbnails/91.jpg)
By: Navid EinackchiBy: Navid Einackchi Spring 2007Spring 2007
Image alignment and stitching using object recognition methodsImage alignment and stitching using object recognition methods
ThanksThanksQuestions?Questions?