niloy j. mitra, leonidas j. guibas, and mark...

36
Niloy J. Mitra, Leonidas J. Guibas, and Mark Pauly Copyright of figures and other materials in this slide is belongs to original authors. Presenter: 이성호

Upload: others

Post on 24-Dec-2019

0 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Niloy J. Mitra, Leonidas J. Guibas, and Mark Paulykucg.korea.ac.kr/new/seminar/2010/tr/ppt-2010-07-02.pdf · 2002-01-17 · Korea University Computer Graphics Lab. KUCG | 이성호|10

Niloy J. Mitra, Leonidas J. Guibas, and Mark PaulyCopyright of figures and other materials in this slide is belongs to original authors.

Presenter: 이성호

Page 2: Niloy J. Mitra, Leonidas J. Guibas, and Mark Paulykucg.korea.ac.kr/new/seminar/2010/tr/ppt-2010-07-02.pdf · 2002-01-17 · Korea University Computer Graphics Lab. KUCG | 이성호|10

Korea UniversityComputer Graphics Lab. 이성호| 10 March 2011 | # 2KUCG |

Symmetry in Nature

“Symmetry is a complexity-reducing concept [...]; seek it everywhere.”- Alan J. Perlis

"Females of several species, including […] humans, prefer symmetrical males."

- Chris Evan

Page 3: Niloy J. Mitra, Leonidas J. Guibas, and Mark Paulykucg.korea.ac.kr/new/seminar/2010/tr/ppt-2010-07-02.pdf · 2002-01-17 · Korea University Computer Graphics Lab. KUCG | 이성호|10

Korea UniversityComputer Graphics Lab. 이성호| 10 March 2011 | # 3KUCG |

Partial Symmetry DetectionGiven

Shape model (represented as point cloud, mesh, ... )

Identify and extract similar (symmetric) patches of different size across different resolutions

Goal

Page 4: Niloy J. Mitra, Leonidas J. Guibas, and Mark Paulykucg.korea.ac.kr/new/seminar/2010/tr/ppt-2010-07-02.pdf · 2002-01-17 · Korea University Computer Graphics Lab. KUCG | 이성호|10

Korea UniversityComputer Graphics Lab. 이성호| 10 March 2011 | # 4KUCG |

Types of Symmetry

Transform Types:• Reflection• Rotation + Translation• Uniform Scaling

Shearing and non-linear transformations?

Shearing and non-linear transformations?

Page 5: Niloy J. Mitra, Leonidas J. Guibas, and Mark Paulykucg.korea.ac.kr/new/seminar/2010/tr/ppt-2010-07-02.pdf · 2002-01-17 · Korea University Computer Graphics Lab. KUCG | 이성호|10

Korea UniversityComputer Graphics Lab. 이성호| 10 March 2011 | # 5KUCG |

Contributions

• Automatic detection of discrete symmetries § reflection, rigid transform, uniform scaling

• Symmetry graphs § high level structural information about object

• Output sensitive algorithms § Complexity depends on the number and extent of symmetries§ low memory requirements

Page 6: Niloy J. Mitra, Leonidas J. Guibas, and Mark Paulykucg.korea.ac.kr/new/seminar/2010/tr/ppt-2010-07-02.pdf · 2002-01-17 · Korea University Computer Graphics Lab. KUCG | 이성호|10

Korea UniversityComputer Graphics Lab. 이성호| 10 March 2011 | # 6KUCG |

Related Work

[Loy and Eklundh `06]

Hough transform on feature points

[Gal and Cohen-Or `06]

Based on RANSAC

tradeoff memory for speed

Page 7: Niloy J. Mitra, Leonidas J. Guibas, and Mark Paulykucg.korea.ac.kr/new/seminar/2010/tr/ppt-2010-07-02.pdf · 2002-01-17 · Korea University Computer Graphics Lab. KUCG | 이성호|10

Korea UniversityComputer Graphics Lab. 이성호| 10 March 2011 | # 7KUCG |

Problem Characteristics

Difficulties§ Which parts are symmetric

• objects not pre-segmented

§ Space of transforms: rotation + translation + scaling§ Brute force search is not feasible

Easy§ Proposed symmetries

• easy to validate

Page 8: Niloy J. Mitra, Leonidas J. Guibas, and Mark Paulykucg.korea.ac.kr/new/seminar/2010/tr/ppt-2010-07-02.pdf · 2002-01-17 · Korea University Computer Graphics Lab. KUCG | 이성호|10

Korea UniversityComputer Graphics Lab. 이성호| 10 March 2011 | # 8KUCG |

Reflective Symmetry

Page 9: Niloy J. Mitra, Leonidas J. Guibas, and Mark Paulykucg.korea.ac.kr/new/seminar/2010/tr/ppt-2010-07-02.pdf · 2002-01-17 · Korea University Computer Graphics Lab. KUCG | 이성호|10

Korea UniversityComputer Graphics Lab. 이성호| 10 March 2011 | # 9KUCG |

Reflective Symmetry: A Pair Votes

Page 10: Niloy J. Mitra, Leonidas J. Guibas, and Mark Paulykucg.korea.ac.kr/new/seminar/2010/tr/ppt-2010-07-02.pdf · 2002-01-17 · Korea University Computer Graphics Lab. KUCG | 이성호|10

Korea UniversityComputer Graphics Lab. 이성호| 10 March 2011 | # 10KUCG |

Reflective Symmetry: Voting Continues

Page 11: Niloy J. Mitra, Leonidas J. Guibas, and Mark Paulykucg.korea.ac.kr/new/seminar/2010/tr/ppt-2010-07-02.pdf · 2002-01-17 · Korea University Computer Graphics Lab. KUCG | 이성호|10

Korea UniversityComputer Graphics Lab. 이성호| 10 March 2011 | # 11KUCG |

Reflective Symmetry: Voting Continues

Page 12: Niloy J. Mitra, Leonidas J. Guibas, and Mark Paulykucg.korea.ac.kr/new/seminar/2010/tr/ppt-2010-07-02.pdf · 2002-01-17 · Korea University Computer Graphics Lab. KUCG | 이성호|10

Korea UniversityComputer Graphics Lab. 이성호| 10 March 2011 | # 12KUCG |

Reflective Symmetry: Largest Cluster

• Number of points in a cluster : □• Spread of a cluster : □

Page 13: Niloy J. Mitra, Leonidas J. Guibas, and Mark Paulykucg.korea.ac.kr/new/seminar/2010/tr/ppt-2010-07-02.pdf · 2002-01-17 · Korea University Computer Graphics Lab. KUCG | 이성호|10

Korea UniversityComputer Graphics Lab. 이성호| 10 March 2011 | # 13KUCG |

Quiz

• Determine dimension of Γ for§ Reflection§ Translation§ Reflection+Translation§ Rotation§ Scaling+Translation§ Scaling+Rotation+Translation

Page 14: Niloy J. Mitra, Leonidas J. Guibas, and Mark Paulykucg.korea.ac.kr/new/seminar/2010/tr/ppt-2010-07-02.pdf · 2002-01-17 · Korea University Computer Graphics Lab. KUCG | 이성호|10

Korea UniversityComputer Graphics Lab. 이성호| 10 March 2011 | # 14KUCG |

Pipeline

Page 15: Niloy J. Mitra, Leonidas J. Guibas, and Mark Paulykucg.korea.ac.kr/new/seminar/2010/tr/ppt-2010-07-02.pdf · 2002-01-17 · Korea University Computer Graphics Lab. KUCG | 이성호|10

Korea UniversityComputer Graphics Lab. 이성호| 10 March 2011 | # 15KUCG |

Random Sampling

• Sampling yields a set P of surface points.• Select random subset P’⊂P and find all pairs(p’,p)

§ with p’∈P’ and p∈P.§ Appendix gives theoretical bounds

• on the size of P and P’ required to successfully find symmetries

Page 16: Niloy J. Mitra, Leonidas J. Guibas, and Mark Paulykucg.korea.ac.kr/new/seminar/2010/tr/ppt-2010-07-02.pdf · 2002-01-17 · Korea University Computer Graphics Lab. KUCG | 이성호|10

Korea UniversityComputer Graphics Lab. 이성호| 10 March 2011 | # 16KUCG |

Pruning: Local Signatures

• Local signature ! invariant under transforms• Signatures disagree ! points don’t correspond

Use (k1, k2) for curvature based pruning

Page 17: Niloy J. Mitra, Leonidas J. Guibas, and Mark Paulykucg.korea.ac.kr/new/seminar/2010/tr/ppt-2010-07-02.pdf · 2002-01-17 · Korea University Computer Graphics Lab. KUCG | 이성호|10

Korea UniversityComputer Graphics Lab. 이성호| 10 March 2011 | # 17KUCG |

Reflection: Normal-based Pruning

Page 18: Niloy J. Mitra, Leonidas J. Guibas, and Mark Paulykucg.korea.ac.kr/new/seminar/2010/tr/ppt-2010-07-02.pdf · 2002-01-17 · Korea University Computer Graphics Lab. KUCG | 이성호|10

Korea UniversityComputer Graphics Lab. 이성호| 10 March 2011 | # 18KUCG |

Point Pair Pruning

all pairs curvature based curvature + normal based

Page 19: Niloy J. Mitra, Leonidas J. Guibas, and Mark Paulykucg.korea.ac.kr/new/seminar/2010/tr/ppt-2010-07-02.pdf · 2002-01-17 · Korea University Computer Graphics Lab. KUCG | 이성호|10

Korea UniversityComputer Graphics Lab. 이성호| 10 March 2011 | # 19KUCG |

Quiz

• Determine signature of§ Reflection§ Translation§ Rotation+translation§ Scale+rotation+translation

Page 20: Niloy J. Mitra, Leonidas J. Guibas, and Mark Paulykucg.korea.ac.kr/new/seminar/2010/tr/ppt-2010-07-02.pdf · 2002-01-17 · Korea University Computer Graphics Lab. KUCG | 이성호|10

Korea UniversityComputer Graphics Lab. 이성호| 10 March 2011 | # 20KUCG |

Signatures

• Principal curvature estimation§ For point , calculate principal curvatures

and principal directions§ [Cohen-Steiner and Morval 2003]

• Scaling estimation

• Rotation

• Translation

Page 21: Niloy J. Mitra, Leonidas J. Guibas, and Mark Paulykucg.korea.ac.kr/new/seminar/2010/tr/ppt-2010-07-02.pdf · 2002-01-17 · Korea University Computer Graphics Lab. KUCG | 이성호|10

Korea UniversityComputer Graphics Lab. 이성호| 10 March 2011 | # 21KUCG |

• 7 Dimesion transformation

Page 22: Niloy J. Mitra, Leonidas J. Guibas, and Mark Paulykucg.korea.ac.kr/new/seminar/2010/tr/ppt-2010-07-02.pdf · 2002-01-17 · Korea University Computer Graphics Lab. KUCG | 이성호|10

Korea UniversityComputer Graphics Lab. 이성호| 10 March 2011 | # 22KUCG |

Transformations

• Reflection requires point-pairs• Rigid transform requires more information

Robust estimation of principal curvature frames [Cohen-Steiner et al. `03]

??

Page 23: Niloy J. Mitra, Leonidas J. Guibas, and Mark Paulykucg.korea.ac.kr/new/seminar/2010/tr/ppt-2010-07-02.pdf · 2002-01-17 · Korea University Computer Graphics Lab. KUCG | 이성호|10

Korea UniversityComputer Graphics Lab. 이성호| 10 March 2011 | # 23KUCG |

Mean-Shift Clustering

Kernel:• Radially symmetric• Radius/spread

Page 24: Niloy J. Mitra, Leonidas J. Guibas, and Mark Paulykucg.korea.ac.kr/new/seminar/2010/tr/ppt-2010-07-02.pdf · 2002-01-17 · Korea University Computer Graphics Lab. KUCG | 이성호|10

Korea UniversityComputer Graphics Lab. 이성호| 10 March 2011 | # 24KUCG |

Define norm of Γ

• Norm of as the weighted sum

• 180 degrees == 0.5*bounding box diagonal== scailing factor of 10

• Metric for Γ can be derived as

Page 25: Niloy J. Mitra, Leonidas J. Guibas, and Mark Paulykucg.korea.ac.kr/new/seminar/2010/tr/ppt-2010-07-02.pdf · 2002-01-17 · Korea University Computer Graphics Lab. KUCG | 이성호|10

Korea UniversityComputer Graphics Lab. 이성호| 10 March 2011 | # 25KUCG |

Verification

• Clustering gives a good guess• Verify builds symmetric patches• Locally refine solution using ICP (Iterative Closest Point)

algorithm § [Besl and McKay `92]

Page 26: Niloy J. Mitra, Leonidas J. Guibas, and Mark Paulykucg.korea.ac.kr/new/seminar/2010/tr/ppt-2010-07-02.pdf · 2002-01-17 · Korea University Computer Graphics Lab. KUCG | 이성호|10

Korea UniversityComputer Graphics Lab. 이성호| 10 March 2011 | # 26KUCG |

ICP Problem

• Align two partially-overlapping meshesgiven initial guessfor relative transform

Page 27: Niloy J. Mitra, Leonidas J. Guibas, and Mark Paulykucg.korea.ac.kr/new/seminar/2010/tr/ppt-2010-07-02.pdf · 2002-01-17 · Korea University Computer Graphics Lab. KUCG | 이성호|10

Korea UniversityComputer Graphics Lab. 이성호| 10 March 2011 | # 27KUCG |

Compound Transforms

Page 28: Niloy J. Mitra, Leonidas J. Guibas, and Mark Paulykucg.korea.ac.kr/new/seminar/2010/tr/ppt-2010-07-02.pdf · 2002-01-17 · Korea University Computer Graphics Lab. KUCG | 이성호|10

Korea UniversityComputer Graphics Lab. 이성호| 10 March 2011 | # 28KUCG |

[Magnus et al. 2004][Magnus et al. 2004]

Page 29: Niloy J. Mitra, Leonidas J. Guibas, and Mark Paulykucg.korea.ac.kr/new/seminar/2010/tr/ppt-2010-07-02.pdf · 2002-01-17 · Korea University Computer Graphics Lab. KUCG | 이성호|10

Korea UniversityComputer Graphics Lab. 이성호| 10 March 2011 | # 29KUCG |

Model Reduction: Chambord

Page 30: Niloy J. Mitra, Leonidas J. Guibas, and Mark Paulykucg.korea.ac.kr/new/seminar/2010/tr/ppt-2010-07-02.pdf · 2002-01-17 · Korea University Computer Graphics Lab. KUCG | 이성호|10

Korea UniversityComputer Graphics Lab. 이성호| 10 March 2011 | # 30KUCG |

Model Reduction: Chambord

Page 31: Niloy J. Mitra, Leonidas J. Guibas, and Mark Paulykucg.korea.ac.kr/new/seminar/2010/tr/ppt-2010-07-02.pdf · 2002-01-17 · Korea University Computer Graphics Lab. KUCG | 이성호|10

Korea UniversityComputer Graphics Lab. 이성호| 10 March 2011 | # 31KUCG |

Model Reduction: Chambord

Page 32: Niloy J. Mitra, Leonidas J. Guibas, and Mark Paulykucg.korea.ac.kr/new/seminar/2010/tr/ppt-2010-07-02.pdf · 2002-01-17 · Korea University Computer Graphics Lab. KUCG | 이성호|10

Korea UniversityComputer Graphics Lab. 이성호| 10 March 2011 | # 32KUCG |

Sydney Opera House

Page 33: Niloy J. Mitra, Leonidas J. Guibas, and Mark Paulykucg.korea.ac.kr/new/seminar/2010/tr/ppt-2010-07-02.pdf · 2002-01-17 · Korea University Computer Graphics Lab. KUCG | 이성호|10

Korea UniversityComputer Graphics Lab. 이성호| 10 March 2011 | # 33KUCG |

Articulated Motion: Horses

Page 34: Niloy J. Mitra, Leonidas J. Guibas, and Mark Paulykucg.korea.ac.kr/new/seminar/2010/tr/ppt-2010-07-02.pdf · 2002-01-17 · Korea University Computer Graphics Lab. KUCG | 이성호|10

Korea UniversityComputer Graphics Lab. 이성호| 10 March 2011 | # 34KUCG |

Performance

model # vertices sign. pairing cluster. verif.Dragon 160,947 3.44 49.24 13.63 7.45

Opera 9,376 0.96 0.02 0.03 0.86

Castle 172,606 5.61 117.81 159.73 5.63

Horse 8,431 0.92 0.01 0.01 1.63

Arch 16,921 0.08 5.86 26.89 2.42

(time in seconds)

Page 35: Niloy J. Mitra, Leonidas J. Guibas, and Mark Paulykucg.korea.ac.kr/new/seminar/2010/tr/ppt-2010-07-02.pdf · 2002-01-17 · Korea University Computer Graphics Lab. KUCG | 이성호|10

Korea UniversityComputer Graphics Lab. 이성호| 10 March 2011 | # 35KUCG |

Limitations

• Cannot differentiate between § small sized symmetries and comparable noise§ Pre-smoothing

• Less distinct curvature estimates

Page 36: Niloy J. Mitra, Leonidas J. Guibas, and Mark Paulykucg.korea.ac.kr/new/seminar/2010/tr/ppt-2010-07-02.pdf · 2002-01-17 · Korea University Computer Graphics Lab. KUCG | 이성호|10

Korea UniversityComputer Graphics Lab. 이성호| 10 March 2011 | # 36KUCG |

Future Work

• Symmetrization

• Unsupervised registration of§ Partial scan alignment§ Protein docking