graph cut chien-chi chen 1. outline 2 introduction interactive segmentation related work graph...
TRANSCRIPT
1
GRAPH CUT
Chien-chi Chen
2
Outline Introduction
Interactive segmentation Related work
Graph cut Concept of graph cut Hard and smooth constrains Min cut/Max flow
Extensive of Graph cut Grab cut Paint Selection
Unsupervise graph cut Conclusion Reference
3
Outline Introduction
Demo Related work
Graph cut Concept of grap hcut Hard and smooth constrains Min cut/Max flow
Extensive of Graph cut Grab cut Paint Selection
Unsupervise graph cut Conclusion Reference
4
Interactive Segmentation
5
Related Work
Scribble-based selection Graph cut
Painting-based selection Paint Selection http://www.youtube.com/watch?v=qC5Y9W-
E-po Boundary-based selection
Intelligent Scissor http://www.youtube.com/watch?
v=3LDsh3vi5fg
6
Outline Introduction
Demo Related work
Graph cut Concept of graph cut Hard and smooth constrains Min cut/Max flow
Extensive of Graph cut Grab cut Paint Selection
Unsupervise graph cut Conclusion Reference
7
Concept of graph cut
Characteristic Interactive image segmentation using graph
cut Binary label: foreground vs. background
Interactive User labels some pixels
Algorithm setting Hard constrains Smoothness constrains
Min cut/Max flow Energe minimization
8
Labeling as a graph problem Each pixel = node Add two nodes F & B Labeling: link each pixel to either F or B
F
B
Desired result
9
Data term
Put one edge between each pixel and F & G
Weight of edge = minus data term Don’t forget huge weight for hard
constraints Careful with sign
B
F
10
Smoothness term
Add an edge between each neighbor pair Weight = smoothness term
B
F
11
Energy function Labeling: one value per pixel, F or B Energy(labeling) = hard + smoothness
Will be minimized
Hard: for each pixel Probability that this color belongs to F (resp. B)
Smoothness (aka regularization): per neighboring pixel pair Penalty for having different label Penalty is downweighted if the two
pixel colors are very different
One labeling(ok, not best)
Data
Smoothness
( ) ( ) ( )E A R A B A
( ) ( )p pp all
R A R A
{ , }{ , }
( ) ( , )p q p qp q N
B A B A A
12
Min cut
Energy optimization equivalent to min cut
Cut: remove edges to disconnect F from B
Minimum: minimize sum of cut edge weight
http://www.cse.yorku.ca/~aaw/Wang/MaxFlowStart.htm
B
F
13
Outline Introduction
Demo Related work
Graph cut Concept of graph cut Hard and smooth constrains Min cut/Max flow
Extensive of Graph cut Grab cut Paint Selection
Unsupervise graph cut Conclusion Reference
14
Extensive of Graph cut
Grab cut E(φ,S,x, λ) = Ecol(φ,S,x) + Ecol(,S,x, λ) :Gaussian
mixture model
22, .
1( , , ) ( ) exp{ || || }
2coh i j i j
i jadjE S x S S x x
( , , ) ( , , )col n nn
E S x D S x
Image
15
Extensive of Graph cut
Paint selection
B- user brush, F- existing selection F’- new selection, U- backgroundR-dilated box, L- local foreground, dF-frontal foreground
16
Extensive of Graph cut
E(X)= Hard constrains
Using L(local foreground) to build GMM Background model is randomly sampling a
number (1200 points)from background to build GMM
( )fp
( )bp ( ) (1 )
( )
( ) (1 ) | ( )
d p p
Bd p p
f b Bd p p p p p
E x x K p S
E x x K p S
E x x L x L p U S S
,( ) ( ) ( , )d p c p q
p p qE X E x E x x
17
Extensive of Graph cut
Smoothness constrains
Adding frontal forground
1
2 1
( , ) | | ( || || )
0.05, (|| || )
c p q p q p q
p q
E x x x x I I
I I
( ) (1 ) d p pE x x K p S F
18
Outline Introduction
Interactive segmentation Related work
Graph cut Concept of graph cut Hard and smooth constrains Min cut/Max flow
Extensive of Graph cut Grab cut Paint Selection
Unsupervise graph cut Conclusion Reference
19
Unsupervise graph cut
Automatic object segmentation with salient color model
Saliency Map: 1
( ) ( )K
k kk
F x f x
, ( )
, ( )
,
F F
B B
U
x if F x
x x if F x
x
20
Unsupervise graph cut
Saliency map
21
Unsupervise graph cut Segmentation Hard constrains
K-means is employed to model distribution
( , , ) ( , , )x
D X H x
( , , ) (1 ) Pr ( | ) Pr ( | )x F x BH x ob x ob x
Pr ( | ) 1/ min ( , )
Pr ( | ) 1/ min ( , )F F
B B
ob x dis x
ob x dis x
1 2 2min ( , ) min{| | ,...,| | }CF F Fdis x x t x t
22
Unsupervise graph cut
Smoothness constrains
2'
' ( )( , ) ( , ) exp( | ' | )x x
x x N xB X x x
'( ) 1
0x xif then
else
arg min ( , , )E X
23
24
Outline Introduction
Interactive segmentation Related work
Graph cut Concept of graph cut Hard and smooth constrains Min cut/Max flow
Extensive of Graph cut Grab cut Paint Selection
Unsupervise graph cut Conclusion Reference
25
Conclusion
Interactive segmentation Graph cut is fast, robust segmentation It consider not only difference between
source to node, but also link of node to node.
26
Reference
1. Lecture slide from Dr. Y.Y. Chuang.2. Y. Boyjov, “An Experimental Comparison
of Min-Cut/Max-Flow Algorithms for Energy Minimization in Vision”, PAMI 2002.
3. J. Liu, J. Sun, H.Y. Shum, ”Paint Selection”, sigraph 2007.
4. C.C. Kao, J.H. Lai, S.Y. Chien,“Automatic Object Segmentation With Salient Color Model”, IEEE 2011.
27
Q&A