1 a briefly introduction of region- based image segmentation advice researcher: 丁建均教授...

43
1 A Briefly Introduction of Region-Based Image Segmentation Advice Researcher: 丁丁丁丁丁 (Jian-Jiun Ding ) Presenter: 丁丁丁 (Cheng-Jin Kuo) Digital Image and Signal Processing Laboratory Graduate Institute of Communication Engineering National Taiwan University, Taipei, Taiwan, ROC 台台台台台 台台台台台台台台台台台台

Upload: conrad-greer

Post on 15-Jan-2016

239 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: 1 A Briefly Introduction of Region- Based Image Segmentation Advice Researcher: 丁建均教授 (Jian-Jiun Ding ) Presenter: 郭政錦 (Cheng-Jin Kuo) Digital Image and

1

A Briefly Introduction of Region-Based Image Segmentation

Advice Researcher:

丁建均教授 (Jian-Jiun Ding )Presenter:

郭政錦 (Cheng-Jin Kuo)

Digital Image and Signal Processing LaboratoryGraduate Institute of Communication EngineeringNational Taiwan University, Taipei, Taiwan, ROC

台大電信所 數位影像與訊號處理實驗室

Page 2: 1 A Briefly Introduction of Region- Based Image Segmentation Advice Researcher: 丁建均教授 (Jian-Jiun Ding ) Presenter: 郭政錦 (Cheng-Jin Kuo) Digital Image and

2

Outline

Introduction Data Clustering Hierarchical Clustering Partitional Clustering (k-means method) Simulation Results Comparison Conclusion and Future Work References

Page 3: 1 A Briefly Introduction of Region- Based Image Segmentation Advice Researcher: 丁建均教授 (Jian-Jiun Ding ) Presenter: 郭政錦 (Cheng-Jin Kuo) Digital Image and

3

Introduction

Image Segmentation:

Threshold Technique Edge-Based Segmentation

Watershed Algorithm Method

Region-Based Segmentation Data Clustering Region Growing Region Splitting and Merging

Page 4: 1 A Briefly Introduction of Region- Based Image Segmentation Advice Researcher: 丁建均教授 (Jian-Jiun Ding ) Presenter: 郭政錦 (Cheng-Jin Kuo) Digital Image and

4

Introduction

Image Segmentation:

Threshold Technique Edge-Based Segmentation

Watershed Algorithm Method

Region-Based Segmentation Data Clustering Region Growing Region Splitting and Merging

Page 5: 1 A Briefly Introduction of Region- Based Image Segmentation Advice Researcher: 丁建均教授 (Jian-Jiun Ding ) Presenter: 郭政錦 (Cheng-Jin Kuo) Digital Image and

5

Data Clustering

Data Clustering:

Goal: 1. To classify the statistical databases

2. To segment the digital images

by a systematical way.

Page 6: 1 A Briefly Introduction of Region- Based Image Segmentation Advice Researcher: 丁建均教授 (Jian-Jiun Ding ) Presenter: 郭政錦 (Cheng-Jin Kuo) Digital Image and

6

Data Clustering

Two Kinds of Data Clustering :

Hierarchical Clustering hierarchical agglomerative algorithm hierarchical divisive algorithm

Partitional Clustering K-means method

Page 7: 1 A Briefly Introduction of Region- Based Image Segmentation Advice Researcher: 丁建均教授 (Jian-Jiun Ding ) Presenter: 郭政錦 (Cheng-Jin Kuo) Digital Image and

7

Data Clustering

Two Kinds of Data Clustering :

The biggest difference between them: Hierarchical Clustering

The number of clusters is flexible. Partitional Clustering

The number of clusters is assigned before processing.

Page 8: 1 A Briefly Introduction of Region- Based Image Segmentation Advice Researcher: 丁建均教授 (Jian-Jiun Ding ) Presenter: 郭政錦 (Cheng-Jin Kuo) Digital Image and

8

Data Clustering

Two Kinds of Data Clustering :

Hierarchical Clustering hierarchical agglomerative algorithm hierarchical divisive algorithm

Partitional Clustering K-means method

Page 9: 1 A Briefly Introduction of Region- Based Image Segmentation Advice Researcher: 丁建均教授 (Jian-Jiun Ding ) Presenter: 郭政錦 (Cheng-Jin Kuo) Digital Image and

9

Hierarchical Clustering

Characteristics:Has been widely used in statistical fieldsTree DiagramSimple ConceptUser could change the number of clusters during

the processing time

Which means: the numbers of clustering is flexible

Page 10: 1 A Briefly Introduction of Region- Based Image Segmentation Advice Researcher: 丁建均教授 (Jian-Jiun Ding ) Presenter: 郭政錦 (Cheng-Jin Kuo) Digital Image and

10

Hierarchical Clustering

hierarchical agglomerative algorithm :

1. Treat every single point (pixel) as a cluster.

Numbers of cluster: 9

Page 11: 1 A Briefly Introduction of Region- Based Image Segmentation Advice Researcher: 丁建均教授 (Jian-Jiun Ding ) Presenter: 郭政錦 (Cheng-Jin Kuo) Digital Image and

11

Hierarchical Clustering

hierarchical agglomerative algorithm :

2. Find out two clusters ,

for that:iC jC

( , ) m in ( ( , )),

x y

i j x yD C C D C C

for

Page 12: 1 A Briefly Introduction of Region- Based Image Segmentation Advice Researcher: 丁建均教授 (Jian-Jiun Ding ) Presenter: 郭政錦 (Cheng-Jin Kuo) Digital Image and

12

Hierarchical Clustering

hierarchical agglomerative algorithm :

The Definition of Distance D: Single-Linkage agglomerative algorithm :

Complete-Linkage agglomerative algorithm :( , ) min( ( , )), a , bi j i jD C C d a b for C C

( , ) max( ( , )), a , bi j i jD C C d a b for C C

Page 13: 1 A Briefly Introduction of Region- Based Image Segmentation Advice Researcher: 丁建均教授 (Jian-Jiun Ding ) Presenter: 郭政錦 (Cheng-Jin Kuo) Digital Image and

13

Hierarchical Clustering

hierarchical agglomerative algorithm :

3. Agglomerate them together to form a new cluster.

Numbers of cluster: 8

Page 14: 1 A Briefly Introduction of Region- Based Image Segmentation Advice Researcher: 丁建均教授 (Jian-Jiun Ding ) Presenter: 郭政錦 (Cheng-Jin Kuo) Digital Image and

14

Hierarchical Clustering

hierarchical agglomerative algorithm :

4. Repeat step1~step3 until the number of cluster satisfies the requirement.

Page 15: 1 A Briefly Introduction of Region- Based Image Segmentation Advice Researcher: 丁建均教授 (Jian-Jiun Ding ) Presenter: 郭政錦 (Cheng-Jin Kuo) Digital Image and

15

Hierarchical Clustering

hierarchical agglomerative algorithm :

4. Repeat step1~step3 until the number of cluster satisfies the requirement.

Numbers of cluster: 7

Page 16: 1 A Briefly Introduction of Region- Based Image Segmentation Advice Researcher: 丁建均教授 (Jian-Jiun Ding ) Presenter: 郭政錦 (Cheng-Jin Kuo) Digital Image and

16

Hierarchical Clustering

hierarchical agglomerative algorithm :

4. Repeat step1~step3 until the number of cluster satisfies the requirement.

Numbers of cluster: 6

Page 17: 1 A Briefly Introduction of Region- Based Image Segmentation Advice Researcher: 丁建均教授 (Jian-Jiun Ding ) Presenter: 郭政錦 (Cheng-Jin Kuo) Digital Image and

17

Hierarchical Clustering

hierarchical agglomerative algorithm :

4. Repeat step1~step3 until the number of cluster satisfies the requirement.

Numbers of cluster: 5

Page 18: 1 A Briefly Introduction of Region- Based Image Segmentation Advice Researcher: 丁建均教授 (Jian-Jiun Ding ) Presenter: 郭政錦 (Cheng-Jin Kuo) Digital Image and

18

Hierarchical Clustering

hierarchical agglomerative algorithm :

4. Repeat step1~step3 until the number of cluster satisfies the requirement.

Numbers of cluster: 4

Page 19: 1 A Briefly Introduction of Region- Based Image Segmentation Advice Researcher: 丁建均教授 (Jian-Jiun Ding ) Presenter: 郭政錦 (Cheng-Jin Kuo) Digital Image and

19

Hierarchical Clustering

hierarchical agglomerative algorithm :

4. Repeat step1~step3 until the number of cluster satisfies the requirement.

Numbers of cluster: 3

Page 20: 1 A Briefly Introduction of Region- Based Image Segmentation Advice Researcher: 丁建均教授 (Jian-Jiun Ding ) Presenter: 郭政錦 (Cheng-Jin Kuo) Digital Image and

20

Hierarchical Clustering

hierarchical agglomerative algorithm :

4. Repeat step1~step3 until the number of cluster satisfies the requirement.

Numbers of cluster: 2

Page 21: 1 A Briefly Introduction of Region- Based Image Segmentation Advice Researcher: 丁建均教授 (Jian-Jiun Ding ) Presenter: 郭政錦 (Cheng-Jin Kuo) Digital Image and

21

Hierarchical Clustering

The tree diagram: (an example)

These two tree diagrams are downloaded from http://neural.cs.nthu.edu.tw/jang/ Author: Professor Jyh-Shing Roger Jang

Page 22: 1 A Briefly Introduction of Region- Based Image Segmentation Advice Researcher: 丁建均教授 (Jian-Jiun Ding ) Presenter: 郭政錦 (Cheng-Jin Kuo) Digital Image and

22

Hierarchical Clustering

Advantages:Simple:

We can check all the stages by checking out the tree diagram only.

Number of cluster is flexible:

We can change the number of cluster anytime during processing. which means?

Page 23: 1 A Briefly Introduction of Region- Based Image Segmentation Advice Researcher: 丁建均教授 (Jian-Jiun Ding ) Presenter: 郭政錦 (Cheng-Jin Kuo) Digital Image and

23

Hierarchical Clustering

Drawback:

Slower compared to partitional clustering:

Not suitable for processing larger database

Page 24: 1 A Briefly Introduction of Region- Based Image Segmentation Advice Researcher: 丁建均教授 (Jian-Jiun Ding ) Presenter: 郭政錦 (Cheng-Jin Kuo) Digital Image and

24

Hierarchical Clustering

Two Kinds of Data Clustering :

Hierarchical Clustering hierarchical agglomerative algorithm hierarchical divisive algorithm

Partitional Clustering K-means method

Page 25: 1 A Briefly Introduction of Region- Based Image Segmentation Advice Researcher: 丁建均教授 (Jian-Jiun Ding ) Presenter: 郭政錦 (Cheng-Jin Kuo) Digital Image and

25

Hierarchical Clustering

hierarchical division algorithm :

1. Treat the whole database as a cluster.

Numbers of cluster: 1

Page 26: 1 A Briefly Introduction of Region- Based Image Segmentation Advice Researcher: 丁建均教授 (Jian-Jiun Ding ) Presenter: 郭政錦 (Cheng-Jin Kuo) Digital Image and

26

Partitional Clustering

Characteristics:

Computational time is short User have to decide the number of clusters before

starting classifying data The concept of centroid One of the famous method: K-means Method

Page 27: 1 A Briefly Introduction of Region- Based Image Segmentation Advice Researcher: 丁建均教授 (Jian-Jiun Ding ) Presenter: 郭政錦 (Cheng-Jin Kuo) Digital Image and

27

Partitional Clustering

K-mean algorithm :

1. Decide the number of the final classified result with N.

Numbers of cluster: N

we now assume N=3

Page 28: 1 A Briefly Introduction of Region- Based Image Segmentation Advice Researcher: 丁建均教授 (Jian-Jiun Ding ) Presenter: 郭政錦 (Cheng-Jin Kuo) Digital Image and

28

Partitional Clustering

K-mean algorithm :

2. Randomly choose N point for the centroids of cluster.

(N=3)

Numbers of cluster: N

Page 29: 1 A Briefly Introduction of Region- Based Image Segmentation Advice Researcher: 丁建均教授 (Jian-Jiun Ding ) Presenter: 郭政錦 (Cheng-Jin Kuo) Digital Image and

29

Partitional Clustering

K-mean algorithm :

3. Find the nearest point for every centroid of cluster. Classify the point into the cluster.

Notice the definition of the nearest!

Page 30: 1 A Briefly Introduction of Region- Based Image Segmentation Advice Researcher: 丁建均教授 (Jian-Jiun Ding ) Presenter: 郭政錦 (Cheng-Jin Kuo) Digital Image and

30

Partitional Clustering

K-mean algorithm :

4. Calculate the new centroid of every cluster.

Notice the definition of the centroid!

Page 31: 1 A Briefly Introduction of Region- Based Image Segmentation Advice Researcher: 丁建均教授 (Jian-Jiun Ding ) Presenter: 郭政錦 (Cheng-Jin Kuo) Digital Image and

31

Partitional Clustering

K-mean algorithm :

5. Repeat step1~step4 until all the point are classified.

Page 32: 1 A Briefly Introduction of Region- Based Image Segmentation Advice Researcher: 丁建均教授 (Jian-Jiun Ding ) Presenter: 郭政錦 (Cheng-Jin Kuo) Digital Image and

32

Partitional Clustering

K-mean algorithm :

5. Repeat step1~step4 until all the point are classified.

Page 33: 1 A Briefly Introduction of Region- Based Image Segmentation Advice Researcher: 丁建均教授 (Jian-Jiun Ding ) Presenter: 郭政錦 (Cheng-Jin Kuo) Digital Image and

33

Partitional Clustering

K-mean algorithm :

5. Repeat step1~step4 until all the point are classified.

Page 34: 1 A Briefly Introduction of Region- Based Image Segmentation Advice Researcher: 丁建均教授 (Jian-Jiun Ding ) Presenter: 郭政錦 (Cheng-Jin Kuo) Digital Image and

34

Partitional Clustering

K-mean algorithm :

5. Repeat step1~step4 until all the point are classified.

Page 35: 1 A Briefly Introduction of Region- Based Image Segmentation Advice Researcher: 丁建均教授 (Jian-Jiun Ding ) Presenter: 郭政錦 (Cheng-Jin Kuo) Digital Image and

35

Partitional Clustering

K-mean algorithm :

5. Repeat step1~step4 until all the point are classified.

Page 36: 1 A Briefly Introduction of Region- Based Image Segmentation Advice Researcher: 丁建均教授 (Jian-Jiun Ding ) Presenter: 郭政錦 (Cheng-Jin Kuo) Digital Image and

36

Partitional Clustering

K-mean algorithm :

6. Data clustering completed

N=3

Page 37: 1 A Briefly Introduction of Region- Based Image Segmentation Advice Researcher: 丁建均教授 (Jian-Jiun Ding ) Presenter: 郭政錦 (Cheng-Jin Kuo) Digital Image and

37

Partitional Clustering

Advantages:Fast:

Since the N has been decided at beginning, the computational time is short.

Simple:

Since the N has been decided at beginning, every simulation testing will be clear.

Page 38: 1 A Briefly Introduction of Region- Based Image Segmentation Advice Researcher: 丁建均教授 (Jian-Jiun Ding ) Presenter: 郭政錦 (Cheng-Jin Kuo) Digital Image and

38

Partitional Clustering

Drawbacks:N is fixed:

What is the best value of N?Choice of initial points influence the resultCircular shape

Page 39: 1 A Briefly Introduction of Region- Based Image Segmentation Advice Researcher: 丁建均教授 (Jian-Jiun Ding ) Presenter: 郭政錦 (Cheng-Jin Kuo) Digital Image and

39

Simulation Results

Original Image

N=2 N=3

N=4 N=5

Processed by K-means:

Page 40: 1 A Briefly Introduction of Region- Based Image Segmentation Advice Researcher: 丁建均教授 (Jian-Jiun Ding ) Presenter: 郭政錦 (Cheng-Jin Kuo) Digital Image and

40

Comparison

Hierarchical clustering:ReliableBut is time consumingCannot perform on a large database

Partitional clustering:FastBut got the initial problemAnd the circular shape problem

Page 41: 1 A Briefly Introduction of Region- Based Image Segmentation Advice Researcher: 丁建均教授 (Jian-Jiun Ding ) Presenter: 郭政錦 (Cheng-Jin Kuo) Digital Image and

41

Conclusion and Future Work

K-means algorithm has been widely used in image segmentation field because of the fast processing speed.

How do we choose the best N? Can we use PSO algorithm to improve it? Other ideas of image segmentation:

Segment the image by the graphical features

Page 42: 1 A Briefly Introduction of Region- Based Image Segmentation Advice Researcher: 丁建均教授 (Jian-Jiun Ding ) Presenter: 郭政錦 (Cheng-Jin Kuo) Digital Image and

42

References

R. C. Gonzalez, R. E. Woods, Digital Image Processing 2nd Edition, Prentice Hall, New Jersey 2002.

M. Petrou and P. Bosdogianni, Image Processing the Fundamentals, Wiley, UK, 2004. W. K. Pratt, Digital Image Processing 4nd Edition, John Wiley & Sons, Inc., Los Altos,

California, 2007. S.C. Satapathy, J. V. R. Murthy, R. Prasada, B.N.V.S.S, R. Prasad, P.V.G.D. “A

Comparative Analysis of Unsupervised K-Means, PSO and Self-Organizing PSO for Image Clustering”, Conference on Computational Intelligence and Multimedia Applications, 2007. International Conference on Volume: 2  13-15 Dec. 2007, Page(s): 229-237

J. Tilton, “Analysis of Hierarchically Related Image Segmentations”, pre-sented at the IEEE Workshop on Advances in Techniques for Analysis of Remotely Sensed Data, Greenbelt, MD, 2003.

Page 43: 1 A Briefly Introduction of Region- Based Image Segmentation Advice Researcher: 丁建均教授 (Jian-Jiun Ding ) Presenter: 郭政錦 (Cheng-Jin Kuo) Digital Image and

43

THANK YOU