Self-Supervised

Representation Learning

May 1, 2020

Seokho Moon

논문, 블로그, 발표자료및다른연구원분들(도형록, 강현구등)의

도움을받아작성되었음을미리알려드리며

감사의말을전합니다.

https://lilianweng.github.io/lil-log/2019/11/10/self-supervised-learning.html

https://hoya012.github.io/blog/Self-Supervised-Learning-Overview/

PR-208: Unsupervised Visual Representation Learning Overview: Toward Self-Supervision

[Self-supervised learning] AI프렌즈세미나발표자료 -서정훈

3

1. Introduction

1. Background

2. Brief framework

2. Pretext tasks

Exemplar

Context Prediction(Relative Patch Location)

Jigsaw Puzzle

Image Colorization

Count

Rotation

3. Downstream task evaluation

Transfer learning

4. SimCLR

Paper explanation

Results

5. Conclusion

Comments

4

5

6

7

8

9

11

12

13

14

15

16

17

18

19

Pretext task

20

Pretext task

21

22

23

24

25

26

27

28

29

30

31

32

33

Linear Classifier

34

35

36

37

38

39

40

41

42

43

44

45

46

47

48

49

Thank you