딥러닝을 위한 기초 수학
TRANSCRIPT
! ..
FFNN, RNN, CNN
, ,
..
/ • Coursera - Machine Learning, Stanford
• https://www.coursera.org/learn/machine-learning
• Udacity - Deep Learning, Google• https://www.udacity.com/course/deep-learning--ud730
• / , HKUST• https://hunkim.github.io/ml/
• Deep Learning for Natural Language Processing, Stanford• http://cs224d.stanford.edu/syllabus.html
• Convolutional Neural Networks for Visual Recognition, Stanford• http://cs231n.stanford.edu/syllabus.html
Who am I•
• Y • 5 • S !
• • .. theeluwin.kr
• /theeluwin• @theeluwin•
Preliminaries•
• ?
Table of Contents• ?• ?• , ?•
• (?) ! 1 ..
?! ‘ ’
-
?
?
‘ ’
?? ??
formal , deterministic
formalism!
• “∅ !” ...• s(X) = X ∪ {X} successor • ∅ ∈ A X ∈ A then s(X) ∈ A A successor set
• ∅ ‘0’ • 1) s(0) = 0 ∪ {0} = ∅ ∪ {∅} = {∅}
• {∅} ‘1’ • 2) s(1) = {∅} ∪ {{∅}} = {∅, {∅}}
• {∅, {∅}} ‘2’ •
• successor set • • smallest inductive set
, ‘ ’ ,
(??)
formal
...
, : n × 1 ?
,
‘ ’
:
?! ‘ ’
1. 2. 3. ? ( )4. 5. ‘ ’
“ ”
“ ”
? ,
0. ( )1. 2.
3. , , , , , ,
, , ,
♚♚ ♚♚♜ ♜
SNU IDS FAQPGM = = ( )• “ ” / “PGM ”• “ ” / “PGM ”• “ ” / “PGM ”• “ ?” / “PGM ”• “ ” / “ PGM ”• “ ” / “PGM ”• “PGM ?” / “ ” ( )• “ ” / “PGM”• “ ?” / “PGM”
, ? ...
?
‘linear ’ :• f(x + y) = f(x) + f(y)
• additivity • f(ax) = af(x) for all a
• homogeneity of degree 1
!!
,
,
???
...
, , ,
?
?
? F ...
?field
field
field…?
field ?nonzero commutative division ring
... ...
F field :F any a, b, c ,
( : )
: , ,
1: a • 0 = 0 2: finite field pn
(p , n )
field F V vector space :F any a, b , V any u, v, w ,
u + v au V
u + (v + w) = (u + v) + w
u + v = v + u
v + 0 = v 0 V
v + (-v) = 0 -v V
a(bv) = (ab)v
1v = v
a(u + v) = au + av, (a + b)v = av + bv
, , ?? ??
???‘ ’
‘ ’ !!
‘ ’
V ≅ Fn
?
?
T: V ⟶ W T(ax) = aT(x)
T(x + y) = T(x) + T(y)
(
...)
References1. Pinter, Charles C. "Set theory." (1976). 2. Gockenbach, Mark S. Finite-dimensional linear algebra. CRC Press, 2011. 3. Janson, Svante. "Tensors And Differential Forms." (2000). 4. Bhattacharya, Phani Bhushan, Surender Kumar Jain, and S. R. Nagpaul. Basic abstract
algebra. Cambridge University Press, 1994. 5. Artin, Michael. “Algebra”, 2nd Ed., Pearson, 2010. 6. Weisstein, Eric W. "Field Axioms." From MathWorld--A Wolfram Web Resource. http://
mathworld.wolfram.com/FieldAxioms.html
7. 최상혁, 설진석, 이상구, "한국어에 적합한 단어 임베딩 모델 및 파라미터 튜닝에 관한 연구", HCLT, 2016.