:

:

jijiji wt()1w)t(w)t(

)evitaretI(

:

2 -

)(

.

)(.

3 -

W

y x

xy

W

d

gninraeL desivrepuS

gninraeL desivrepusnU

-

)0991( iramA

wt()1w)t([rcw,)t(x,)t(d])t(x)t(

rr(w,x,d)

w)t([rcw,)t(x,)t(d])t(x)t(

jjjj

jj

jjj

-

.1

T ww[ww] jj1j2jm

m

i1

m

i0ijiiji

j00

xwxw

wx1

jd c

j1x

2x

mx

j1w

j2w

jmw

...

r

x

jw

jy

1

6 -

)9491(bbeH

.

wxcy jiij

ry

7 -

Hebb(1949)

When a weight contributes to firing a neuron,

the weight is increased.

- 8

Hebbian Learning

Unsupervised

Weights are strengthened by the actual

response to a stimulus

Supervised

Weights are strengthened by the desired

response

jiij ycxw

jiij dcxw

-

noitalerroC

:

:

.

rdjT

wdcx jj

wdcx jiji

01 -

)8591( ttalbnesoR

jijji

jj

jj

wd[c(fxwx])

ywx(f)i,...,1m

rdy

.

: )ralopinU(

)ralopiB(

0y0

1y0)y(f

1y0

1y0)y(f

11 -

)2691( ffoH-wordiw

:

Tjjj

jj

wd(cxw)x

rdxw

jijji wd(cxwx)i,1,m

(fxw)xw jj

)z(fz

21 -

)6891( trahlemuR & dnallelc cM

wx()

wx(f)

jjj

j

j

rd[wx(f])fwx()

2d(y) jj

2

1 E

31 -

.

:w ) (

:

T Ew()d(y)f(xw)x jjjj

w()

(xw)

i

(xw)

(fxw)

jjj

ji

j

ji

j

j

j

d(y)f(xw)xw

w(E)

2d[(fxw]) jjj

2

1 (Ew)

1 -

): (

:

T wEd(y)f(xw)x jjjj

i

r

wd(y)f(xw)x jijjj

1 -

evititepmoClla ekat renniw

:

.

lla ekat renniw

w(xw)0

ww[ww]

jT

j

Tjj1j2jm

k jwx(xam(gra))k,...,2,1n

61 -

rats tuO

.

:

:

i w(dw) T ii

j,...,2,1n

jijiji wd(w)

71 -

81 -