de la perceptron la deep learning - babeș-bolyai...
TRANSCRIPT
![Page 1: De la Perceptron la Deep Learning - Babeș-Bolyai Universitylauras/test/docs/school/IA/2016-2017/lectures/09... · Architecture Of LeNet-5, a Convolutional Neural Network, here for](https://reader031.vdocuments.pub/reader031/viewer/2022020217/5e036711eb3df3327f718f40/html5/thumbnails/1.jpg)
De la Perceptron la Deep
Learning Gabriel Mircea
![Page 2: De la Perceptron la Deep Learning - Babeș-Bolyai Universitylauras/test/docs/school/IA/2016-2017/lectures/09... · Architecture Of LeNet-5, a Convolutional Neural Network, here for](https://reader031.vdocuments.pub/reader031/viewer/2022020217/5e036711eb3df3327f718f40/html5/thumbnails/2.jpg)
Neuron ~ Perceptron
![Page 3: De la Perceptron la Deep Learning - Babeș-Bolyai Universitylauras/test/docs/school/IA/2016-2017/lectures/09... · Architecture Of LeNet-5, a Convolutional Neural Network, here for](https://reader031.vdocuments.pub/reader031/viewer/2022020217/5e036711eb3df3327f718f40/html5/thumbnails/3.jpg)
Perceptron
- clasificator liniar
- ajusteaza o functie liniara pentru a
imparti un set de entitati in doua
clase
- functioneaza bine pe seturi care
contin entitati cu proprietati liniar
separabile
![Page 4: De la Perceptron la Deep Learning - Babeș-Bolyai Universitylauras/test/docs/school/IA/2016-2017/lectures/09... · Architecture Of LeNet-5, a Convolutional Neural Network, here for](https://reader031.vdocuments.pub/reader031/viewer/2022020217/5e036711eb3df3327f718f40/html5/thumbnails/4.jpg)
Perceptron - limitari
- nu reuseste sa gaseasca solutia
pentru seturi cu proprietati
neseparabile liniar
- exemplu : XOR
- pentru a rezolva aceste probleme
trebuie corelati mai multi
perceptroni => Multi Layer
Perceptron (MLP)
![Page 5: De la Perceptron la Deep Learning - Babeș-Bolyai Universitylauras/test/docs/school/IA/2016-2017/lectures/09... · Architecture Of LeNet-5, a Convolutional Neural Network, here for](https://reader031.vdocuments.pub/reader031/viewer/2022020217/5e036711eb3df3327f718f40/html5/thumbnails/5.jpg)
XOR - Solutie : Multi Layer Perceptron
![Page 6: De la Perceptron la Deep Learning - Babeș-Bolyai Universitylauras/test/docs/school/IA/2016-2017/lectures/09... · Architecture Of LeNet-5, a Convolutional Neural Network, here for](https://reader031.vdocuments.pub/reader031/viewer/2022020217/5e036711eb3df3327f718f40/html5/thumbnails/6.jpg)
Sistem nervos ~ Retea Neuronala (MLP)
![Page 7: De la Perceptron la Deep Learning - Babeș-Bolyai Universitylauras/test/docs/school/IA/2016-2017/lectures/09... · Architecture Of LeNet-5, a Convolutional Neural Network, here for](https://reader031.vdocuments.pub/reader031/viewer/2022020217/5e036711eb3df3327f718f40/html5/thumbnails/7.jpg)
Retea Neuronala
- primeste date prin input layer
- rezolva probleme de
- clasificare
- regresie (vezi imaginea)
- rezolva probleme neseparabile
liniar cu ajutorul mecanismului de
propagare inapoi a erorilor
(backpropagation)
![Page 8: De la Perceptron la Deep Learning - Babeș-Bolyai Universitylauras/test/docs/school/IA/2016-2017/lectures/09... · Architecture Of LeNet-5, a Convolutional Neural Network, here for](https://reader031.vdocuments.pub/reader031/viewer/2022020217/5e036711eb3df3327f718f40/html5/thumbnails/8.jpg)
Backpropagation
- recalcularea ponderilor pentru a
reduce erorile
- se realizeaza cu ajutorul tehnicii :
gradient descent
![Page 9: De la Perceptron la Deep Learning - Babeș-Bolyai Universitylauras/test/docs/school/IA/2016-2017/lectures/09... · Architecture Of LeNet-5, a Convolutional Neural Network, here for](https://reader031.vdocuments.pub/reader031/viewer/2022020217/5e036711eb3df3327f718f40/html5/thumbnails/9.jpg)
Backpropagation: Gradient descent
![Page 10: De la Perceptron la Deep Learning - Babeș-Bolyai Universitylauras/test/docs/school/IA/2016-2017/lectures/09... · Architecture Of LeNet-5, a Convolutional Neural Network, here for](https://reader031.vdocuments.pub/reader031/viewer/2022020217/5e036711eb3df3327f718f40/html5/thumbnails/10.jpg)
Retele neuronale clasice - limitari / alternative
![Page 11: De la Perceptron la Deep Learning - Babeș-Bolyai Universitylauras/test/docs/school/IA/2016-2017/lectures/09... · Architecture Of LeNet-5, a Convolutional Neural Network, here for](https://reader031.vdocuments.pub/reader031/viewer/2022020217/5e036711eb3df3327f718f40/html5/thumbnails/11.jpg)
Deep Neural Network
![Page 12: De la Perceptron la Deep Learning - Babeș-Bolyai Universitylauras/test/docs/school/IA/2016-2017/lectures/09... · Architecture Of LeNet-5, a Convolutional Neural Network, here for](https://reader031.vdocuments.pub/reader031/viewer/2022020217/5e036711eb3df3327f718f40/html5/thumbnails/12.jpg)
Deep Neural Network - exemplu
![Page 13: De la Perceptron la Deep Learning - Babeș-Bolyai Universitylauras/test/docs/school/IA/2016-2017/lectures/09... · Architecture Of LeNet-5, a Convolutional Neural Network, here for](https://reader031.vdocuments.pub/reader031/viewer/2022020217/5e036711eb3df3327f718f40/html5/thumbnails/13.jpg)
Overfitting