guest lecture by prof. rohit manchanda biological neurons - i · 2005. 12. 3. · cs 621 artificial...
TRANSCRIPT
![Page 1: Guest Lecture by Prof. Rohit Manchanda Biological Neurons - I · 2005. 12. 3. · CS 621 Artificial Intelligence Lecture 33 - 07/11/05 Guest Lecture by Prof. Rohit Manchanda Biological](https://reader036.vdocuments.pub/reader036/viewer/2022071503/61235d595972bd5c2877692d/html5/thumbnails/1.jpg)
CS 621 Artificial Intelligence
Lecture 33 - 07/11/05
Guest Lecture byProf. Rohit Manchanda
Biological Neurons - I
![Page 2: Guest Lecture by Prof. Rohit Manchanda Biological Neurons - I · 2005. 12. 3. · CS 621 Artificial Intelligence Lecture 33 - 07/11/05 Guest Lecture by Prof. Rohit Manchanda Biological](https://reader036.vdocuments.pub/reader036/viewer/2022071503/61235d595972bd5c2877692d/html5/thumbnails/2.jpg)
The Perceptron Model
A perceptron is a computing element with input lines having associated weights and the cell having a threshold value. The perceptron model is motivated by the biological neuron.
Output = y
wnWn-1
w1
Xn-1
Threshold = θ
x1
![Page 3: Guest Lecture by Prof. Rohit Manchanda Biological Neurons - I · 2005. 12. 3. · CS 621 Artificial Intelligence Lecture 33 - 07/11/05 Guest Lecture by Prof. Rohit Manchanda Biological](https://reader036.vdocuments.pub/reader036/viewer/2022071503/61235d595972bd5c2877692d/html5/thumbnails/3.jpg)
Step function / Threshold functiony = 1 for Σ > θ, y >1
=0 otherwise
Σwixi > θ
θ
1y
Σwixi
Features of Perceptron
• Input output behavior is discontinuous and the derivative does not exist at Σwixi = θ
• Σwixi - θ is the net input denoted as net
• Referred to as a linear threshold element - linearity because of x appearing with power 1
• y= f(net): Relation between y and net is non-linear
![Page 4: Guest Lecture by Prof. Rohit Manchanda Biological Neurons - I · 2005. 12. 3. · CS 621 Artificial Intelligence Lecture 33 - 07/11/05 Guest Lecture by Prof. Rohit Manchanda Biological](https://reader036.vdocuments.pub/reader036/viewer/2022071503/61235d595972bd5c2877692d/html5/thumbnails/4.jpg)
Perceptron vs. the point neuron
• Incoming signals from synapses are summed up at the soma
• , the biological “inner product”• On crossing a threshold, the cell “fires”
generating an action potential in the axon hillock region
The McCulloch and Pitt’s neuron
Synaptic inputs: Artist’s conception
Σ
![Page 5: Guest Lecture by Prof. Rohit Manchanda Biological Neurons - I · 2005. 12. 3. · CS 621 Artificial Intelligence Lecture 33 - 07/11/05 Guest Lecture by Prof. Rohit Manchanda Biological](https://reader036.vdocuments.pub/reader036/viewer/2022071503/61235d595972bd5c2877692d/html5/thumbnails/5.jpg)
The biological neuron
Pyramidal neuron, from the amygdala (Rupshiet al. 2005)
A CA1 pyramidal neuron (Mel et al. 2004)
![Page 6: Guest Lecture by Prof. Rohit Manchanda Biological Neurons - I · 2005. 12. 3. · CS 621 Artificial Intelligence Lecture 33 - 07/11/05 Guest Lecture by Prof. Rohit Manchanda Biological](https://reader036.vdocuments.pub/reader036/viewer/2022071503/61235d595972bd5c2877692d/html5/thumbnails/6.jpg)
What makes neuronal computation special ?
• Electrical activity in neurons• Traveling action potentials• Leaky, conducting membrane• Highly branched structures• A variety of electrical connections between neurons• A varied range of possibilities in neural coding of
information
![Page 7: Guest Lecture by Prof. Rohit Manchanda Biological Neurons - I · 2005. 12. 3. · CS 621 Artificial Intelligence Lecture 33 - 07/11/05 Guest Lecture by Prof. Rohit Manchanda Biological](https://reader036.vdocuments.pub/reader036/viewer/2022071503/61235d595972bd5c2877692d/html5/thumbnails/7.jpg)
Dendritic computation
• Time delay• Attenuation, duration
increase• Spatial and temporal
summation• Non linear intra branch
summation• Multiple layer configuration• Retrograde propagation of
signals into the dendritic arbor– Backprogating action
potentialsSpatial and temporal summation of proximal and distal inputs (Nettleton et al. 2000)
![Page 8: Guest Lecture by Prof. Rohit Manchanda Biological Neurons - I · 2005. 12. 3. · CS 621 Artificial Intelligence Lecture 33 - 07/11/05 Guest Lecture by Prof. Rohit Manchanda Biological](https://reader036.vdocuments.pub/reader036/viewer/2022071503/61235d595972bd5c2877692d/html5/thumbnails/8.jpg)
Dendritic computationComparison of within-branch andbetween-branch summation.
(a-f)Black: individually Activated Re: simultaneously activatedBlue: arithmetic sum of individual responses.
(g) Summary plot of predicted versus actual combined responses. Coloured circles: within-branch summationDashed line: linear summation. Green diamonds: between-branch summation
(h) Modeling data: summation of EPSPsRed circles: within-branch summation Open green circles: between-branch summation
(Mel et al. 2003, 2004)
![Page 9: Guest Lecture by Prof. Rohit Manchanda Biological Neurons - I · 2005. 12. 3. · CS 621 Artificial Intelligence Lecture 33 - 07/11/05 Guest Lecture by Prof. Rohit Manchanda Biological](https://reader036.vdocuments.pub/reader036/viewer/2022071503/61235d595972bd5c2877692d/html5/thumbnails/9.jpg)
Possible computational consequences of non-linear summation in dendritic sub-trees (Mel et al. 2003)
Dendritic computation: Single neuron as a neural network
Another possibility
![Page 10: Guest Lecture by Prof. Rohit Manchanda Biological Neurons - I · 2005. 12. 3. · CS 621 Artificial Intelligence Lecture 33 - 07/11/05 Guest Lecture by Prof. Rohit Manchanda Biological](https://reader036.vdocuments.pub/reader036/viewer/2022071503/61235d595972bd5c2877692d/html5/thumbnails/10.jpg)
Single neuron as a neural network
3 Layered Neural Network2 Layered Neural Network
![Page 11: Guest Lecture by Prof. Rohit Manchanda Biological Neurons - I · 2005. 12. 3. · CS 621 Artificial Intelligence Lecture 33 - 07/11/05 Guest Lecture by Prof. Rohit Manchanda Biological](https://reader036.vdocuments.pub/reader036/viewer/2022071503/61235d595972bd5c2877692d/html5/thumbnails/11.jpg)
A multi neuron pathway in the hippocampus
![Page 12: Guest Lecture by Prof. Rohit Manchanda Biological Neurons - I · 2005. 12. 3. · CS 621 Artificial Intelligence Lecture 33 - 07/11/05 Guest Lecture by Prof. Rohit Manchanda Biological](https://reader036.vdocuments.pub/reader036/viewer/2022071503/61235d595972bd5c2877692d/html5/thumbnails/12.jpg)
Summary
Classical Picture Emerging Picture
![Page 13: Guest Lecture by Prof. Rohit Manchanda Biological Neurons - I · 2005. 12. 3. · CS 621 Artificial Intelligence Lecture 33 - 07/11/05 Guest Lecture by Prof. Rohit Manchanda Biological](https://reader036.vdocuments.pub/reader036/viewer/2022071503/61235d595972bd5c2877692d/html5/thumbnails/13.jpg)
Recent neurobiological discoveries
Changes as a result of stress (CIS)– Dendritic atrophy
Consequences– Loss of computational subunits– Changes in connectivity of the
network
Atrophy and de-branching as seen in the CA3 pyramidal cells from (Ajai et al. 2002)
![Page 14: Guest Lecture by Prof. Rohit Manchanda Biological Neurons - I · 2005. 12. 3. · CS 621 Artificial Intelligence Lecture 33 - 07/11/05 Guest Lecture by Prof. Rohit Manchanda Biological](https://reader036.vdocuments.pub/reader036/viewer/2022071503/61235d595972bd5c2877692d/html5/thumbnails/14.jpg)
Increase in spine count (Amygdaloidneurons) (Rupshi et al. 2005)
Changes as a result of stress (CIS)
•Arbor growth•Increase in spine count
Consequences
•Increase in computational subunits•Synaptic site increase
Recent neurobiological discoveries