nn models with dl4j for deep learning

Download NN Models with DL4J for Deep Learning

If you can't read please download the document

Upload: -

Post on 16-Aug-2015

478 views

Category:

Data & Analytics


10 download

TRANSCRIPT

  1. 1. NN Models with DL4J for Deep Learning ujava.org 11th Deep Learning Workshop 2015-08-08 www.idosi.com CEO Shindong KANG ()
  2. 2. www.idosi.comujava.org
  3. 3. www.idosi.comspaceapi.org
  4. 4. www.idosi.com DL4J (Deeplearning4j, Deep Learning for Java)
  5. 5. www.idosi.com Hopfield Network
  6. 6. www.idosi.com Boltzmann Machine
  7. 7. www.idosi.com RBM (Restricted Boltzmann Machine)
  8. 8. www.idosi.comIris Iris setosa Iris virginicaIris versicolor Sepal length () Sepal width Petal length () Petal width
  9. 9. www.idosi.comIris Data set
  10. 10. www.idosi.comIris Data File (150 rows)
  11. 11. www.idosi.com Activation Functions Graph
  12. 12. www.idosi.com Vector
  13. 13. www.idosi.com Pythagoras' theorem
  14. 14. www.idosi.com Euclidean Distance
  15. 15. www.idosi.comNorm
  16. 16. www.idosi.com Loss Function
  17. 17. www.idosi.comMomentum Learning Rule
  18. 18. www.idosi.comMLP
  19. 19. www.idosi.comMLP
  20. 20. www.idosi.comXavier initialization
  21. 21. www.idosi.comXavier Initialization
  22. 22. www.idosi.com Gaussian function
  23. 23. www.idosi.comSoftmax function
  24. 24. www.idosi.comSoftmax function
  25. 25. www.idosi.comMLP training
  26. 26. www.idosi.comMLP evaluation
  27. 27. www.idosi.com MLP (Multi-Layer Perceptron) execution
  28. 28. www.idosi.com Activation Functions Graph (ReLU)
  29. 29. www.idosi.com RMSE (Root Mean Squared Error)
  30. 30. www.idosi.com Cross Entropy Error
  31. 31. www.idosi.com Gradient Descent with step size parameter
  32. 32. www.idosi.com Gradient Descent
  33. 33. www.idosi.com Newton-Raphson method (Newton's method)
  34. 34. www.idosi.com Newton-Raphson method (Newton's method)
  35. 35. www.idosi.com Newton-Raphson method (Newton's method)
  36. 36. www.idosi.com Newton-Raphson method (Newton's method)
  37. 37. www.idosi.com Backtracking line search for step size
  38. 38. www.idosi.com Line search
  39. 39. www.idosi.com Stochastic Gradient Descent (SGD)
  40. 40. www.idosi.com AdaGrad (Adaptive Gradient) of SGD
  41. 41. www.idosi.com AdaGrad (Adaptive Gradient)
  42. 42. www.idosi.com Drop-Out
  43. 43. www.idosi.com Drop-Out Effect
  44. 44. www.idosi.com Drop-Connect
  45. 45. www.idosi.com DBN pre-training
  46. 46. www.idosi.com DBN's greedy layer wise training
  47. 47. www.idosi.comDBN
  48. 48. www.idosi.comDBN
  49. 49. www.idosi.comDBN model
  50. 50. www.idosi.comDBN train and evaluate
  51. 51. www.idosi.com DBN (Deep Belief Network) execution
  52. 52. www.idosi.comDeep AutoEncoder
  53. 53. www.idosi.comDeep AutoEncoder
  54. 54. www.idosi.comDeep AutoEncoder
  55. 55. www.idosi.comDeep AutoEncoder
  56. 56. www.idosi.comConvolution function
  57. 57. www.idosi.comConvolution in CNN
  58. 58. www.idosi.comConvolution with Kernel
  59. 59. www.idosi.com3D Kernel
  60. 60. www.idosi.comMax Pooling
  61. 61. www.idosi.comCNN
  62. 62. www.idosi.comCNN
  63. 63. www.idosi.comCNN with DL4J
  64. 64. www.idosi.comCNN with DL4J
  65. 65. www.idosi.comCNN with DL4J
  66. 66. www.idosi.comCNN modeling, training, evaluation
  67. 67. www.idosi.com Appendix
  68. 68. www.idosi.comJava Beans
  69. 69. www.idosi.comJava Island
  70. 70. www.idosi.comLombok Island
  71. 71. www.idosi.comLombok Project Web Site
  72. 72. www.idosi.comLombok installation
  73. 73. www.idosi.comLombok installation
  74. 74. www.idosi.comLombok installation OK
  75. 75. www.idosi.com Lombok
  76. 76. www.idosi.com Lombok
  77. 77. Thank you ! () Intelligent City Ltd. Shindong KANG www.idosi.com [email protected]