Skip to content

Practice building different deep neural net models starting with simple problems

Notifications You must be signed in to change notification settings

NewbieAI/Deep-Neural-Net-Practice

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

15 Commits
 
 
 
 
 
 

Repository files navigation

Deep-Neural-Net-Practice

Practice building different deep neural net models starting with simple problems

April 29th update: -Created a simple NeuralNet framework using the Numpy library:

  1. Enables creation of deep neural networks
  2. User can specify the depth of the network and the width of each layer
  3. XOR_test uses NeuralNet to attempt to learn the XOR function
  4. Convergence is observed for 2 bit and 3 bit XOR functions

-To see the framework in action:

  1. put generate_data.py, NeuralNet.py, and XOR_Test.py in the same directory
  2. run the XOR_Test module, the TrainingError vs Iterations graph will appear

-Known problems:

  1. The network does not always converge the where you want!!
  2. The result of convergence is highly sensitive to the initial weights
  3. Oscillation in the training error is observed for some learning rates

About

Practice building different deep neural net models starting with simple problems

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages