This repository is simple implementation of some deep learning algorithms.

e.g.

cd example
python mlp.py

• Multi-Layer Perceptron (example/mlp.py)
• Denoising Autoencoder (example/da.py)
• Sparse Autoencoder (example/sa.py)
• Convolutional Neural Network (example/cnn.py)

in dnn/layer.py

• Fully-Connected Layer
• 2-Dimensional Convolutional Layer
• 2-Dimensional Max Pooling Layer
• Batch Normalization Layer

in dnn/optimizers.py

• Stochastic Gradient Descent (SGD)
• Momentum Stochastic Gradient Descent (Momentum SGD)
• AdaGrad
• RMSprop
• AdaDelta
• Adam

• Python3
• NumPy
• Theano == 0.9.0
• Scikit-Learn
• tqdm
• Pandas (for visualization)
• Matplotlib (for visualization)