playing around with some neural nets
nn folder has a numpy nn for arbitrarily deep feed forward nets.
- mini-batch sgd, Adadelta, RMSProp
- just mean squared error cost function for now
- activations: linear tanh, relu, leaky relu, sigmoid
sentences_CNN has theano based cnn for modelling sentences and example run on a small corpus of academic papers
read the soar document there for more details