Open Source GPGPU support for Artificial Neural Networks

The benchmarks used are based on the Sentdex (PythonProgramming.net) Neural Networks Machine Learning Tutorial

Artificial Neural Network implementation alternatives in OpenCL ('cause GPGPU != nVidia), and if that isn't enough, try Micro$oft Windoze:

TF:
1. Luke Iwanski's OpenCL support for TensorFlow via SYCL
2. Benoit Steiner's OpenCL support for TensorFlow
3. Hugh Perkins's TensorFlow on Coriander.
  - No windows support
  - No native GPU-based convolutions (see corainder-dnn WIP)
4. Benoit Steiner's tensorflow-opencl
5. TensorFlow.js on WebGL
Theano:
1. Theano using libgpuarray
2. Jonas Jarutis's "Theano and Keras setup on ubuntu with OpenCL on AMD card" (see also Fabrício Silva's version)
Caffe: OpenCL Caffe
1. requires the ViennaCL developer repo to install on Windows. see also Caffe on Micro$oft Windoze
2. Using Intel's spatial convolution engine
3. HCC Caffe backend
AMD software ComputeLibrary (TODO)
ArrayFire
Codeplay's ComputeCpp (SYCL implementation)
Torch:
1. Hugh Perkins's pyCLTorch. Requires CMake to install on Micro$oft Windoze.
2. HCC Torch backend
DeepCL: Hugh Perkins's DeepCL. (Works! still trying to get the Python bindings working on Micro$oft Windoze, though)
Apache SINGA (TODO)
FANN: Steffen Nissen's FANN (see OpenCL backend with C API and non-OpenCL Python bindings)
Nengo OpenCL (nengo_ocl)
Encog: Jeff Heaton's encog (no Python. For example Maven Central POM for encog 3.3.0) (Jeff's reply to my inquiry was that he gave up support of OpenCL since Encog 3). My attempt is here.
Veles: Samsung's Veles (Ubuntu only)
Neural Networks: Ivan Vasilev's Neural Networks (Works!)
Spark: Max Grossman's Spark SWAT

DevOps

docker cp $AMP_APP_SDK_SRC_DIR\AMD-APP-SDKInstaller-v3.0.130.136-GA-linux64.tar. bz2 my-ubuntu:$AMP_APP_SDK_TGT_DIR

(not "docker-machine scp", which accesses the virtual machine itself, rather than the docker container we're running in it)

Name		Name	Last commit message	Last commit date
Latest commit History 74 Commits
TensorFlow-Examples/examples/3_NeuralNetworks		TensorFlow-Examples/examples/3_NeuralNetworks
data		data
sentdex_nn_ml_tutorial @ 041b11e		sentdex_nn_ml_tutorial @ 041b11e
testkeras		testkeras
testnengo		testnengo
testocl		testocl
testocv		testocv
testplaidml		testplaidml
.gitignore		.gitignore
.gitmodules		.gitmodules
AMD_OCL.md		AMD_OCL.md
CMakeLists.txt		CMakeLists.txt
Google_Colaboratory_TensorFlow_with_GPU.ipynb		Google_Colaboratory_TensorFlow_with_GPU.ipynb
Google_Colaboratory_test_ogpgpuann.ipynb		Google_Colaboratory_test_ogpgpuann.ipynb
README.md		README.md
my_amd_clinfo.txt		my_amd_clinfo.txt
setup.py		setup.py
test_SYCL.cpp		test_SYCL.cpp
test_arrayfire.py		test_arrayfire.py
test_arrayfire_ml.cpp		test_arrayfire_ml.cpp
test_pycaffe.py		test_pycaffe.py
test_pyopencl.py		test_pyopencl.py
test_veles.py		test_veles.py