Skip to content

This is the ready-to-use code for the paper 'Quaternion Convolutional Neural Networks for End-to-End Automatic Speech Recognition'. It provides all the Keras classes to run a Quaternion Convolutional NN.

License

Notifications You must be signed in to change notification settings

b2220333/Quaternion-Convolutional-Neural-Networks-for-End-to-End-Automatic-Speech-Recognition

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

20 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Quaternion-Valued Convolutional Neural Networks for End-to-End Automatic Speech Recognition

This repository contains code which reproduces experiments presented in the paper Quaternion Convolutional Neural Networks for End-to-End Automatic Speech Recognition

Requirements

Install requirements for experiments with pip:

pip install numpy tensorflow-gpu keras theano

Depending on your Python installation you might want to use anaconda or other tools. You can also go to the 'Installation' Section and execute the command for an automatic installation.

Installation

Install all the needed dependencies.

python setup.py install

TIMIT

Since the TIMIT dataset is not free, you must create your own features, and also create your own:

  • Keras Data Generator (See scripts/training.py)
  • Keras Edit Distance Accuracy (See scripts/training.py)

Experiments

  1. Get help:

    python scripts/run.py train --help
    
  2. Run models:

    python scripts/run.py train --model {real,quaternion} --sf STARTFILTER --nl NUMBEROFLAYERS
    

    Other arguments may be added as well; Refer to run.py train --help for

    • Optimizer settings
    • Dropout rate
    • Clipping
    • Saving prefix
    • ...

Citation

Please cite our work as


About

This is the ready-to-use code for the paper 'Quaternion Convolutional Neural Networks for End-to-End Automatic Speech Recognition'. It provides all the Keras classes to run a Quaternion Convolutional NN.

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Python 100.0%