Skip to content

sterry24/ASL_Translator

Repository files navigation

ASL Translator

A project to

  • collect ASL (American Sign Language) static gestures through the use of the Leap Motion Sensor.
  • translate ASL gestures into text with the use of a machine learned model from data collection

Includes:

  • One RandomForest model created from data collected from 6 users
  • leap_utils.py:
    • Some utilities for working with leap motion data

Requirements:

Python 2.7
PyQt4 or PyQt5
Leap Motion Sensor
Leap Motion Sensor SDK

Known Issues

Currently, translation occurs too often (receive the same sign over and over).
Attempts to add autocorrect feature were unsuccessful.

  • This was attempted to help correct words as they came through when a sign was predicted incorrectly.

Screenshots

ASL_dataCollectGUI

  • Modify lines 9 and 10 for path to SDK (LeapDeveloperKit_3.2.0+45899_win\LeapDeveloperKit_3.2.0+45899_win\LeapSDK\lib)
  • Modify line 157 to update output paths for data collection

ASL_TranslatorGUI

  • Modify lines 9 and 10 for path to SDK (LeapDeveloperKit_3.2.0+45899_win\LeapDeveloperKit_3.2.0+45899_win\LeapSDK\lib)
  • Modify line 54 to update model path

About

No description, website, or topics provided.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages