Skip to content

Speech interface to play Minecraft without necessity of touching keyboard - Voice Recognition, Syntax/Semantics Analysis with NLP, and Heuristics Algorithms

Notifications You must be signed in to change notification settings

HiroIshikawa/speech2craft

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 
 
 
 
 
 
 
 
 

Repository files navigation

Speech2craft

Description of the Video

A Smart Speech Interface for Minecraft

Speech2craft is a smart speech interface that allows users to play and explore the amazing world of Minecraft without having to touch a keyboard or controller. Not only it supports simple movements such as move, turn, attack, jump, pitch but also complex movements like equipping a specific tool and tracking a target entitiy. Do you want to dig the ground fast? Say "use diamondpickaxe and dig"! Do you want to chase the pig? Say "go to pig"! Speech2craft integrates technical key components. Speech recognizer converts the user's speech into text. Text parser restructure the text to a pattern and match that with Minecraft commands. Command handler allows the anget in the Minecraft to take actual actions. Let's speech and craft!

Library/API Used:

Source Code / Detailed Doc / Pictures

About

Speech interface to play Minecraft without necessity of touching keyboard - Voice Recognition, Syntax/Semantics Analysis with NLP, and Heuristics Algorithms

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published