Task : Unknown territory mapping with teleoperation, and intelligent map-based navigation with voice interaction.
Robo_guide will be deployed in an unknown territory. It will be remotely tele-operated via keyboard aided with a GUI. We will be receiving a live video feed from the robot for feedback. We will be using the kinect sensor to image and map the environment. A slam algorithm will be running in the background, to localize and map the robot. After covering the Area of Interest (AOI), the map will be stored in the server.
The user interacts with our system to choose a goal point from the previous map. The robot uses the map, computes a path to the goal. 'Alexa' is the framework from Amazon for voice command recognition which we are employing. The robot guides the user through this path avoiding new obstacles if any, and reaches the goal.
- Microsoft Kinect (Mapping and SLAM)
- IR Sensor (Obstacle detection)
- Web Camera (Send live image feed)
- Microphone (Input voice commands)
- Inbuilt encoders (Odometry)
- We use a AWS lambda to host our alexa service if you want to reuse this code please create a AWS account to host the lambda.
- We have implemented a request response framework over mqtt. The code uses a public mqtt service make sure to change it to custom one.