Skip to content

Programming a Real Self-Driving Car: In this project ROS nodes are developed to implement the core functionality of an autonomous vehicle system, including traffic light detection, control, and waypoint following. The system is first tested on a simulator and then on a real car. The solution is implemented using ROS, C++, Python and TensorFlow.

License

emabello42/CarND-Capstone-1

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

This is the project repo for the final project of the Udacity Self-Driving Car Nanodegree: Programming a Real Self-Driving Car. For more information about the project, see the project introduction here.


Team Leader

Christiane Rother - christiane.rother@web.de

Team Member

Frederik Rathmann - f-rathmann@outlook.de
Emmanuel Bello - emabello42@gmail.com
Yang Song - ysong.sc@gmail.com
Pascal Perle - pasfitbit@gmail.com


Traffic Light Detection

The model used is based on ssd_mobilenet_v1_coco from Tensorflow Models. The dataset (TFRecord) was created using the labeled images by coldKnight and using simulation_data.ipynb in order to create some augmented images.

More information about the training can be found at Traffic-Light-Detection-TensorFlow.


Please use one of the two installation options, either native or docker installation.

Native Installation

  • Be sure that your workstation is running Ubuntu 16.04 Xenial Xerus or Ubuntu 14.04 Trusty Tahir. Ubuntu downloads can be found here.

  • If using a Virtual Machine to install Ubuntu, use the following configuration as minimum:

    • 2 CPU
    • 2 GB system memory
    • 25 GB of free hard drive space

    The Udacity provided virtual machine has ROS and Dataspeed DBW already installed, so you can skip the next two steps if you are using this.

  • Follow these instructions to install ROS

  • Dataspeed DBW

  • Download the Udacity Simulator.


Docker Installation

Install Docker

Build the docker container

docker build . -t capstone

Run the docker file

docker run -p 4567:4567 -v $PWD:/capstone -v /tmp/log:/root/.ros/ --rm -it capstone

Port Forwarding

To set up port forwarding, please refer to the instructions from term 2


Usage

  1. Clone the project repository
git clone https://github.com/udacity/CarND-Capstone.git
  1. Install python dependencies
cd CarND-Capstone
pip install -r requirements.txt
  1. Make and run styx
cd ros
catkin_make
source devel/setup.sh
roslaunch launch/styx.launch
  1. Run the simulator

Real world testing

  1. Download training bag that was recorded on the Udacity self-driving car.
  2. Unzip the file
unzip traffic_light_bag_file.zip
  1. Play the bag file
rosbag play -l traffic_light_bag_file/traffic_light_training.bag
  1. Launch your project in site mode
cd CarND-Capstone/ros
roslaunch launch/site.launch
  1. Confirm that traffic light detection works on real life images

About

Programming a Real Self-Driving Car: In this project ROS nodes are developed to implement the core functionality of an autonomous vehicle system, including traffic light detection, control, and waypoint following. The system is first tested on a simulator and then on a real car. The solution is implemented using ROS, C++, Python and TensorFlow.

Resources

License

Stars

Watchers

Forks

Packages

No packages published

Languages

  • CMake 38.7%
  • Python 34.6%
  • C++ 25.5%
  • Other 1.2%