Collaborative System for Task Automation and Recognition

CoSTAR is an end-user interface for authoring robot task plans developed at Johns Hopkins University. It includes integrated perception and planning capabilities, plus a Behavior Tree based user interface.

Our goal is to build a system which facilitates end-user instruction of robots to solve a variety of different problems. CoSTAR allows users to program robots to perform complex tasks such as sorting, assembly, and more. Tasks are represented as Behavior Trees. For videos of our system in action, you can check out the CoSTAR YouTube Channel.

To take full advantage of CoSTAR, you will need an RGB-D camera and supported hardware:

• a KUKA LBR iiwa or Universal Robots UR5
• a Robotiq 3-finger gripper or 2-finger gripper
• a Da Vinci Research Kit -- in development.

This is a project by members of the JHU Laboratory for Computational Sensing and Robotics, namely Chris Paxton, Kel Guerin, Andrew Hundt, and Felix Jonathan. If you find this code useful, please cite:

@article{paxton2016costar,
  title={Co{STAR}: Instructing Collaborative Robots with Behavior Trees and Vision},
  author={Paxton, Chris and Hundt, Andrew and Jonathan, Felix and Guerin, Kelleher and Hager, Gregory D},
  journal={arXiv preprint arXiv:1611.06145},
  year={2016}
}

Interested in contributing? Check out the development guidelines

Check out installation instructions.

We are working on experimental install scripts:

• ROS Indigo/Ubuntu 14.04 LTS
• ROS Kinetic/Ubuntu 16.04 LTS -- not yet supported

Run the IIWA test script:

rosrun costar_bringup iiwa_test.py

It will start gazebo and move the arm to a new position. If this test passes, CoSTAR is set up right.

There is a more detailed startup guide.

• Bringup: launch files, RVIZ configurations, et cetera
• Component: generic tools for non-specific CoSTAR components.
• Instructor: user interface
• Librarian: file management
• Predicator: robot knowledge management
• Perception: semantic segmentation and object detection via SP Segmenter
• Robot: utilities and services allowing high-level control of the robot and integrating these behaviors into the UI. Contains the CostarArm component.
• Gripper: utilities for integrating different grippers into UI
• Tools: packages used for data collection, maintaining MoveIt planning scene, and other purposes

CoSTAR is maintained by Chris Paxton (cpaxton@jhu.edu).

Other core contributors include:

• Felix Jonathan
• Andrew Hundt