QA-Board helps Algorithms/QA engineers build great products with powerful quality evaluation and collaboration tools.

QA-Board is not officially released yet, and likely won't work yet for you because it expects running on our infra...

We're working on it! Status: Samsung#1

• Organize, View and Compare Results, Tuning/Optimization
• Web-based: sharable URLs, no install needed.
• Visualizations: support for quantitative metrics, and many file formats: advanced image viewer, support for videos, plotly graphs, text, pointclouds, embedded HTML...
• Integrations: direct access from Git/CI, easily exportable results, API, links to the code, trigger jobs...

• Scale R&D: enable engineers to achieve more and be more productive.
• Faster Time-to-Market: collaboration across teams, workflow integration..
• Quality: uncover issues earlier, KPIs, tuning, reporting...

We are looking for feedback and insights from outside Samsung. This will help us set the direction for qaboard.

We think you could be interested if have projects where:

• unit tests are not enough (ML, operational research...), and a loss function doesn't tell the whole story. Maybe because...
• there are performance / quality trade-offs, or different configurations of your code you need to compare (hardware design, mobile/embedded...).
• you need advanced visualizations to make sense of results (statistics, image processing, 3d sensors, sensing and decision tasks...) and need tools to dive down into outputs.
• lifecycles are complex, with many stakeholders (algo, hardware, software, QA, production...)

Contact arthur.flam@samsung.com

Read the docs! You will learn how to:

• install QA-Board's CLI wrapper
• run a QA-Board server
• wrap your code with QA-Board
• view output files and KPIs
• ...and improve your integration with many guides: bit-accuracy, tuning, etc.

Each section has its own README:

• qatools: provides the qa CLI wrapper than runs your code, and the import qatools package.
• qaboard-backend exposes an HTTP API used to read/write all the metadata on runs.
• qaboard-webapp is the frontend that displays results.
• thirdparty:
  • Cantaloupe IIIF server, used to "stream" large images to the users.

If you've got questions about setup, deploying, want to develop new features, or just want to chat with the developers, please feel free to start a thread in our Spectrum community!

Found a bug with QA-Board? Go ahead and submit an issue. And, of course, feel free to submit pull requests with bug fixes or changes to the master branch.

QA-Board was started at Samsung SIRC by Arthur Flam.

Thanks to the following people for their contributions, testing, feedback or bug reports: Amir Fruchtman, Avi Schori, Yochay Doutsh, Itamar Persi, Amichay Amitay, Lena Grechikhin, Gal Hai, Rivka Emmanuel, Nadav Ofer. Thanks also to Sebastien Derhy, Elad Rozin, Nathan Levy, Shahaf Duenyas, Asaf Jazcilevich and Yoel Yaffe for supporting the project.

You don't see your name? Get in touch to be added to the list!

• The logo is a the Poodle twemoji 🐩, recolored in Samsung Blue 🔵. Copyright 2019 Twitter, Inc and other contributors. Code licensed under the MIT License. Graphics licensed under CC-BY 4.0