Skip to content

gooa1121/LearningSocialInteraction

Repository files navigation

Studying Social Interactions through Computer Vision

Introduction

The goal of this project is to find conversational groups among people in the image as well as the group membership. More specificlly, we want to predict F-formation, which is a spatial arrangement of people's social behavior.

Pipeline

To predict F-formation with estimated positions and orientations:

  1. Multi-camera Multi-target Detection: https://github.com/pierrebaque/DeepOcclusion
  2. Tracking (Optional): https://github.com/cvlab-epfl/pyKSP
  3. Orientation Estimation and F-formation Prediction: Run GroupVoting_estInputs.ipynb.

To predict F-formation with annotated positions and orientations: Directly run GroupVoting.ipynb.

Testing Data

SALSA Dataset: http://tev.fbk.eu/salsa

Results

Using GT positions and orientations

View1View2View3View4

Using estimated positions and orientations

r1r2r3r4

About

No description, website, or topics provided.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published