YouTube analysis concerning content creator collaborations in videos, using face recognition. This projects includes data acquisition from YouTube ,video and face processing and statistics evaluation.

contains evaluation results and plots

contains code for the different pipeline steps

crawler code for YouTube, Socialblade and Google Images

evaluation code, jupyter-notebook based evaluation, code for plot creation

video download, face recognition and clustering pipeline, contains Facenet code base aswell as youtube_dl

collaboration graph visualization based on Gugel Universum (http://universum.gugelproductions.de/).

misc scripts, face recognition evaluation scripts (heavily based on FaceNet and OpenFace (https://cmusatyalab.github.io/openface/) code)

For face feature extraction trained models and code from FaceNet is used. Face detection and alignment uses MTCNN Multi-task CNN.

For clustering face features, the algorithm HDBSCAN is used.

Face recognition evaluation were conducted on the YouTube Faces dataset aswell as Labeled Faces in the Wild LFW dataset.

See the CATANA publication for further explanation.

Data for applying face recognition and evaluation can be acquired using the provided crawler in [data_collection] directory.

Depending on the use-case different requirements must be met.

For using the CATANA framework only, without evaluation of the other face recognition methods like OpenFace, see requirements.txt aswell as the requirements of FaceNet.

For executing the face recognition evaluations, additionally requirements for the OpenFace (https://cmusatyalab.github.io/openface/) framework must be installed.

All use cases also require a current OpenCV 2.4 version installed.

For video extraction, youtube_dl is used, a version is included in the face_recognition directory, but should be updated to a current version when used.

See the respective directory Readme files for instructions.

Data evaluation is based on Jupyter notebook .ipynb files located in data_evaluation. File names indicate a execution order, while 'XX' files can be executed independent after the strict order execution.