Skip to content

bettle123/music_recognization

Repository files navigation

Music Symbols Recognition with CNN

@Author: Su, Ming Yi
@Date: 05/21/2019
@Library: OpenCV, Tensorflow, OpenGL

I applied cutting-edge Machine Learning technique: Convolutional Neural Networks to classify music symbols.
Designed CNN architecture and trained CNN model by tensorflow.
Simulated the training data including illumination, rotation, scale, translation by OpenGL Phong shading.
Increased diversity of training data and implemented image segmentation with music knowledge by OpenCV.

This project is my master project, there are 6 directories.
- music_recognization
- music_simulation_3D
- music_simulation_preprocess
- music_simulation_software
- music_training
- Ouput

Here is the pipeline for my project.

ScreenShot1 - Pipeline

"ScreenShot1"

ScreenShot2 - 1. Five lines detection algorithm

"ScreenShot2"

ScreenShot3 - 2. Scan line algorithm

"ScreenShot3"

ScreenShot4 - 3. CNN classification

"ScreenShot4"

ScreenShot5 - 4. Template Matching for pitch

"ScreenShot5"

ScreenShot6 - Simulate Training data

"ScreenShot6"

ScreenShot7 - Training Data

"ScreenShot7"

ScreenShot7 - CNN architecture

"ScreenShot8"

ScreenShot8 - Training Process

"ScreenShot9"

ScreenShot9 - Result of Test Case 1

"ScreenShot10"

ScreenShot10 - Real Test Case 2

"ScreenShot11"

ScreenShot11 - Result of Test Case 2

"ScreenShot12"

About

Music Symbols Recognition with CNN

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published