_ __ ___ _ _ __ _ ___ _ __
| '_ ` _ \| | | |/ _` |/ _ \ '_ \
| | | | | | |_| | (_| | __/ | | |
|_| |_| |_|\__,_|\__, |\___|_| |_|
|___/
A music video generator based on rhythm
Use it to brainstorm AMVs, montages, and more! Check it out.
Built with moviepy programmatic video editing, and librosa audio analysis.
-
Provide an audio file and a set of video files.
-
Perform rhythm analysis to identify beat locations.
-
Generate a set of random video segments syced to the beat.
-
Discard segments with scene changes, detectable text (e.g. credits), or low contrast (i.e. solid colors, very dark scenes).
-
Combine the segments in order, overlay the audio, and output the resulting music video.
Optional:
- Install tesseract >= 3.04 and
pip install tesserocr>=2.2.1for text detection features.
Mugen has not been tested on Windows, but should work provided the dependencies are compiled and installed properly.
1. Download this repository
git clone https://github.com/scherroman/mugen
2. Install mugen
pip install -e mugen
2. Create a Python 3.6 virtual environment
conda create --yes --name mugen python=3.6
3. Activate the virtual environment
source activate mugen
4. Download this repository
git clone https://github.com/scherroman/mugen
5. Install mugen
pip install -e mugen
6. Install ffmpeg
imageio_download_bin ffmpeg
2. Install tesseract via Homebrew
brew install tesseract --with-all-languages
4. Create a Python 3.6 virtual environment
conda create --yes --name mugen python=3.6
5. Activate the virtual environment
source activate mugen
6. Download this repository
git clone https://github.com/scherroman/mugen
7. Install mugen
pip install -e mugen[full]
8. Install ffmpeg
imageio_download_bin ffmpeg
mugen --help
mugen create --help
mugen preview --help
mugen create --audio-source MACINTOSH_PLUS_420.mp3 --video-sources TimeScapes.mkv
Use a series 60% of the time and a movie 40% of the time
mugen create --video-sources Neon_Genesis_Evangelion/ The_End_of_Evangelion.mkv --video-source-weights .6 .4
Slow down scene changes to every other beat
mugen create --events-speed 1/2
Slow down scene changes for leading and trailing weak beats
mugen create --beats-mode weak_beats --group-events-by-type --group-speeds 1/2 1 1/4
Control the speed of scene changes for specific sections
mugen create --group-events-by-slices (0,23) (23,32) (32,95) (160,225) (289,321) (321,415) --group-speeds 1/2 0 1/4 1/2 1/2 1/4
Allow clips with cuts and repeat clips
mugen create --exclude-video-filters not_has_cut not_is_repeat
Use only clips that have text
mugen create --video-filters has_text
mugen preview --audio-source Spazzkid_Goodbye.mp3
Input event locations manually
mugen preview --event-locations 2 4 6 10 11 12
This gets interesting!
mugen preview --audio-events-mode onsets --events-speed 1/2 --events-speed-offset 1
from mugen import MusicVideoGenerator
generator = MusicVideoGenerator("Pogo - Forget.mp3")
beats = generator.audio.beats()
beats.speed_multiply(1/2)
generator.preview_events(beats, "forget-preview.mkv")
from mugen import MusicVideoGenerator
generator = MusicVideoGenerator("in love with a ghost - flowers.mp3", ["wolf children.mkv"])
beats = generator.audio.beats()
beat_groups = beats.group_by_slices([(0, 23), (23, 32), (32, 95), (160, 225), (289,331), (331, 415)])
beat_groups.selected_groups.speed_multiply([1/2, 0, 1/4, 1/2, 1/2, 1/4])
beats = beat_groups.flatten()
music_video = generator.generate_from_events(beats)
music_video.write_to_video_file("flowers.mkv")
music_video.save("flowers.pickle")
from mugen import VideoSource, SourceSampler, MusicVideo
music_video = MusicVideo.load("flowers.pickle")
wolf_children = VideoSource("wolf children.mkv", weight=.2)
spirited_away = VideoSource("spirited away.mkv", weight=.8)
sampler = SourceSampler([wolf_children, spirited_away])
music_video.segments[1] = sampler.sample(music_video.segments[1].duration)
music_video.write_to_video_file("flowers.mkv")
from mugen import MusicVideo
music_video = MusicVideo.load("flowers.pickle")
''' Basic Previews (pretty iffy) '''
# Use a lower fps to reduce lag in playback
music_video.segments[1].preview(fps=10)
# Preview a frame at a specific time (seconds)
music_video.segments[1].show(.5)
''' Jupyter Notebook Previews (much better) '''
music_video.segments[1].ipython_display(autoplay=1, loop=1, width=400)
# Preview a frame at a specific time (seconds)
music_video.segments[1].ipython_display(t=.5, width=400)