Skip to content

Image recoloring with deep neural networks (and GANs!)

License

Notifications You must be signed in to change notification settings

irvanmalik48/repalette

 
 

Repository files navigation

Usage

  1. Install Docker
  2. Pull the web app container:
docker pull danielgafni/repalette:app
  1. Run the container:
docker run -p 8000:8000 danielgafni/repalette:app
  1. Open localhost:8000 in your browser
  2. In the web interface:
  • Upload the image
  • Select the desired color palette
  • Press the "recolor" button

Screenshots

image image

Development

Installation

poetry install
poetry run pre-commit install  # for development

To activate the virtual environment run poetry shell

Configuration

cp ./.env.example ./.env

Fill it with the correct values.

Install Jupyter Lab plugins

# Avoid "JavaScript heap out of memory" errors during extension installation
# (OS X/Linux)
export NODE_OPTIONS=--max-old-space-size=4096
# (Windows)
set NODE_OPTIONS=--max-old-space-size=4096
# Jupyter widgets extension
jupyter labextension install @jupyter-widgets/jupyterlab-manager --no-build

# jupyterlab plotly renderer support
jupyter labextension install jupyterlab-plotly --no-build

# Plotly FigureWidget support
jupyter labextension install plotlywidget --no-build

# Build extensions (must be done to activate extensions since --no-build is used above)
jupyter lab build

# Unset NODE_OPTIONS environment variable
# (OS X/Linux)
unset NODE_OPTIONS
# (Windows)
set NODE_OPTIONS=

Download data

Option 1: scrap data from www.design-seeds.com

python repalette/db/utils/download_raw.py --num-workers 8  # adjust num-workers
python repalette/db/utils/build_rgb.py

Option 2: download prepared data from S3

This data might be a little outdated comparing to the #1 option, but will be downloaded much faster.

python repalette/db/utils/download_rgb_from_s3.py

Update S3 dataset

python repalette/db/utils/upload_rgb_to_s3.py

Download the pre-trained model checkpoint:

python repalette/db/utils/download_pretrain_checkpoint_from_s3.py

Training

The model can be trained on the data downloaded from www.design-seeds.com. After running the training script the logs (losses, images, etc) will be available at localhost:6006.

Pre-training

python repalette/training/pretrain.py

GAN training

python repalette/training/gan.py

Project structure

data

  • data - root data directory
  • data/raw.sqlite, data/rgb.sqlite - databases
  • data/raw - raw images downloaded from Design Seeds
  • data/rgb - cropped images without palettes in RGB
  • data/model-checkpoints - pytorch-lightning models checkpoints
  • data/lightning-logs - pytorch-lightning tensorboard (or other logger) logs

Code

  • repalette - main python package
  • scripts - misc scripts
  • app - web app

About

Image recoloring with deep neural networks (and GANs!)

Resources

License

Stars

Watchers

Forks

Packages

No packages published

Languages

  • Python 95.9%
  • Dockerfile 1.6%
  • Shell 1.4%
  • HTML 1.1%