I'm playing with PyTorch on the CIFAR10 dataset.

Pros:

• Built-in data loading and augmentation, very nice!
• Training is fast, maybe even a little bit faster.
• Very memory efficient!

Cons:

• No progress bar, sad :(
• No built-in log.

I manually change the lr during training:

• 0.1 for epoch [0,150)
• 0.01 for epoch [150,250)
• 0.001 for epoch [250,350)

Resume the training with python main.py --resume --lr=0.01