Deep Learning by Goodfellow really gave me some good insights and tips for training a model, also covering the mathematical background around the ideas.

I would probably suggest splitting into chunks of data or you could try to implement you own dataset class to load images lazily.