Flag_Red t1_iw2nxte wrote on November 12, 2022 at 2:17 PM

Reply to comment by enryu42 in [D]We just release a complete open-source solution for accelerating Stable Diffusion pretraining and fine-tuning! by HPCAI-Tech

If I'm not mistaken, full fine tuning on one 3090 isn't really feasible because of training times. I haven't tried it, but I was under the impression that matching the results of a DreamBooth would take an unreasonably long time.

DreamBooth gets around this by bootstrapping a very small number of training examples to learn a single concept. But if I have a few thousand well labelled images, I should be able to do a fine tune on them (maybe with some regularisation?) and get better results.

enryu42 t1_iw2vlwf wrote on November 12, 2022 at 3:19 PM

Oh, it is totally feasible - I'm getting smth around 2.5 training examples/second with vanilla SD without any optimizations (which translates to more than 200k per day), which is more than enough for fine-tuning.

I'd still not recommend it for teaching the model new concepts though - it is more appropriate for transferring the model to new domains (e.g. here people adapted it to anime images).