king_of_walrus t1_ivbdzd4 wrote
I don’t think it’s that easy… do you have brain activity/image pairs for training? If so, do you have a lot of them?
To train the conditional models, and you need pairs of targets and conditioning info. Also, the code is a lot to digest. I would suggest looking in ldm/models/diffusion/ddpm.py to see how things work. You can clearly see all diffusion related code and the training logic. It may help your understanding.
bloc97 t1_ivbmwbb wrote
I'm just guessing, but it's probably pairs of visual cortex activations with images seen by an animal (maybe mice)...
Viewing a single comment thread. View all comments