Viewing a single comment thread. View all comments

trovaleve t1_j7owfxe wrote

I've never actually put any thought into how image similarity tests work. I wonder if that's how Google's reverse image search works.

2

Pro_RazE OP t1_j7ox1lr wrote

Let's say you generate an image of a cat. CLIP can convert what is in the image into words and then use them to find similar images that was in the LAION dataset which Stable Diffusion uses. So if it was let's say an orange cat, it can find similar images of that cat that was used in the training. Without those original pictures, Stable Diffusion cannot generate pictures of an orange cat (poor example i know lol). It is not always accurate. And also generated images are always different to the original ones. But one recent paper kinda proved it wrong (very rarely happens)

I hope this helps.

3