Viewing a single comment thread. View all comments

thelastpizzaslice t1_isxw4bb wrote

What is the value of having a ckpt output? Is it like dreambooth?

1

0x00groot OP t1_isxwwp7 wrote

Not right now. You need the model weights along with the optimised embeddings to get the results.

2

thelastpizzaslice t1_isxxsok wrote

So, to use this, I run the colab, take the ckpt and also a pt that exists somewhere presumably, drop them into AUTOMATIC1111, and then I can pose a specific photo like it's a doll/restyle it at will in AUTOMATIC1111? Am I correct in this description?

2

0x00groot OP t1_isy024x wrote

Currently automatic doesn't support it. You can use the inference code given at the end of colab to generate images for now.

2

thelastpizzaslice t1_isy86ca wrote

I decided to copy paste the model into automatic1111 anyway. I made one based on a photo of Atul from spiritfarer with a loose description of him as "uncle frog spirit person" and it's actually the single best cartoon generator I've ever worked with. I've spent dozens of hours trying to make these things and this paper beat all of them on accident. What a time to be alive!

The author of this paper is apparently a genius who has built something better than TI or Dreambooth, and is massively understating his accomplishment.

Here's the three photos #1 is standard, #2 is dreambooth, #3 is imagic

This is Atul

5

0x00groot OP t1_isycsor wrote

Oh wow. That's really interesting. I'll have to look into it.

2