Submitted by 0x00groot t3_y7u6gg in MachineLearning
Text-Based Real Image Editing
Code: https://github.com/ShivamShrirao/diffusers/tree/main/examples/imagic
Still need to play around and tune the parameters a bit, may not work as is on every subject. Hopefully everyone can try it out now.
This is produced through this implementation.
Yes you can run it locally in 12 GB VRAM.
This Shivam Shrirao guy is super fast! Took him two days to make Dreambooth scripts and now just one day to make Imagic scripts.
Haha. Thanks
paging Automatic1111
pls implement in webui
This is not Windows compatible as far as I know.
Some people have been able to run xformers on windows.
https://github.com/huggingface/diffusers/pull/532#issuecomment-1273656447
Automatic1111's webui runs in linux or windows
What is the value of having a ckpt output? Is it like dreambooth?
Not right now. You need the model weights along with the optimised embeddings to get the results.
So, to use this, I run the colab, take the ckpt and also a pt that exists somewhere presumably, drop them into AUTOMATIC1111, and then I can pose a specific photo like it's a doll/restyle it at will in AUTOMATIC1111? Am I correct in this description?
Currently automatic doesn't support it. You can use the inference code given at the end of colab to generate images for now.
Obamna
but not bitsandbytes as far as i know
How different is this in practice from running img2img on regular SD? The examples shown in the paper look very similar to what you would get from img2img, as far as I can tell.
(Ps: great work on your repos! I still can't run Dreambooth on my 3080 10gb but have played around with it in Collab and it's fantastic.)
I decided to copy paste the model into automatic1111 anyway. I made one based on a photo of Atul from spiritfarer with a loose description of him as "uncle frog spirit person" and it's actually the single best cartoon generator I've ever worked with. I've spent dozens of hours trying to make these things and this paper beat all of them on accident. What a time to be alive!
The author of this paper is apparently a genius who has built something better than TI or Dreambooth, and is massively understating his accomplishment.
Here's the three photos #1 is standard, #2 is dreambooth, #3 is imagic
Just copy the ckpt output and use similar terms. It worked for me.
Oh wow. That's really interesting. I'll have to look into it.
https://twitter.com/andrewb10687674/status/1582479603129466881
In this tweet the author also claims that cycle diffusion is about 1minute , unlike Imagic which is 5min+ atleast
Does this use model v1.5 or is it still running on v1.4?
You can specify what to use with MODEL_NAME variable.
Oh my Obama. What large teeth you have.
img2img even at a high init image setting doesn't necessarily respect the init image, this is far more precise. It's limited (to my knowledge) because it uses one input image, but the results are pretty incredible.
Does this give the exact same output as 24gb VRAM?
[deleted]
advertisementeconomy t1_iswsi3r wrote
Wow. The pace is exciting. Is that the Barack from the original tweet or was it run through this implementation?
Here's the README for anyone interested: https://github.com/ShivamShrirao/diffusers/blob/main/examples/imagic/README.md
Is the .ipynb file a Jupyter Notebook that could be run locally on a card with 12GB VRAM (forgive me if this is a stupid question using Colab and Jupyter is new to me)?