How much do you guys charge for finetuning? Also how long does it take and what GPUs are you training on?

Finetuning takes ~15 mins at 1500 steps on about 10-15 images. We train on A100s and it costs about $2.50 per finetune. We're running a holiday promo though right now where you can finetune for $0.99.

Excited for you to try it out! Let me know if you have any feedback :)

How much does inference cost? Does that run on A100s too?

Yeap, you can run inference on upto 100 images at a time for 0.5c

Great to hear! How does the quality compare to Astria? I’ve found that Replicate’s API, for example, is significantly lower quality that Astria’s.

Interesting. 2.50 for 1500 is quite expensive though. Astria is about 3$ bulk or 5$ one off with about 100 free images. Do you guys add any “secret” sauce for fine tuning models?

We can benchmark it, our renders are pretty high quality. I'll pick a celeb and train it against both and post results sometime tomorrow.

No UI, just api calls, is that correct?

So just to compare we do $2.50 for one-off fine tunes + inference for 100 images costs 0.5c so call it $2.51.

By the way, you can choose how many steps you want to train for, would still come around to $2.50 as long as it's within reason (eg: <10k steps).

For bulk pricing + volume, we can definitely do better than $3, I mean our one-off is cheaper than that. DM me with details on your workloads and we can figure out bulk pricing that beats any other vendor.

Hosted WebUI's is on the roadmap and will be launching soon! We have a few users beta testing it right now. Let me know if you'd like to join the beta.

In the meantime, here's an example of some of the renders. This ofcourse is highly dependent on the prompts + inference config (samplers, steps, seed etc...)

Thanks, this would be hugely helpful! I’m actually trying to make an app using an API, I’d love to Ty this out!

Do we get to configure the specific fine tuning?

Yes you do, what parameters you thinking specifically?

Interesting! Will definitely look into this if I develop any apps in the future.

Are you using AWS for training, or others?

Excited to have you try us out, let me know if I can answer any questions or help you get started. We don't use AWS, we've got our own GPUs :)

I’m interested to beta test. Will you all be supporting LLMs as well? I hear stability has something cooking for those, very interested in that space and running some tests with GPT2 right now.

Can we download the model ?

Great concept. What version(s) of Stable Diffusion does it work with?

I'd be interested in trying the beta!

Does it work with sparse models from the sparse zoo?

No Emma Watson or Taylor Swift. I declare it a failure.

I would be interested too!

Another guy making money out of dreambooth training when you can do it for free on Google Colab...

Bottom right?

If it is then I stand corrected.....said the man in the orthopedic Shoes

Is it possible to do dreambooth with less than 16 GB of GPU? I figured you couldn't do attention slicing for fine tuning the way you can for just running the model.

Yes, there are some colab notebooks that do it for you easily. This one works great: https://colab.research.google.com/github/TheLastBen/fast-stable-diffusion/blob/main/fast-DreamBooth.ipynb

[removed]

Since you are using huggingface for hosting models, you can also create a organization with a webui there and embed it in your website

for example this is stabiity ai org: https://huggingface.co/stabilityai

this is a web demo: https://huggingface.co/spaces/stabilityai/stable-diffusion

you can duplicate and embed it:

<script
type="module"
src="https://gradio.s3-us-west-2.amazonaws.com/3.11.0/gradio.js"
\></script>

<gradio-app src="https://stabilityai-stable-diffusion.hf.space"></gradio-app>

This may be a dumb question, but what products is stable diffusion useful for? It's an awesome technology but does it have any kind of widespread applicability?

So true

[removed]

Yes. Just look at all the AI art apps popping up. Logo makers too. The AI avatar apps killing it like AI Avatars or Lensa.

We'll have a stable diffusion and dreambooth API up soon on our site as well. So I hope it makes SD app dev's lives that much easier

You can finetune on all versions, 1.4, 1.5 and the newer SD 2.x models :)

Yes, will be adding support for additional models starting with Whisper, GPT2 and Stability's LLM once it comes out :) Let me know if there's any custom models you'd like hosted and we'll get that up and running. Eventually will be able to do that self serve.

There's a ton of Colabs out there for folks to use, keep in mind you're still paying Google however much a month for compute credits. I would recommend Colab for folks looking to experiment in a notebook. What we're offering is an API ready for production grade apps.

Hope you try us out :)

What is the code for the Holiday Promo?

REDDIT

Looking into GPT-NeoX, seems like the right direction if you're looking at supporting Stability's LLM (Stability is providing EleutherAI cloud services, I'd guess the forthcoming LLM will be a collaboration).

Anyway we can get that up and running? Would love to test that on your API.

This is a great response. I feel like I’m one of many who have no interest in experimenting with a colab. I just want an api that I can start building on quickly. I’ll head over and check it out later today!

Excited for you to give us a try, feel free to hop in the Discord too. I'm always around to answer Q's!

Shoot me a DM and we'll get you setup :)

We host the models on our end, our huggingface integration allows you to pull in any model from there for finetuning and push finetuned models to your private repos.

I was just wondering if you guys do anything different while tuning. I would use your service if tunes yielded similiar result to astria. Right now I have my own infra setup but can't get it fine tuned quite like it.

We do indeed have a few optimizations in place to make sure renders are high quality. Take a look at some of our renders

We can setup any model from there for you to finetune + run inference on. Shoot me a DM and I'll help you get started

Chat sent

Just bought a credit and trying it out :) Btw do you use the huggingface diffusers repo? Or another one? (Also running the api, and how what should the file array include? Path to images or public image url?)

Fine-tuning the SD 2.1 768x768 resolution model as well or just the 2.1-base 512x512 model?

Also can you supply your own regularization images, or do you have some selection (w. recommendations for e.g. fine-tuning on a person) to choose from? Training the text-encoder as well I assume? What about jointly learning different concepts when fine-tuning on an object/person?

Can do both, any diffusion model you want really

We can support regularization with your own class images if you'd want, however it's recommended to use model generated regularization images for prior preservation. You don't want to introduce bias into the model with curated images.

We train the text encoder as well, correct.

You should be able to train multiple concepts/subjects although there is an unsolved problem regarding bleeding when used in the same prompt. Shoot me a DM and we can probably figure something out!

Sounds great! I d be happy to switch over from astria, but i am missing two things:
- Astria has a "super_resolution" and a "face_correct" flag that work pretty good

Curated images would be generated by the model being trained using the same prompt for reg images as for the subject training images (found via clip interrogation, swapping out e. g. "a woman" to my subject's token). Not a big deal though, if you can train the 768x768 model I'll try it out. Can't run it locally and colabs for the 768 model have been unreliable. Might write my own later on if the model trained by you shows good quality.

Edit: probably not much use having the exact same prompt, but I'm thinking something similar to the clip classification of the image(s) + the general style/concept you want to learn. Or do you see some issues with the method I've described?

You can do full finetuning with 12gb already (kohya_ss)

I understand your point. My point is that these guys are making you pay for it when this API that you want could definitely be for free.

Without open source they would not be able to make you pay for any of this, so using open source tools to make paid APIs just doesn't go along with me.

Hello u/TrueBlueDreamin,

Would this website (of yours) allow a website (that I created) to let users send their images to my website, then my website would send them to your website and generate a training , then my website would receive back the new model? then produce some images to the end user? If yes, then everytime that happends you get payed right? (I am still new)

> you get paid right? (I

FTFY.

Although payed exists (the reason why autocorrection didn't help you), it is only correct in:

• Nautical context, when it means to paint a surface, or to cover with something like tar or resin in order to make it waterproof or corrosion-resistant. The deck is yet to be payed.

• Payed out when letting strings, cables or ropes out, by slacking them. The rope is payed out! You can pull now.

Unfortunately, I was unable to find nautical or rope-related words in your comment.

Beep, boop, I'm a bot

Hey Unreal, yes you can use our API to create your own app/website that does exactly that. You can choose to export the model after it's done finetuning and run inference (creating images) yourself if you'd like, we do also have an option for you to run inference through an API. Shoot me a DM and I can help you get setup

We also support "face_correct" which is just face restoration using GFPGAN/CodeFormers and "super_resolution" which is what's known as upscaling :)

Cheers! Excited to have you try us out

Does your api support the ability to train a style instead of a subject?

thanks for the reply!
I wasnt able to find these in your API-Documentation! Shouldnt that be under inference?

Ah, sorry about that. Our docs are currently a little hard to parse, reworking them soon.

If you go to the inference params, theres fields called facetool and facetool_strength for face correction.

Documenting the upscaling endpoint as we speak :) New docs should be live EOD tomorrow. In the meantime, feel free to hop in the Discord to stay posted on when it's live.

It's currently optimized for tuning on subjects but we're launching finetuning for styles in the coming week since a lot of folks have asked for it. Feel free to hop in the Discord to be notified when we launch it, in any case, I'll circle back here once it's live

Looking forward to it! I’ve been doing style training on the lastBen colab but I have a lot of artists that want a more accessible way to build and use models based on their own styles