DALL-E was disrupted by Stable Diffusion, can OpenAssistant disrupt ChatGPT in your opinion?

I think it will depend on how small the LLMs that it uses are. If they can be run on consumer GPUs, then it will probably take off. If you need to rent 8xGPU servers just for inference, probably not.

Stablediffusion took off because in the first two weeks you could run it on 4GB VRAM GPUs. Then when "finetuning" aka dreambooth came along, it went from 24 to 16 to 8 GB in a matter of weeks. Same effect there.

I am confused. Does a model already exist or is it only in a data collection stage?

It's in the data collection stage. It's being run by LAION.

The plan is to make it kinda good and train in (on industrial hardware) and then distill it down to a smaller model that ideally can fit in a consumer GPU. It's going to be big at first but they do want to make it small eventually.

Do you know if distilling will be possible after instruct finetuning and the RLHF steps? I know it works on "vanilla" models, but I haven't searched anything regarding distillation of instruct trained models.

Sorry, I just casually watch Yannic Kilcher's YT videos, so I don't know much else.

Excited for the future of dynamic intelligent systems, Ones that can influence, retrieve and alter the state of the web using the same tools we do. What a world we are living, soon most of the operations done over the web will be ai based.