Viewing a single comment thread. View all comments

Magikarpeles t1_j9xtz9x wrote

Stability AI “democratised” stable diffusion by releasing their models and allowing open source platforms to use them. The open source solutions are arguably better than the corpo ones like Dalle-2 now.

OpenAI do release older models of GPT but they are vastly less sophisticated than the current ones. Releasing the current models would “democratise” chatGPT but it would also kill their golden goose.


GreenTeaBD t1_j9ymzr3 wrote

There are models that are open source and near GPT3. The most open are eleutherai's models, though not as big as GPT3 perform very well. You can go run them right now with some very basic python.

The problem is less that we don't have open models, it's that we haven't found good ways to run the models that big on consumer hardware. We do have open models that are about as big as GPT3 (The largest Bloom model) but the minimum requirements in GPUs would set you back about 100,000 us dollars.

Stable Diffusion didn't just democratize image gen AI by releasing SD open source, but by releasing it in a way people with normal gaming computers could use it.

We are maybe almost at this point with language models. Flexgen just came out, and if those improvements continue we might get an SD like moment. But until then it doesn't matter if GPT3 is open or not for the vast majority of people.


Otarih OP t1_ja97gh7 wrote

You got that exactly right. It's sad to see for us this didn't come across in the article. But that was our way of thinking, i.e. FOSS (free and open source software). We will improve in future articles! Thanks for reading!


oramirite t1_j9yjdc2 wrote

This isn't a conversation about better or worse, how "good" they are is centrally the problem. This is an ethics conversation.


Magikarpeles t1_j9yk6wv wrote

The person I replied to asked what democratisation means in this context and I answered.