Comments

You must log in or register to comment.

Scarlet_pot2 t1_j5xl0or wrote

could someone educated start an AI company and do something similar at a smaller scale? I would love to run a company that makes open source and paid models.. like stabilityAI.

2

genshiryoku t1_j5y03ci wrote

Problem is that AI benefits from economy of scale and there's an exponential increase in performance with bigger models.

What this means is that it's a "winner-takes-all" situation and you can't compete as a smaller entity without huge capital injection to generate the compute necessary to train large models.

The only alternative I can think of is a distributed computer like Seti@home where people volunteer their GPUs to collectively train large open source AI models.

As cryptocurrency mining has shown us, most people won't do that on volunteer basis so there'd need to be some sort of financial incentive but I wouldn't want to mix a neutral AI open source model with perverse financial incentives like crypto.

So essentially that is not going to happen and even StabilityAI is eventually going to have to incorporate like OpenAI to continue on their path, sadly enough.

8

luisbrudna t1_j60epie wrote

Maybe.. If you manage to get hundreds of billions of content from Internet. This kind of system needs HUGE training data.

1

Scarlet_pot2 t1_j66jo0e wrote

they have open source datasets like LAION-5B, the Common Crawl, the Pile etc.. the main thing is getting a model trained on it. I guess I would need to design the transformer architecture, train the model, then use that as a proof-of-concept to get investors interested.

Or build an app around Stable-Diffusion, post it on app store, make some money, and use that to get investors interested. Probably do this then with the investments and some hired help do what i said in the first paragraph

1

iNstein t1_j5xggcb wrote

I was under the impression that up until now, they onky got 1 billion from Microsoft so why the plural? When an article ignores facts then it really is not worth reading.

1

throwawaydthrowawayd t1_j5xxv3u wrote

As the article says, Microsoft just gave them $10 billion.

5

TheAnonFeels t1_j5z57vq wrote

The headline though, if you only read that, it seems they built the current system with billions.

4

iNstein t1_j61vb8s wrote

Exactly, they have already built it, the billions are still to come.

1

Superschlenz t1_j61mwr2 wrote

>Microsoft will be entitled to 75% of OpenAI’s profits until it earns back the $13 billion it has invested—a figure that includes an earlier $2 billion investment in OpenAI that had not been previously disclosed until Fortune reported it in January.

2

iNstein t1_j61vkhz wrote

If that is in fact true then fine, however I would need more than some journalist claim, some actual evidence. If you know of anything official, I would really appreciate the link. Cheers

2