Viewing a single comment thread. View all comments

EnjoyableGamer t1_jcbe3b3 wrote

There is not much to release from OpenAI, just big model with big data on existing methods. Google Deepmind did go that route of secrecy with AlphaGo, if anything the easy access for anyone to try is cool and new.

In the long run it's their mistake, as research never stops. It won't build on GTP4 but other alternatives that I'm sure will come in the next months.

−2

Nhabls t1_jcbm504 wrote

> Google Deepmind did go that route of secrecy with AlphaGo

AlphaGo had a proper paper released, what are you talking about?

This action by OpenAI to completely refuse to share their procedure for training GPT-4 very much breaks precedent and is horrible for the field as a whole. It shouldn't be glossed over

14

VelveteenAmbush t1_jcbv0rs wrote

GPT-4 is an actual commercial product though. AlphaGo was just a research project. No sane company is going to treat the proprietary technological innovations at the core of their commercial strategy as an intellectual commons. It's like asking them to give away the keys to the kingdom.

−2

Nhabls t1_jcc30fs wrote

The original transformers (ie the foundational model architecture all GPTs are based on) were also commercial products (they're used for search, summarization, translation,etc) we got them and the paper all the same.

5

VelveteenAmbush t1_jcc4mvf wrote

Transformers aren't products, they're technology. Search, Maps, Ads, Translation, etc. -- those were the products. Those products had their own business models and competitive moats that had nothing to do with the technical details of the transformer.

Whereas GPT-4 is the product. Access to it is what OpenAI is selling, and its proprietary technology is the only thing that prevents others from commoditizing it. They'd be crazy to open up those secrets.

−4

Nhabls t1_jccgj1w wrote

This a very silly semantic game that i have no interest in engaging with

1

VelveteenAmbush t1_jccizz1 wrote

It has nothing to do with semantics, it's basic corporate strategy.

−2

ComprehensiveBoss815 t1_jcbpi7w wrote

I read the paper on AlphaGo and I felt it had a enough technical detail for me to reproduce.

2

geeky_username t1_jcbh0mf wrote

OpenAI still has custom training methods, and whatever other tweaks they've made to the model

1