GeoLyinX t1_j404nv8 wrote on January 12, 2023 at 6:24 AM

Reply to comment by --algo in [D] Microsoft ChatGPT investment isn't about Bing but about Cortana by fintechSGNYC

No they are not, they are 2 different api’s and even 2 distinct AI models. It’s not just a different api that uses the same AI differently, it’s an entirely different model together with different output layer parameters and likely the input layers as well, just both models based originally based off GPT3 for their hidden layers mostly.

--algo t1_j40j84w wrote on January 12, 2023 at 9:28 AM

We are both right and wrong. To be pedantic, it's this paper for both https://arxiv.org/abs/2203.02155 but with different training data

Hyper1on t1_j43crwx wrote on January 12, 2023 at 9:58 PM

That's the InstructGPT paper, which is right for ChatGPT, but Copilot is based on Codex, which does not use RLHF.

--algo t1_j43rpre wrote on January 12, 2023 at 11:33 PM

Are you sure? This implies otherwise: https://openai.com/blog/instruction-following/

But maybe it's only for the non-codex models

Hyper1on t1_j43wyf3 wrote on January 13, 2023 at 12:09 AM

You can see the full details here: https://beta.openai.com/docs/model-index-for-researchers

Copilot itself is the 12B Codex model, with further refinements.