Viewing a single comment thread. View all comments

rjromero t1_ivch6er wrote

How did InstructGPT completely go under the radar?

I remember trying GPT3 a while ago and being unimpressed. The results were mostly illogical copypasta. I couldn't believe the hype that preceded it in the media.

That is... Until I tried it again very recently, post InstructGPT. The text generation itself, prompting aside, has improved greatly. Prompting feels unreal, especially some of the Q/A and command extraction tasks. It takes a few shots to perform what would otherwise take mountains of data to train with traditional NLP approaches.

GPT3 is now InstructGPT by default, as of Jan of this year. But why wasn't there more hype around InstructGPT? I feel it warrants a rename or at least a major version bump of GPT.

1

CremeEmotional6561 t1_ivck8kj wrote

>why wasn't there more hype around InstructGPT?

Because people are expecting gradual improvements "two more papers down the line". In order to generate hype one must create the unexpected.

1