Viewing a single comment thread. View all comments

zeidrich t1_j3wtmnr wrote

There's two sides to it, the chat bot itself and the research and potential.

As far as the use of a chat bot this is going to be better utilized by Cortana as it stands. But there's no reason search or otherwise can't stand to gain.

The real gem of chatgpt is how popular it is and how much direct engagement it gets. Any machine learning has access to a lot of content that can be scraped from the internet. Its few that have a large audience testing it and asking questions.

2

visarga t1_j41cfzx wrote

I assume they have more/better task demonstrations for the multi-task finetuning phase. But that kind of data would be very easy to generate by calling their APIs. It's also possible to use a LLM to generate this kind of data from scratch, and even to do without RLHF by using Constitutional AI.

1