Viewing a single comment thread. View all comments

Zealousideal-Ice9957 t1_je5vo1c wrote

Reply to comment by EvilMegaDroid in [D] FOMO on the rapid pace of LLMs by 00001746

You better have a look at the OpenAssistant initiative made by Laion, their Human assisted data collection process is said to be of very good quality compared to the underpaid croworder-based one used by OpenAI

2

EvilMegaDroid t1_je6s99k wrote

Good idea, I'm kinda skeptical if enough users would complete tasks for it to get enough data.

Not impossible though, there are huge open source projects so who knows.

2

Zealousideal-Ice9957 t1_jebdm73 wrote

They just completed the data collection a few days ago, and they claim prompts of really high quality due to strict filtering algorithm and the propension of the community to create a better open source alternative to OAI.

1

EvilMegaDroid t1_jec89t6 wrote

That would be insane (I mean as noted, was not impossible given that people have come together to improve things such as big open source projets like linux, mpv etc).

I checked it out for a while but got confused, is everyone supposed to access the data because i could not.

1