Viewing a single comment thread. View all comments

singularpanda OP t1_j3elwu4 wrote

Seems recently, not too much paper are doing on them. Don't look at details. Maybe models like OPT is still too large?

1

f_max t1_j3frqfb wrote

They have a sequence of models ranging from 6B params up to 175B largest, so you can work on smaller variants if you don’t have gpus. There’s def some papers working on inference efficiency and benchmarking their failure modes if you look around.

1

Think_Olive_1000 t1_j3tnkld wrote

Dude that's why you ought to put everything into NLP find a way of producing better results for cheaper on less expensive hardware and you'll be the talk of the town. I think everyone would love to have an unrestricted local version of chatgpt on their phones. Do the research!

1