Viewing a single comment thread. View all comments

[deleted] t1_ivqj8wu wrote

[deleted]

21

mooslar t1_ivrc6tl wrote

Sure hope it doesn’t have worse performance!

14

theferalturtle t1_ivt0xip wrote

My wife has Ankolysing spondylitis and I'd love to be able to check out all the research and maybe even have it summarized for the layman without having to spend hours just finding an article or paper I haven't read already.

5

visarga t1_ivt8r4i wrote

More recently GPT-3 can load 4000 tokens in the context. If you have a dataset of texts you can make a search engine that will put the top results in the context. Then GPT-3 can reference that and answer as if it was up to date.

Using this trick a 25x smaller model could have similar results with a big model, they had 1 trillion tokens of text in the reference.

3