Interesting. Is it feasible to fine tune the mode with selected literature on a single machine / GPU? I'd love to have an AI assistant when going through papers / lit review.

It’s already here ( using gpt3) www.explainpaper.com, you upload a pdf of the paper and highlight on the paper that you want explained and it will do so in non - technical language, you can even ask questions about the paper. Of course it’s not perfect but it’s a good step in the right direction, use your judgment when reading the AI/GPT3 generated explanations.

[removed]

I tried out the demo on their website. I think the idea sounds very promising, but its performance was pretty lacking. It does talk about the topic you provide and the format looks appropriate, but there are elementary factual and logical errors in the examples that I tried.

It seems to get a little funky depending on the prompt.

https://galactica.org/?max_new_tokens=400&prompt=Electromagnetism+

Also it includes what looks like image captions that could have been stripped prior to training

> "The electromagnetic spectrum, showing the major categories of electromagnetic radiation."

Edit: I can also see what it means by "hallucinate text" (using a topic I'm very familiar with)

https://galactica.org/?prompt=rigging+in+autodesk+maya&max_new_tokens=400

you can certainly set limits and the rest but most of these don't have a dedicated button, or if there is a button it's burred inside multiple menus that you need to be guided too.

But I'm still amazed at just how good this is on a topic that is not strictly 'scientific'

Edit 2: ok I'm going to stop playing with this now because the temptation to shitpost is becoming too damn high.

https://galactica.org/?prompt=the+correct+way+to+bake+bread+&max_new_tokens=400

Nice

[deleted]

Well it is new! Might just need a couple of updates!

Likely not. Solving some of these problems might turn out to be equivalent to creating an AGI.

Galactica might still be great for purely summarizing and reviewing purposes and thus, would still help accelerate scientific progress

Interesting!

https://www.vice.com/en/article/3adyw9/facebook-pulls-its-new-ai-for-science-because-its-broken-and-terrible

Yep, real success here.

Definitely not what he asked

you are likely correct but i was just giving them something that might making reading papers a little easier, thank you for your input. If you know of something that is even better to use that is publicily available currently ( I know some more effective intergrations will be coming on board over the next few months) i would love to know about it. Thanks in advance.