Comments
chrisdh79 OP t1_iwutj00 wrote
From the article: Facebook parent company Meta has pulled the public demo for its “scientific knowledge” AI model after academics showed it was generating fake and misleading information while filtering out entire categories of research.
Released earlier this week, the company described Galactica as an AI language model that “can store, combine and reason about scientific knowledge”—summarizing research papers, solving equations, and doing a range of other useful sciencey tasks. But scientists and academics quickly discovered that the AI system’s summaries were generating a shocking amount of misinformation, including citing real authors for research papers that don’t exist.
“In all cases, it was wrong or biased but sounded right and authoritative,” Michael Black, the director of the Max Planck Institute for Intelligent Systems, wrote in a thread on Twitter after using the tool. “I think it's dangerous.”
All-I-Do-Is-Fap t1_iwv59jw wrote
>“In all cases, it was wrong or biased but sounded right and authoritative,”
Reminds me of some politicians
Youvebeeneloned t1_iwvpi7c wrote
Why ANYONE would think Facebook/META would be the company to do something like this properly vs non-profit science and research groups whose entire job it is to do this PROPERLY.
The sheer arrogance of the Tech Bros on full display thinking they read the cliff notes of Stephen Hawking's History of Time and they know enough to create something like this
russdb t1_iwvqorw wrote
Well if anything there is value to be extracted here in how not to do it. That can be almost as important as doing it right. I would argue in fact we are too scared to fail or validate, which has helped lead to a massive replication problem in science.
throwaway836282672 t1_iwxpve1 wrote
>The sheer arrogance of the Tech Bros on full display
Arrogance, ignorance, or blind optimism?
AzulMage2020 t1_iwuz0pq wrote
How many broken , unneeded and unwanted "products" are they going to come up with? Billions spent on ether that could have been used to develop solutions to existing problems rather than trying to create the next futile enterprise revolution to maximize profits and control.
[deleted] t1_iwvss0f wrote
[deleted]
russdb t1_iwvq5hc wrote
It's a real problem they are trying to solve, imo. Whether Facebook should solve that problem is another question altogether, but it's not like this unheard of either. IBM paid the guy who came up with relational algebra, and the structured query language on top of that, which benefitted the entire world greatly to this day and well into the future.
[deleted] t1_iwy8w4n wrote
[deleted]
Impossible-Long1100 t1_iwv7y9f wrote
“In all cases, it was wrong or biased but sounded right and authoritative”
Sounds like Facebook to me.
Chef_BoyarTom t1_iwuwza4 wrote
Sounds like someone trained this thing by making it watch Trump speeches and read Q-anon conspiracies.
netsurfer3141 t1_iwvxjg1 wrote
I don’t understand how it generated abstracts where the underlying article didn’t actually exist?
[deleted] t1_ix17kx8 wrote
[removed]
WillBottomForBanana t1_iww4v3l wrote
I have serious doubts about technology like this from a tech group that one could reasonably expect o manage it. Meta as the source is just a joke set up.
Alan_Smithee_ t1_iww9om3 wrote
It’s going to be a race to see if Facebook implodes before Twitter.
FlashbackUniverse t1_iwuum6r wrote
We don't need Facebook creating fake research.
My MAGA brainwashed Uncle already does that.