Submitted by lughnasadh t3_yytfpr in Futurology
Reply to comment by ledow in Meta has withdrawn its Galactica AI, only 3 days after its release, following intense criticism. Meta’s misstep—and its hubris—show once again that Big Tech has a blind spot about the severe limitations of large language models in AI. by lughnasadh
> Intelligence knows enough to not give any answer, that it doesn't know the answer
> able to reason the answer in the absence of all training data
Human intelligence is not able to do this either
Yes we are, it's called intuition, or inherited memory. It's general and abstract, but real.
He's saying that humans do the same thing and give nonsense answers and can't just say they don't understand
That might be social training? I wonder whether the propensity to make up answers rather than admit a lack of knowledge or understanding has any cultural biases?
It is a human trait. We try to make sense of the world using the limited data we have (see religion and astrology). It is easy to see patterns where none exist. Apparently Meta created a pretty good analog for a human 😂. We also are not good judges of truth or fiction as the pandemic has illuminated.
intuition and inherited memory is training data, from all your ancestors that persisted to you through their DNA dictating the basic formation of your brain. just like some animals can walk or eat right after being born. it's not that they haven't had training data, it's just that this training data has been coded in their DNA
Not just coded. Nucleic acid performs computation itself and does not merely contain instructions.
Michael Levin on Lex Friedman’s podcast was incredible FWIW
People make up answers for things they don't fully understand all the time, and certainly aren't able to admit they're wrong when they do it. See the world's various religions for hundreds of examples.
Eh, without first developing language and reason, there is no intuition. That comes with experience. Which is the human equivalent of training data. No human knowledge is a priori. People like to shit on philosophers, but they've been working on this one for centuries.
Humans do have some instinctive knowledge. The instinctive fear of snakes and spiders, sexual attraction, etc, all rely on recognizing sense data without learning anything first.
That is part of our training set for decision making. It comes from instinct and influences our decisions based on the past development of our heredity.
Yet often ignored
It's just heuristics, statistics, and hysterics.
Yeah, clearly displayed by this guys response
You’ve never talked to my dad
Human intelligence can do it. It is called science, democracy, entrepreneurship, which all are collective enterprises and trial-by-error processes.
[deleted]
Viewing a single comment thread. View all comments