bacon_boat
bacon_boat t1_jcjt0bi wrote
Reply to [D] GPT-4 is really dumb by [deleted]
I know, that joint probability distribution P(next_word|words) is really *dumb*.
bacon_boat t1_j7fbjcg wrote
I think his view reflects his disappointment as a researcher that it's not novel ideas and algorithms that lead to success. It's scale + engineering.
But anyone with a broader view sees that ChatGPT represents a massive milestone for AI.
Who really cares how novel the algorithms are, openAI built a killer product, and deserve the recognition.
Lecun is maybe also salty because Deepmind / OpenAI are perceived as leaders, and Meta isn't.
bacon_boat t1_j710cpy wrote
Reply to [D] I'm at a crossroads: Bayesian methods VS Reinforcement Learning, which to choose? by fuscarili
My guess is that the successful reinforcement learning methods of the future will be compatible, or enforce Bayes either explicitly or implicitly.
With that in mind, I'd go with Bayes, it's eternally relevant. Whereas the RL field might be completely different in 5 years.
bacon_boat t1_j6n82xv wrote
Reply to comment by pfm11231 in [D] deepmind's ai vision by [deleted]
Am I looking at your comment right now, or is it just some number of voltages over the neurons of my visual cortex?
bacon_boat t1_iygxmve wrote
Reply to comment by eternal-abyss-77 in [D] Is 20 single layer Neural networks equals to a single 20 layer neural network? by eternal-abyss-77
I think you need to check if you have a specific case in mind.
They are obviously not the same in general.
bacon_boat t1_iygvgdf wrote
Reply to [D] Is 20 single layer Neural networks equals to a single 20 layer neural network? by eternal-abyss-77
f(f(f(f(x)))) =/= f(x)+f(x)+f(x)+f(x)
bacon_boat t1_jd26bag wrote
Reply to comment by Joates87 in Student built satellite launched by SpaceX and powered by 48 AA batteries and a $20 microprocessor shows a low-cost way to reduce space junk by DukeOfGeek
Yeah, when I clean my kitchen I'm not "reducing" the amount of waste.
I'm just decreasing the lifetime of the junk in my kitchen.
The consequence that reducing junk lifetime reduces the amount of junk is just incidental and can be ignored.