Viewing a single comment thread. View all comments

MrEloi t1_j6i8akg wrote

Just a bad loser.

Move right along - nothing to see here.

2

vivehelpme t1_j6o0mzr wrote

Yann LeCun was programing neural networks before before most of the people who replied in this thread was even born, he made optical character recognition work on hardware that makes your smartfridge looks like a supercomputer. He doesn't say this from a sore loser point of view but to understand where he come from you need to look at what he's actually saying.

He didn't say chatGPT sucks.

He didn't say meta have something better.

He said it's "not particularly innovative". Which is true.

  • Transformers models have been around since 2017.
  • Language models are more numerous than anyone can keep track of.
  • Dialogue oriented fine tuning have been made before.
  • Virtually all names in big tech are training large language models.

Why is chatGPT doing so well then?

  • It's a big model, which is hardly new, but it's accessible and usable for free.
  • openAI have a good media traction, so they make a splash even when they show off closed models.

So when LeCun says it's "not particularly innovative", is he really wrong? Is being a known name and giving out free stuff^((arguably they are datamining the public for additional training data, which makes the free part a little bit less free)) considered innovative?

1

Ashamed-Asparagus-93 t1_j6p3i85 wrote

I understand what you're saying as this was more or less my reaction to what he said but from a devil's advocate perspective it is innovative due to the presentation and availability.

If me you and 50,000 other guys created magic mirrors that make you look younger and you're the only one who releases it to the public then in a way you're the innovative one even if I've been studying magic mirrors for 20 years.

Maybe I'm wrong but the one who can release a product to the masses is the innovative one simply because no one else has been able to do it yet.

2