I wrote find a masters thesis from a notable deep learning person because they will have laid out the related work since the “beginning of time“, and it will be organized and each sub group will be related

Thank you!!!

Can you link to an example online or from a book? I need to understand this!!!

That makes sense. Convolutional neural networks were just deep learning with convolution.

That’s a pretty big hope that all data can be modeled linearly

Oh wow I never considered if I should see them as different. Transformers are a pretty big conceptual change, but they’re used in a deep way. 🤔 food for thought

What you’re looking for is embeddings. Take an auto encoder and produce an embedding (latent code) for every image in your database. When you need to query for an image, produce an embedding for that image and use a nearest neighbors algorithm to find the most similar images.

That’s not an easy question to answer because the 90% that are correct may be super easy to fit, and those 10% errors may just be unfittable and will just keep the loss high without impacting the model. On the other hand, since models tend to be very over-parameterized that 10% could very well be “fit” and have an outsized impact on the model. It could also be the case that the model ends up with 10% variance on its accuracy.

I’ve never seen a definitive theoretical answer since deep learning models are over parameterized and have seen models replicate the error in the training data, especially when it came to keypoint prediction. When I assessed the error in the training data, I showed the team that the model has the same degree of error. I was arguing for cleaner training data. I got told no and to come up with a magic solution to fix the problem. I quit 🤣

Are you asking if it can outperform a single human or a collective of humans?

Can a machine learning model determine the make and model of a Toyota better than I can? Yes. Is there a human on the planet that can better determine the male and model? Yes.

😂 yes exactly

Bingo

🤣

Omg I do this too and it works!!! The world is more vibrant, and my phone has become purely functional

My first thought would be curriculum learning.

I bought that book during my masters and I couldn’t figure out what Bishop was saying. It’s years later and my math is way better so I’ll give it another shot. Thank you!

Do you have a recommended read?

It depends what you mean by better. Is a car better than a person at driving? They’re safer on average, but you need pretty advanced AI to be able to navigate the long-tail of potential situations. A human can navigate a large majority of the long tail.