Viewing a single comment thread. View all comments

dumbmachines t1_j0ztjdq wrote

Have you tried something like this?

You're not able to overfit on the hard examples alone? Why not?

20

Dartagnjan OP t1_j103ef6 wrote

  1. I have already tried my own version of selective backprob, but thanks for the link. this is exactly what I was looking for. I want to know how other people implement it and if I did something wrong.
  2. Overfitting on the hard examples is a test that I carried out already multiple times but not yet on the latest experiments. Thanks for reminding me of this. I guess from this I can infer whether my complexity is definitely too low, if I cannot overfit. If I can overfit. If I can overfit on the hard examples it does not mean the model is able to handle easy and hard examples at the same time, still.
15