manuLearning
manuLearning t1_irie761 wrote
Reply to comment by perfopt in Help regularization and dropout are hurting accuracy by perfopt
I had always good experiences with dropout. Try to put a dropout layer of around 0.75 after your first layer and onedropout layer before your last layer. You can also put a light 0.15 layer before your first layer.
How similar is the test and val set?
manuLearning t1_irij2hl wrote
Reply to comment by perfopt in Help regularization and dropout are hurting accuracy by perfopt
A rule of thumb is to take around 30% as val set