kingfung1120

kingfung1120 t1_irmd87k wrote

Reply to comment by DrXaos in Help regularization and dropout are hurting accuracy by perfopt

Hi, I am still quite new to data science, this is the first time I see someone using information theory to measure whether a neural network has suitable amount of parameters.

Do you mind sharing more? Like the reference, or some examples. I would love to know more about this. Thank you!

1

kingfung1120 t1_iripkba wrote

Reply to comment by perfopt in Help regularization and dropout are hurting accuracy by perfopt

I haven’t handled audio data before, but it seems like you are flattening a [1723, 13]shape data into a vector(correct me if I am wrong), which is definitely going to affect the information that the model can learn since the data is sequential and it is in 2-D.

Unfortunately, I haven’t studied/read anything related to audio data deep learning, I couldn’t give you anymore in-depth opinion, but based on my understanding, using a CNN or anything recurrent should improve the model performance better than fine-tuning a MLP.

2