redditnit21
redditnit21 OP t1_isnc1yx wrote
Reply to comment by First_Bullfrog_4861 in Testing Accuracy higher than Training Accuracy by redditnit21
There is no data augmentation suing. Should I use data augmentation?
redditnit21 OP t1_isn465e wrote
Reply to comment by DrXaos in Testing Accuracy higher than Training Accuracy by redditnit21
>Views
Yeah I am using conventional softmax + CE loss function which is the most common for multinomial outcomes. Which regularization method would you suggest me to use and what's the main reason why test acc should be less than train acc?
redditnit21 OP t1_isn2qbq wrote
Reply to comment by DeskFan9 in Testing Accuracy higher than Training Accuracy by redditnit21
There are 9 Classes in the dataset labelled as 1 - 9. These are 7916 images in training and 1979 images in testing. All the classes are equally proportioned except 1 class which has more images.
​
Training accuracy is around 96% and testing is around 98%.
redditnit21 OP t1_isn2joq wrote
Reply to comment by DrXaos in Testing Accuracy higher than Training Accuracy by redditnit21
I am using a stratified test/train split. "train_df, test_df = model_selection.train_test_split(
df, test_size=0.2, random_state=42, stratify=df['Class']
)"
All the classes are equally proportioned except 1 class. I am using dropout layer in the model for training. Is the dropout layer creating this issue?
redditnit21 OP t1_isn2ap3 wrote
Reply to comment by pornthrowaway42069l in Testing Accuracy higher than Training Accuracy by redditnit21
I am using this split "train_df, test_df = model_selection.train_test_split(
df, test_size=0.2, random_state=42, stratify=df['Class']
)"
redditnit21 OP t1_isn27zi wrote
Reply to comment by danielgafni in Testing Accuracy higher than Training Accuracy by redditnit21
Yeah, I am using dropout layer in the model to avoid overfitting. So am I supposed to remove the dropout layer?
Submitted by redditnit21 t3_y5qn9h in deeplearning
redditnit21 OP t1_irn75ut wrote
Reply to comment by Street_Excitement_14 in [D] CSV File to training and testing split by redditnit21
Thanks a lot man! I am really sorry for asking to write code.
redditnit21 OP t1_irn6vek wrote
Reply to comment by Zealousideal_Low1287 in [D] CSV File to training and testing split by redditnit21
And I searched on the internet to split the csv file according to image paths but I only found 1 method of splitting it into different folders. Didn’t found any solution based on pandas.
Nice try!
redditnit21 OP t1_irn5gnk wrote
Reply to comment by Zealousideal_Low1287 in [D] CSV File to training and testing split by redditnit21
I saw your some previous post asking for datasets and some basic advice? Why are you asking for such basic questions? You could have just searched it on the internet.
redditnit21 OP t1_irn55fi wrote
Reply to comment by Zealousideal_Low1287 in [D] CSV File to training and testing split by redditnit21
I am not asking people to do my task. I was just asking them to tell me the command for which I am sorry I already told you. You should be ashamed for behaving horribly instead of giving constructive criticism. Shame on you.
redditnit21 OP t1_irmxu3q wrote
Reply to comment by Zealousideal_Low1287 in [D] CSV File to training and testing split by redditnit21
Sorry, if I am way too lazy for you. Just an advice, Please be kind for the world. You could have just given me an advice instead of just being harsh on me. Be kind and humble!
redditnit21 OP t1_irmwspv wrote
Reply to comment by Street_Excitement_14 in [D] CSV File to training and testing split by redditnit21
Just a last question, do you know any good resource to learn the basics for Pandas?
redditnit21 OP t1_irmvsly wrote
Reply to comment by Street_Excitement_14 in [D] CSV File to training and testing split by redditnit21
Thanks for such a good answer and I will keep in mind all you said and start learning basics. I don’t know why other guys are just straight up criticising me. What I did I split the images into 2 folders train and test and then further classified into folders (Class 1 and Class 2). Then I am thinking of using train data generator for training.
redditnit21 OP t1_irmtltz wrote
Reply to comment by Zealousideal_Low1287 in [D] CSV File to training and testing split by redditnit21
What happened? What’s your problem? Am I not allowed to ask any question?
redditnit21 OP t1_irmnk5i wrote
Reply to comment by eingrid2 in [D] CSV File to training and testing split by redditnit21
But the images are present in some other folder. Can you send me the code for that?
redditnit21 OP t1_irmniga wrote
Reply to comment by in-your-own-words in [D] CSV File to training and testing split by redditnit21
Can you write the code for that?
Submitted by redditnit21 t3_xzkmlr in MachineLearning
redditnit21 OP t1_isoa0lc wrote
Reply to comment by BrotherAmazing in Testing Accuracy higher than Training Accuracy by redditnit21
I commented from the different account by mistake. After looking at everyone’s comment. I tried without dropout and the same thing is happening. I am not using any data augmentation except the rescaling (1/.255).