Viewing a single comment thread. View all comments

tsgiannis OP t1_j4uukd9 wrote

Reply to comment by XecutionStyle in Why a pretrained model returns better accuracy than the implementation from scratch by tsgiannis

What exactly do you mean ...by "fixing weights" ?

The pretrained carries the weights from ImageNet and that's all .. if I unfreeze some layers it will get some more accuracy

But the "from scratch" starts empty.

1

XecutionStyle t1_j4v0dui wrote

When you replace the top layer and train the model, are the previous layers allowed to change?

3

tsgiannis OP t1_j4v447x wrote

No changes on the pretrained model besides removing the top layer.

I am aware that unfreezing can cause either good or bad results

1