Viewing a single comment thread. View all comments

tsgiannis OP t1_j4vvxt3 wrote

Reply to comment by jsxgd in Why a pretrained model returns better accuracy than the implementation from scratch by tsgiannis

from scratch I mean I take the implementation of a model (just pick any) from articles and github pages, I copy paste it and I feed my data.

There is always a big accuracy difference no matter what...at first I thought it was my mistake because I always tinker what I copy but....

1

DrXaos t1_j4w9vav wrote

The data size of the pre trained model was likely enormously larger than yours and that overcomes the distribution shift.

1