Viewing a single comment thread. View all comments

asdfzzz2 t1_ixm6knh wrote

Reply to comment by Oceanboi in [D] Transfer Learning of Image Trained Network in Audio Domain by Oceanboi

Is there any reason for them to be worse than random weights? Because if not, then you have no reason not to use pretrained models.

3

hadaev t1_ixmajnt wrote

To add to it, non random weight might be worse for tiny/simple models.

But modern vision models should be fine with it.

Like bert text weights is a good starting point for images classification.

2