Submitted by Dense-Smf-6032 t3_10lk0bp in MachineLearning
[removed]
Comments
KingsmanVince t1_j5xicem wrote
nins_ t1_j5xjw35 wrote
Do you mean self-supervised learning for CNNs? SimCLR does work on CNNs. Also check out SOCO, SCRL, BYOL - there's a lot.
KingsmanVince t1_j5xk2e3 wrote
w2ex t1_j5xo3bp wrote
There are of course pre-trained models for CNN (most of the time it is pre-trained on ImageNet in a supervised manner). If you talk about self-supervised pre-training for CNN specifically have a look at the recent papers Convnext 2 or SparK (BERT-style pretraining for convnets).
Meddhouib10 t1_j5y2ete wrote
There are : check the ConvNext V2 paper
Daango_ t1_j5xewol wrote
Do you mean mean something like this
https://pytorch.org/vision/stable/models.html
?