Viewing a single comment thread. View all comments

FluffyVista t1_j9ottk1 wrote

Reply to comment by Seankala in [D] 14.5M-15M is the smallest number of parameters I could find for current pretrained language models. Are there any that are smaller? by Seankala

probably

1

Yahentamitsi t1_j9xi4q4 wrote

That's a good question! I'm not sure if there are any pretrained language models with fewer parameters, but you could always try training your own model from scratch and see how small you can get it.

1