Submitted by manuelfraile t3_12327d1 in MachineLearning
BeautifulLazy5257 t1_jdsyfbc wrote
I'd start by going through the Hugging Facd courseware.
You'll learn in the first chapter of their courses that it is just better for people to fine-tune pre-trained models. That's what they are there for.
It costs a lot and produces a lot of energy and heat waste to train a LLM from scratch.
Viewing a single comment thread. View all comments