Submitted by simpleuserhere t3_11usq7o in MachineLearning
Art10001 t1_jcwfyw8 wrote
Reply to comment by baffo32 in [Research] Alpaca 7B language model running on my Pixel 7 by simpleuserhere
I heard MoE is bad. I have no sources sadly.
baffo32 t1_jcxqr2i wrote
i visited cvpr last year and people were saying that moe was what mostly was being used; i haven’t tried these things myself though
Viewing a single comment thread. View all comments