Viewing a single comment thread. View all comments

uspmm2 t1_jd1jh1b wrote

Reply to comment by Straight-Comb-6956 in [Project] Alpaca-30B: Facebook's 30b parameter LLaMa fine-tuned on the Alpaca dataset by imgonnarelph

are you talking about the 30b one?

1

Straight-Comb-6956 t1_jd1srkd wrote

Haven't tried the 30B model. 65B takes 900ms/token on my machine.

3

msgs t1_jd46yf9 wrote

do you have a link to a torrent/download for the 30B or 65B weights that works with Alpaca.cpp? reddit DMs are fine if don't want to post it publicly.

1