Viewing a single comment thread. View all comments

SWESWESWEh t1_jdk8rtn wrote

Reply to comment by machineko in [R] Hello Dolly: Democratizing the magic of ChatGPT with open models by austintackaberry

Doing the lords work my friend. Does it work with Apple Silicon Metal shaders? I've trained my own models as both TF and pytorch support it but I've noticed a lot of people use cuda only methods which makes it hard to use open source stuff

17

machineko t1_jdmm43b wrote

Thanks for the comment. Are you looking to run on M2 or smaller edge devices?

3