Viewing a single comment thread. View all comments

BayesMind t1_jd8ps8g wrote

Is there an example script somewhere for how to run this? All I've seen is the heavy inference server example in the repo.

1

pixiegirl417 OP t1_jd8s4nc wrote

I haven't tried to run it locally since I don't have the hardware requirements, and haven't tried to find a way to do it.

However you can check my GitHub if you want to try the server attached inference API (I know it may not be what you're looking for).

1