Viewing a single comment thread. View all comments

tyras_ t1_j9e9kp0 wrote

Reply to comment by nikola-b in [D] Large Language Models feasible to run on 32GB RAM / 8 GB VRAM / 24GB VRAM by head_robotics

Free for now or free for an hour as the pricing tab indicates?

3

nikola-b t1_j9hk5q4 wrote

Free for now, we have not added the payment workflow. In the future, you are billed only for the inference time, so with 1h you should be able to generate lots of tokens. Also I added EleutherAI/gpt-neo-2.7B and EleutherAI/gpt-j-6B if the op wants to try them.

3

tyras_ t1_j9pjkcx wrote

I finally got some time and was excited to try out. I did not see many LLMs pretrained on biomedical data available anywhere.

Anyway, while I could log in without a problem both CURL and deepctl return 401. Now I wonder whether it was cut off or did I miss some extra registration or authorization step that was not mentioned in the docs.

2

nikola-b t1_j9ujdux wrote

There was auth bug in the code. Sorry for that. Please try again now.

1