Viewing a single comment thread. View all comments

nikola-b t1_j9cqkys wrote

Not sure if this helps, but you can use our hosted flan-t5 model at deepinfra.com using HTTP API. It's free for now. Disclaimer I work at deepinfra. If you want GPT-Neo or GPT-J I can deploy those also.

3

tyras_ t1_j9e9kp0 wrote

Free for now or free for an hour as the pricing tab indicates?

3

nikola-b t1_j9hk5q4 wrote

Free for now, we have not added the payment workflow. In the future, you are billed only for the inference time, so with 1h you should be able to generate lots of tokens. Also I added EleutherAI/gpt-neo-2.7B and EleutherAI/gpt-j-6B if the op wants to try them.

3

tyras_ t1_j9pjkcx wrote

I finally got some time and was excited to try out. I did not see many LLMs pretrained on biomedical data available anywhere.

Anyway, while I could log in without a problem both CURL and deepctl return 401. Now I wonder whether it was cut off or did I miss some extra registration or authorization step that was not mentioned in the docs.

2

nikola-b t1_j9ujdux wrote

There was auth bug in the code. Sorry for that. Please try again now.

1