bmunday131 t1_j9vc362 wrote on February 24, 2023 at 8:41 PM Reply to [P] What are the latest "out of the box solutions" for deploying the very large LLMs as API endpoints? by johnhopiler A Chassis + Modzy solution could get these models up and running as endpoints in a couple days max. Here are some docs links and if at all interested, feel free to message me separately. Happy to discuss in more detail. https://chassis.ml/ https://docs.modzy.com/docs/hugging-face Permalink 2
bmunday131 t1_j9vc362 wrote
Reply to [P] What are the latest "out of the box solutions" for deploying the very large LLMs as API endpoints? by johnhopiler
A Chassis + Modzy solution could get these models up and running as endpoints in a couple days max.
Here are some docs links and if at all interested, feel free to message me separately. Happy to discuss in more detail.
https://chassis.ml/
https://docs.modzy.com/docs/hugging-face