lolorenz
lolorenz t1_j1cztpc wrote
Reply to comment by Jonno_FTW in [D] When chatGPT stops being free: Run SOTA LLM in cloud by _underlines_
Docker compose is a service that allows to controll multiple docker container and handle their interactions. So docker compose up already is in an ideal world :P
lolorenz t1_j1d1ud1 wrote
Reply to [D] When chatGPT stops being free: Run SOTA LLM in cloud by _underlines_
Have you had a look into the Huggingface libary? As far as I know you can deploy their model directly from their website onto AWS. https://huggingface.co/bigscience/bloomz