mrcschwering t1_j1easrz wrote on December 23, 2022 at 5:51 PM Reply to comment by gettheflyoffmycock in [D] When chatGPT stops being free: Run SOTA LLM in cloud by _underlines_ I have only deployed a few models (smaller BERT-like) and was able to fit some of them into Lambda function (load from S3). Otherwise, if we don't care about start-up time, a lambda function that starts a spot instance. Permalink Parent 1
mrcschwering t1_j1easrz wrote
Reply to comment by gettheflyoffmycock in [D] When chatGPT stops being free: Run SOTA LLM in cloud by _underlines_
I have only deployed a few models (smaller BERT-like) and was able to fit some of them into Lambda function (load from S3).
Otherwise, if we don't care about start-up time, a lambda function that starts a spot instance.