Viewing a single comment thread. View all comments

mrcschwering t1_j1easrz wrote on December 23, 2022 at 5:51 PM

I have only deployed a few models (smaller BERT-like) and was able to fit some of them into Lambda function (load from S3).

Otherwise, if we don't care about start-up time, a lambda function that starts a spot instance.