Viewing a single comment thread. View all comments

_underlines_ OP t1_j1c8kvn wrote on December 23, 2022 at 5:46 AM

Reply to comment by BestSentence4868 in [D] When chatGPT stops being free: Run SOTA LLM in cloud by _underlines_

DeepSpeed-MII supports Bloom int8 and fp16.

BestSentence4868 t1_j1cackq wrote on December 23, 2022 at 6:05 AM

is DeepSpeed-MII publically available or only on azure?

_underlines_ OP t1_j1cgoj8 wrote on December 23, 2022 at 7:18 AM

They have two versions: public and azure.