Submitted by _underlines_ t3_zstequ in MachineLearning
BestSentence4868 t1_j1bjak3 wrote
run int8 instead of fp16 gg rip
_underlines_ OP t1_j1c8kvn wrote
DeepSpeed-MII supports Bloom int8 and fp16.
BestSentence4868 t1_j1cackq wrote
is DeepSpeed-MII publically available or only on azure?
_underlines_ OP t1_j1cgoj8 wrote
They have two versions: public and azure.
Viewing a single comment thread. View all comments