Viewing a single comment thread. View all comments

SirReal14 t1_j1axbn1 wrote on December 22, 2022 at 11:20 PM

Another option is to work with/contribute to a distributed implementation of large language models. The Petals project is running BLOOM over a decentralized network of small workers (min 8GB VRAM requirement)

Soc13In t1_j1bdyxw wrote on December 23, 2022 at 1:27 AM

Can Radeon cards work or is it Nvidia only?

kkchangisin t1_j1bjz3f wrote on December 23, 2022 at 2:13 AM

CUDA only

Soc13In t1_j1byszb wrote on December 23, 2022 at 4:13 AM

expected as much. thanks for the info though.

SirReal14 t1_j1ben2b wrote on December 23, 2022 at 1:32 AM

Not sure, give it a try and find out!

[deleted] t1_j1dp0ph wrote on December 23, 2022 at 3:23 PM

[removed]