axamar463 t1_itk6p6d wrote on October 24, 2022 at 6:42 AM Reply to [D] Most efficient open source language model ? by Meddhouib10 You should look into deepsparse, they are working on delivering GPU level performance on consumer CPUs with some great results: https://github.com/neuralmagic/deepsparse. There is a great interview with the founder, Nir Shavit here: https://piped.kavin.rocks/watch?v=0PAiQ1jTN5k Permalink 6
axamar463 t1_itk6p6d wrote
Reply to [D] Most efficient open source language model ? by Meddhouib10
You should look into deepsparse, they are working on delivering GPU level performance on consumer CPUs with some great results: https://github.com/neuralmagic/deepsparse. There is a great interview with the founder, Nir Shavit here: https://piped.kavin.rocks/watch?v=0PAiQ1jTN5k