cv4u t1_jakzhqj wrote on March 2, 2023 at 4:14 AM Reply to comment by LetterRip in [D] OpenAI introduces ChatGPT and Whisper APIs (ChatGPT API is 1/10th the cost of GPT-3 API) by minimaxir LLMs can quantize to 8 bit or 4 bit? Permalink Parent 4
cv4u t1_jakzhqj wrote
Reply to comment by LetterRip in [D] OpenAI introduces ChatGPT and Whisper APIs (ChatGPT API is 1/10th the cost of GPT-3 API) by minimaxir
LLMs can quantize to 8 bit or 4 bit?