WarProfessional3278 t1_je1giqi wrote on March 28, 2023 at 6:50 PM

Bad demo imo. The mom's Chinese is worse than English->Chinese google translate.

Plus, there are way too many tools out there that does real time speech to speech translation better than GPT.

BlackstockTy476 OP t1_je1p5th wrote on March 28, 2023 at 7:44 PM

I believe this was proven wrong at least with GPT-4. It was shown to do translations better than Google and DeepL, but I agree with the demo i believe they're using an older version of GPT

WarProfessional3278 t1_je1w1xo wrote on March 28, 2023 at 8:26 PM

>It was shown to do translations better than Google and DeepL

Oh really? Do you know a good benchmark for that?

MysteryInc152 t1_je2qmez wrote on March 28, 2023 at 11:55 PM

not gpt-4 but i made some comparisons awhile back. Even before gpt-4, bilingual llms were way ahead of the game.

https://github.com/ogkalu2/Human-parity-on-machine-translations

-ZeroRelevance- t1_je3zdfa wrote on March 29, 2023 at 6:35 AM

imo it’s blatantly obvious with even just a few tests that GPT-4 is miles ahead of them, especially when translating large volumes of text. Even GPT-3.5 is comparable to them, likely better, although it’s definitely a closer comparison.

Otherwise-Ad5053 t1_je2jezd wrote on March 28, 2023 at 11:03 PM

👍 congrats on your hard work