Viewing a single comment thread. View all comments

Littlegator t1_j8iprqo wrote

Reply to comment by cdtoad in ChatGPT Passed a Major Medical Exam, but Just Barely | Researchers say ChatGPT is the first AI to receive a passing score for the U.S. Medical Licensing Exam, but it's still bad at math. by chrisdh79

The bottom of the class often doesn't pass STEP 1 first go-around. Like 5% to 10% of students fail their first attempt.

However, the STEPs are almost entirely a complex word-association game. Basically a LLM's wet dream. If it was trained on content-specific data, it could probably get 100%.

11