Viewing a single comment thread. View all comments

tmblweeds OP t1_j0hg7su wrote

Reply to comment by trnka in [P] Medical question-answering without hallucinating by tmblweeds

Super helpful! This broadly aligns with other feedback I've gotten, that I should be focusing on guidelines in addition to/instead of clinical research.

2

trnka t1_j0hr6zn wrote

Yeah our doctors spent a lot of time building and revising clinical guidelines for our practice.

I'm not sure what your background is, but some tips from working with them on clinical guidelines:

  • There were some guidelines that were generally-accepted best practices in medicine, but it was more common to have clinic-specific guidelines
  • My team ran into some resistance to the idea of ML-created guidelines. Physicians were more receptive to technology that assisted them in creating guidelines
  • Many guidelines are aspirational, like when to order lab tests. Many patients just won't get the tests, or the test results will come back after the current condition has resolved. Likewise, if you're worried about a patient taking the antibiotic to term, it may be better to use a 1-dose second-line antibiotic rather than a multi-dose first-line antibiotic. In the long term I expect that clinical guidelines will adapt somewhat to patient adherence; they aren't a one-time thing. Plus research changes too.
  • For any evidence, there needs to be vetting of how it's gathered, like whether it's a proper randomized control trial, how the statistics are done, how the study is designed, what population was studied, etc
5

tmblweeds OP t1_j0ieog3 wrote

Ah yeah I wasn't thinking necessarily about creating guidelines with ML—more like highlighting/synthesizing relevant excerpts from existing guidelines (e.g. NICE, American College of Cardiology, etc.). But I didn't know that individual clinics had their own guidelines in addition to the "official" ones).

2

take_eacy t1_j0hh73q wrote

Yes, as an MD, I agree with the points made above

Uptodate is a widely used summary of guidelines (doctors are paid to summarize and synthesize the latest research studies). Widely used is almost an understatement honestly - whke your doctor steps outside or has to look something up, it is one of the top resources (if not like #1 though nobody likes to admit it) since it's such a great aggregator.

4