This speculative review of potential medical applications of LLMs completely ignores two of the largest risks - model hallucinations and premature clinical deployment by credulous hospital administrators of unverified and unverifiable systems trained on proprietary datasets by unscrupulous vendors. https://www.nature.com/articles/s41586-023-05881-4
@twitskeptic
It is frankly terrifying how many people are jumping on the LLM bandwagon, without doing any testing or validation to speak of, even in fields like medicine or law or education, where stuff MATTERS.
"Hey, it can say something that sounds plausible; it must be all-knowing!!"
@twitskeptic
That'll certainly fix all the problems! :D
Even more troubling is the fact that Eric Topol, one of the corresponding authors on the paper, didn't declare any competing interests for the paper when he's a scientific advisor for a AI based precision medicine company.