The Journey of a Tech-Savvy Doctor Who Won’t Let Chat GPT Make His Bed (Yet)
By Dr. Nick van Terheyden aka Dr. Nick
Twitter: @drnic1
Host of Dr. Nick: The Incrementalist – #TheIncrementalist
On this episode I talked to Justin Norden, MD (@JustinNordenMD), Partner at GSR Ventures (@GSRVentures) who is a digital health investor and educator at Stanford Medicine. Like so many of my guests, Justin’s career start was different and interesting leading him down a path of medicine blended with technology and business and included a Master’s in Computer Science and Computational Biology.
Episode NOW on Demand
ChatGPT Just Passed the Medical Exam to Become a Doctor
With an extensive background in AI and technology and watching the excitement around ChatGPT Justin noticed that the latest release failed to include testing this new Large Language Model on the exams for doctors, so he fed ChatGPT4 a final medical exam. In the announcement from Open.Ai for the release of the GPT4 model they had several exam results but medical exams were not among them.
What were the results you ask – well you will need to listen to the podcast to hear but let’s just say they were not disappointing. For context, the previous model GPT3.5 (ChatGPT Release Model) performed at 57% correct which corresponds to a 3rd percentile, near the passing threshold, or a score of ~209.
As you will hear Justin will be teaching a course at Stanford University (MED 216: Generative AI and Medicine) which was filled in under 3 minutes which speaks to the popularity of the topic and area.
Things are changing fast and the power of these models is undeniable. Medical knowledge and interpretation historically was the province of experienced clinicians after years of training. We are watching as access to medical knowledge and interpretation is getting democratized in front of us. Those of us in medicine need to think and react thoughtfully as these models start to interact with patients and providers in the real world.
Listen in to hear our discussion on the hype and excitement tempered with some keen insights on what all this can and will mean for medicine now and in the future.
This article was originally published on the Dr. Nick – The Incrementalist blog and is republished here with permission.
About the Show
For years Dr. Nick van Terheyden aka Dr. Nick, has served as a voice on the impact of new technologies on healthcare, earning a reputation as a leading authority on where the future of medicine is going. Combining powers of observation and real world experience, Dr. Nick has seen many predictions come true and makes the case that innovations in healthcare can be accomplished incrementally, not just by moonshot events. Tune in to hear Dr. Nick: The Incrementalist and his guests discuss what the future of healthcare looks like, how we will get there, and what it will take to improve healthcare for all.
Tune in weekdays at 4:00am, 12 noon, and 8:00pm ET.
Join the conversation on Twitter at #TheIncrementalist