节点文献

ChatGPT作为医学教育工具的思考——以心血管内科主治医师资格考试为例

Reflections on Using ChatGPT as A Medical Education Tool: A Case Study of the Board Certification Examination for Cardiovascular Medicine

  • 推荐 CAJ下载
  • PDF下载
  • 不支持迅雷等下载工具,请取消加速工具后下载。

【作者】 商鲁翔薛茗月孙华鑫汤宝鹏侯应龙

【Author】 SHANG Luxiang;XUE Mingyue;SUN Huaxin;TANG Baopeng;HOU Yinglong;Department of Cardiology, The First Affiliated Hospital of Shandong First Medical University & Shandong Provincial Qianfoshan Hospital/Shandong Medicine and Health Key Laboratory of Cardiac Electrophysiology and Arrhythmia;Zane Cohen Centre for Digestive Diseases, Mount Sinai Hospital;Department of Pacing and Electrophysiology, The First Affiliated Hospital of Xinjiang Medical University;

【通讯作者】 侯应龙;

【机构】 山东第一医科大学第一附属医院(山东省千佛山医院)心血管病学/山东省医药卫生心律失常重点实验室西奈山医院Zane Cohen消化疾病中心新疆医科大学第一附属医院起搏电生理科

【摘要】 为评估人工智能语言模型ChatGPT在医学考试中的表现,采用横断面研究方法,将ChatGPT回答的心血管主治医师资格考试的模拟试题结果与标准答案进行比对。在排除2道图片题后,ChatGPT正确回答了333道问题中的189道,准确率为56.8%,其在四个单元的回答正确率分别为67.0%、61.0%、58.2%及11.4%。逻辑错误是最常见的回答错误原因。题目属于第四单元、案例分析题是回答错误的影响因素。研究显示ChatGPT未通过心内科主治医师资格模拟考试,尚不推荐将其用于心血管内科医师的日常教育。

【Abstract】 In order to evaluate the performance of the artificial intelligence language model ChatGPT in medical examinations, a cross-sectional study was conducted comparing ChatGPT’s answers to a set of simulated tests of Board Certification Examination for Cardiovascular Medicine with the standard answers. After excluding 2 picture questions, ChatGPT correctly answered 189 out of 333 questions, with an accuracy rate of 56.8%. The correct response rates across four sections were 67.0%,61.0%, 58.2% and 11.4% respectively. Logical errors were the most common cause of incorrect answers. Factors influencing incorrect responses included questions from the fourth section and case analysis questions. Research shows that ChatGPT failed to pass the simulation examination of Board Certification Examination for Cardiovascular Medicine, and it is not recommended to be used in the routine education of cardiovascular physicians.

【基金】 2021年国家自然科学基金项目(82100343);2022年首都医科大学代谢紊乱相关心血管疾病北京市重点实验室开放课题(DXWL2022-04);2023年首都医科大学临床流行病学北京市重点实验室开放课题
  • 【文献出处】 医学与哲学 ,Medicine & Philosophy , 编辑部邮箱 ,2024年14期
  • 【分类号】TP18;R-4;C975
  • 【下载频次】37
节点文献中: 

本文链接的文献网络图示:

本文的引文网络