医学文献 >>
  • 检索发现
  • 增强检索
知识库 >>
  • 临床诊疗知识库
  • 中医药知识库
评价分析 >>
  • 机构
  • 作者
默认
×
热搜词:
换一批
论文 期刊
取消
高级检索

检索历史 清除

Performance Assessment of GPT 4.0 on the Japanese Medical Licensing Examination

摘要Objective:To evaluate the accuracy and parsing ability of GPT 4.0 for Japanese medical practitioner qualification examinations in a multidimensional way to investigate its response accuracy and comprehensiveness to medical knowledge.Methods:We evaluated the performance of the GPT 4.0 on Japanese Medical Licensing Examination(JMLE)questions(2021-2023).Questions are categorized by difficulty and type,with distinctions between general and clinical parts,as well as between single-choice(MCQ1)and multiple-choice(MCQ2)questions.Difficulty levels were determined on the basis of correct rates provided by the JMLE Preparatory School.The accuracy and quality of the GPT 4.0 responses were analyzed via an improved Global Qualily Scale(GQS)scores,considering both the chosen options and the accompanying analysis.Descriptive statistics and Pearson Chi-square tests were used to examine performance across exam years,question difficulty,type,and choice.GPT 4.0 ability was evaluated via the GQS,with comparisons made via the Mann-Whitney U or Kruskal-Wallis test.Results:The correct response rate and parsing ability of the GPT4.0 to the JMLE questions reached the qualification level(80.4%).In terms of the accuracy of the GPT4.0 response to the JMLE,we found significant differences in accuracy across both difficulty levels and option types.According to the GQS scores for the GPT 4.0 responses to all the JMLE questions,the performance of the questionnaire varied according to year and choice type.Conclusion:GTP4.0 performs well in providing basic support in medical education and medical research,but it also needs to input a large amount of medical-related data to train its model and improve the accuracy of its medical knowledge output.Further integration of ChatGPT with the medical field could open new opportunities for medicine.

更多
广告
提交
  • 浏览4
  • 下载1
当代医学科学(英文)

当代医学科学(英文)

2024年44卷6期

1148-1154页

SCIMEDLINECSCD

加载中!

相似文献

  • 中文期刊
  • 外文期刊
  • 学位论文
  • 会议论文

加载中!

加载中!

加载中!

加载中!

法律状态公告日 法律状态 法律状态信息

特别提示:本网站仅提供医学学术资源服务,不销售任何药品和器械,有关药品和器械的销售信息,请查阅其他网站。

  • 客服热线:4000-115-888 转3 (周一至周五:8:00至17:00)

  • |
  • 客服邮箱:yiyao@wanfangdata.com.cn

  • 违法和不良信息举报电话:4000-115-888,举报邮箱:problem@wanfangdata.com.cn,举报专区

官方微信
万方医学小程序
new医文AI 翻译 充值 订阅 收藏 移动端

官方微信

万方医学小程序

使用
帮助
Alternate Text
调查问卷