GPT-4在运动医学康复中表现优于初级专家物理治疗师:AI应答质量与适应性的评估
简介
本研究由资深专家设计53个运动物理治疗问题,由GPT-4和3名初级物理治疗师分别作答,并针对患者、物理治疗师和专家物理治疗师三类受众进行回答调整。采用盲法由3名资深专家评估回答质量和适应性。结果显示,GPT-4在所有受众中的回答质量和适应性均显著优于初级治疗师(p<0.001)。针对患者的回答中,GPT-4在55%的问题上被评为最佳;针对物理治疗师的问题中,…
英文摘要
BACKGROUND: Artificial intelligence (AI), particularly large language models (LLMs) like ChatGPT, has demonstrated potential in healthcare applications, but its effectiveness in clinical rehabilitation contexts remains underexplored. This study investigated whether GPT-4 (accessed through its online interface ChatGPT) can deliver high-quality, adaptive responses in sports physical therapy comparable to or surpassing those of human professionals. METHODS: Fifty-three sports physical therapy questions were developed by senior experts and answered by GPT-4 and three junior expert physical therapists (JEPs). Responses were tailored for different target audiences: patients, physical therapists, and expert physical therapists. GPT-4 was prompted using structured engineering techniques. A blinded panel of three senior physical therapists/researchers assessed responses for quality and adaptiveness, and identified which responses were superior. RESULTS: Across all target audiences, GPT-4 outperformed JEPs in both quality and adaptiveness of responses (p < 0.001). For responses aimed at patients, GPT-4 was rated best in 26 (55%) questions. For responses aimed at physical therapists, GPT-4 was rated best in 34 (64%) questions. Performance varied by topic, but GPT-4 consistently provided more expert-adapted and contextually appropriate information. GPT-4's responses were especially superior in areas like pain, osteoarthritis, and anterior cruciate ligament rehabilitation. CONCLUSION: This study demonstrated that GPT-4 is capable to generate high-quality, adaptive responses in the field of orthopedic sports physical therapy, which can surpass the performance of JEPs in a controlled setting.