Integration of ChatGPT in IMG Study Strategies: An Exploratory Study of User Experiences and Perceptions
DOI:
https://doi.org/10.62497/IRABCS.2024.29Keywords:
Artificial Intelligence (AI), ChatGPT, International Medical Graduates, IMG, USMLE, medical students, study strategies, mixed-methods studyAbstract
Introduction: IMGs face extensive challenges when preparing to enter a foreign workforce, such as adapting to new learning systems and studying without guidance, which can be alleviated by using AI tools like ChatGPT to supplement their studies by explaining concepts, generating questions, and providing personalized feedback.
Aims: To explore International Medical Graduate’s (IMG) experiences with ChatGPT by integrating it into their study strategies for the United States Medical License exam (USMLE) preparation.
Methods: This prospective study comprises 305 International Medical Graduates (IMGs) actively preparing for the United States Medical License exam (USMLE) . Data collection included qualitative semi structured interviews and Quantitative surveys via Google Forms. Quantitative data was analyzed with the help of SPSS version 27 for descriptive statistics and inferential analysis.
Results: A total of 305 participant reported diverse sources through which they gained awareness about ChatGPT where Social media (31.15%) and online search platforms (28.52%) were primary sources .Word of mouth (18.69%), blogs (8.85%), friends (9.51%), and news outlets (3.28%) also contributed. Nearly half of the participants (49.5%) actively preparing for USMLE predominantly used it for concept clarification and practice question sessions (31.15%) , exam preparation and content clarification (28.52%) and summarization of study materials (18.69%). 49.5% found it helpful for preparation, others expressed dissent. Satisfaction ratings averaged at 3.7, indicating moderate satisfaction Participants willingness to recommend ChatGPT averaged at 7.2, showcasing a generally positive inclination. Participants highlighted ChatGPT's usefulness for various study-related activities. Recommendations for improvement included refining responses for accuracy and addressing concerns about plagiarism and reliability .Some participants did not observe noticeable improvements in their USMLE performance despite using ChatGPT.
Conclusion: Participants reported that ChatGPT was beneficial for concept clarification and practice questions, though concerns about accuracy and potential plagiarism were noted. The study concludes that while ChatGPT holds significant promise as a supplementary study tool, users should verify information for accuracy and combine its use with traditional study methods to enhance comprehensive understanding. Incorporating ChatGPT into medical curricula as a supplementary tool, with proper training on responsible use, could further maximize its benefits.
Downloads
References
IMGs Meaning: What’s the Experience of Being an IMG? [Internet]. www.clinicalprograms.com. [cited 2024 Mar 11]. Available from: https://www.clinicalprograms.com/blogs/imgs-meaning-whats-the-experience-of-being-an-img
Montenegro-Rueda M, Fernández-Cerero J, Fernández-Batanero JM, López-Meneses E. Impact of the Implementation of ChatGPT in Education: A Systematic Review. Computers [Internet]. 2023 Aug 1;12(8):153. Available from: https://www.mdpi.com/2073-431X/12/8/153
UNESCO. ChatGPT and Artificial Intelligence in higher education [Internet]. 2023. Available from: https://www.iesalc.unesco.org/wp-content/uploads/2023/04/ChatGPT-and-Artificial-Intelligence-in-higher-education-Quick-Start-guide_EN_FINAL.pdf
Singh N. ChatGPT Cheating Statistics & Impact On Education (2023) [Internet]. NerdyNav. 2023. Available from: https://nerdynav.com/chatgpt-cheating-statistics/
Robin BR, McNeil SG, Cook DA, Agarwal KL, Singhal GR. Preparing for the changing role of instructional technologies in medical education. Acad Med [Internet]. 2011;86(4):435–9. Available from: http://dx.doi.org/10.1097/acm.0b013e31820dbee4
Rosenbaum BP, Gorrindo TL, Patel SG, McTigue MP, Rodgers SM, Miller BM. Medical student involvement in website development. Med Teach [Internet]. 2009;31(7):627–33. Available from: http://dx.doi.org/10.1080/01421590802206713
KILIÇ E, KARADENİZ Ş, KARATAŞ S. Internet Supported Constructive Learning Environments. GEFAD. 2003;23(2).
Adar N, Kandemir MC. M-learning tools for palm device: M-test and m-exercise [Paper presentation]. In: Proceedings of the 8th International Educational Technology Conference; 2008 May 8; Anadolu University, Eskisehir.
Lee H. The rise of ChatGPT: Exploring its potential in medical education. Anat Sci Educ [Internet]. 2023; Available from: http://dx.doi.org/10.1002/ase.2270
Uri.edu. [cited 2024 Mar 12]. Available from: https://digitalcommons.uri.edu/cgi/viewcontent.cgi?article=1547&context=cba_facpubs
Kung TH, Cheatham M, Medenilla A, Sillos C, De Leon L, Elepaño C, et al. Performance of ChatGPT on USMLE: Potential for AI-assisted medical education using large language models. PLOS Digit Health [Internet]. 2023;2(2):e0000198. Available from: http://dx.doi.org/10.1371/journal.pdig.0000198
Rospigliosi P ‘asher.’ Artificial intelligence in teaching and learning: what questions should we ask of ChatGPT? Interact Learn Environ [Internet]. 2023;31(1):1–3. Available from: http://dx.doi.org/10.1080/10494820.2023.2180191
Ghosh A, Bir A. Evaluating ChatGPT’s ability to solve higher-order questions on the competency-based medical education curriculum in medical biochemistry. Cureus [Internet]. 2023; Available from: http://dx.doi.org/10.7759/cureus.37023
Halaweh M. ChatGPT in education: Strategies for responsible implementation. Contemp Educ Technol [Internet]. 2023;15(2):ep421. Available from: http://dx.doi.org/10.30935/cedtech/13036
Tackett S, Jeyaraju M, Moore J, Hudder A, Yingling S, Park YS, et al. Student well-being during dedicated preparation for USMLE Step 1 and COMLEX Level 1 exams. BMC Med Educ [Internet]. 2022;22(1). Available from: http://dx.doi.org/10.1186/s12909-021-03055-2
Ozair A, Bhat V, Detchou DKE. The US residency selection process after the United States Medical Licensing Examination Step 1 pass/fail change: Overview for applicants and educators. JMIR Med Educ [Internet]. 2023;9:e37069. Available from: http://dx.doi.org/10.2196/37069
Liu DS, Sawyer J, Luna A, Aoun J, Wang J, Boachie, Lord, et al. Perceptions of US medical students on artificial intelligence in medicine: Mixed methods survey study. JMIR Med Educ [Internet]. 2022;8(4):e38325. Available from: http://dx.doi.org/10.2196/38325
Alkhaaldi SMI, Kassab CH, Dimassi Z, Oyoun Alsoud L, Al Fahim M, Al Hageh C, et al. Medical student experiences and perceptions of ChatGPT and Artificial intelligence: Cross-sectional study. JMIR Med Educ [Internet]. 2023;9:e51302. Available from: http://dx.doi.org/10.2196/51302
Tsang R. Practical applications of ChatGPT in undergraduate medical education. J Med Educ Curric Dev [Internet]. 2023;10:238212052311784. Available from: http://dx.doi.org/10.1177/23821205231178449
Dave T, Athaluri SA, Singh S. ChatGPT in medicine: an overview of its applications, advantages, limitations, future prospects, and ethical considerations. Front Artif Intell [Internet]. 2023;6. Available from: http://dx.doi.org/10.3389/frai.2023.1169595
Mohammad B, Supti T, Alzubaidi M, Shah H, Alam T, Shah Z, Househ M. The Pros and Cons of Using ChatGPT in Medical Education: A Scoping Review. Stud Health Technol Inform. 2023 Jun 29;305:644-647. PMID: 37387114. DOI: 10.3233/SHTI230580
Sok S, Heng K. ChatGPT for education and research: A review of benefits and risks. SSRN Electron J [Internet]. 2023; Available from: http://dx.doi.org/10.2139/ssrn.4378735
Ngo TTA. The perception by university students of the use of ChatGPT in education. Int J Emerg Technol Learn [Internet]. 2023;18(17):4–19. Available from: http://dx.doi.org/10.3991/ijet.v18i17.39019
Downloads
Published
Issue
Section
Categories
License
Copyright (c) 2024 Dr Syed Abdul Aziz Jameel, Dr Shanza Shakil, Dr Syed Hassan , Dr Areeba Abdullah , Dr Muhammad Rizwan , Dr Marium Khan, Dr Aima Tahir (Author)
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
Authors retain copyright to their work published in the IRABCS journal under the Creative Commons Attribution Non-Commercial No Derivatives License (CC BY-NC-ND 4.0).