Integration of ChatGPT in IMG Study Strategies: An Exploratory Study of User Experiences and Perceptions

Authors

DOI:

https://doi.org/10.62497/IRABCS.2024.29

Keywords:

Artificial Intelligence (AI), ChatGPT, International Medical Graduates, IMG, USMLE, medical students, study strategies, mixed-methods study

Abstract

Introduction: IMGs face extensive challenges when preparing to enter a foreign workforce, such as adapting to new learning systems and studying without guidance, which can be alleviated by using AI tools like ChatGPT to supplement their studies by explaining concepts, generating questions, and providing personalized feedback.

Aims: To explore International Medical Graduate’s (IMG) experiences with ChatGPT by integrating it into their study strategies for the United States Medical License exam (USMLE) preparation.

Methods: This prospective study comprises 305 International Medical Graduates (IMGs) actively preparing for the United States Medical License exam (USMLE) . Data collection included qualitative semi structured interviews and Quantitative surveys via Google Forms. Quantitative data was analyzed with the help of SPSS version 27 for descriptive statistics and inferential analysis. 

Results: A total of 305 participant reported diverse sources through which they gained awareness about ChatGPT  where Social media (31.15%) and online search platforms (28.52%) were primary sources .Word of mouth (18.69%), blogs (8.85%), friends (9.51%), and news outlets (3.28%) also contributed. Nearly half of the participants (49.5%) actively preparing for USMLE  predominantly used it for concept clarification and practice question sessions (31.15%)  , exam preparation and content clarification (28.52%) and summarization of study materials (18.69%). 49.5% found it helpful for preparation, others expressed dissent. Satisfaction ratings averaged at 3.7, indicating moderate satisfaction Participants willingness to recommend ChatGPT averaged at 7.2, showcasing a generally positive inclination. Participants highlighted ChatGPT's usefulness for various study-related activities. Recommendations for improvement included refining responses for accuracy and addressing concerns about plagiarism and reliability .Some participants did not observe noticeable improvements in their USMLE performance despite using ChatGPT.

Conclusion: Participants reported that ChatGPT was beneficial for concept clarification and practice questions, though concerns about accuracy and potential plagiarism were noted. The study concludes that while ChatGPT holds significant promise as a supplementary study tool, users should verify information for accuracy and combine its use with traditional study methods to enhance comprehensive understanding. Incorporating ChatGPT into medical curricula as a supplementary tool, with proper training on responsible use, could further maximize its benefits.

Downloads

Download data is not yet available.

References

IMGs Meaning: What’s the Experience of Being an IMG? [Internet]. www.clinicalprograms.com. [cited 2024 Mar 11]. Available from: https://www.clinicalprograms.com/blogs/imgs-meaning-whats-the-experience-of-being-an-img

Montenegro-Rueda M, Fernández-Cerero J, Fernández-Batanero JM, López-Meneses E. Impact of the Implementation of ChatGPT in Education: A Systematic Review. Computers [Internet]. 2023 Aug 1;12(8):153. Available from: https://www.mdpi.com/2073-431X/12/8/153

UNESCO. ChatGPT and Artificial Intelligence in higher education [Internet]. 2023. Available from: https://www.iesalc.unesco.org/wp-content/uploads/2023/04/ChatGPT-and-Artificial-Intelligence-in-higher-education-Quick-Start-guide_EN_FINAL.pdf

Singh N. ChatGPT Cheating Statistics & Impact On Education (2023) [Internet]. NerdyNav. 2023. Available from: https://nerdynav.com/chatgpt-cheating-statistics/

Robin BR, McNeil SG, Cook DA, Agarwal KL, Singhal GR. Preparing for the changing role of instructional technologies in medical education. Acad Med [Internet]. 2011;86(4):435–9. Available from: http://dx.doi.org/10.1097/acm.0b013e31820dbee4

Rosenbaum BP, Gorrindo TL, Patel SG, McTigue MP, Rodgers SM, Miller BM. Medical student involvement in website development. Med Teach [Internet]. 2009;31(7):627–33. Available from: http://dx.doi.org/10.1080/01421590802206713

KILIÇ E, KARADENİZ Ş, KARATAŞ S. Internet Supported Constructive Learning Environments. GEFAD. 2003;23(2).

Adar N, Kandemir MC. M-learning tools for palm device: M-test and m-exercise [Paper presentation]. In: Proceedings of the 8th International Educational Technology Conference; 2008 May 8; Anadolu University, Eskisehir.

Lee H. The rise of ChatGPT: Exploring its potential in medical education. Anat Sci Educ [Internet]. 2023; Available from: http://dx.doi.org/10.1002/ase.2270

Uri.edu. [cited 2024 Mar 12]. Available from: https://digitalcommons.uri.edu/cgi/viewcontent.cgi?article=1547&context=cba_facpubs

Kung TH, Cheatham M, Medenilla A, Sillos C, De Leon L, Elepaño C, et al. Performance of ChatGPT on USMLE: Potential for AI-assisted medical education using large language models. PLOS Digit Health [Internet]. 2023;2(2):e0000198. Available from: http://dx.doi.org/10.1371/journal.pdig.0000198

Rospigliosi P ‘asher.’ Artificial intelligence in teaching and learning: what questions should we ask of ChatGPT? Interact Learn Environ [Internet]. 2023;31(1):1–3. Available from: http://dx.doi.org/10.1080/10494820.2023.2180191

Ghosh A, Bir A. Evaluating ChatGPT’s ability to solve higher-order questions on the competency-based medical education curriculum in medical biochemistry. Cureus [Internet]. 2023; Available from: http://dx.doi.org/10.7759/cureus.37023

Halaweh M. ChatGPT in education: Strategies for responsible implementation. Contemp Educ Technol [Internet]. 2023;15(2):ep421. Available from: http://dx.doi.org/10.30935/cedtech/13036

Tackett S, Jeyaraju M, Moore J, Hudder A, Yingling S, Park YS, et al. Student well-being during dedicated preparation for USMLE Step 1 and COMLEX Level 1 exams. BMC Med Educ [Internet]. 2022;22(1). Available from: http://dx.doi.org/10.1186/s12909-021-03055-2

Ozair A, Bhat V, Detchou DKE. The US residency selection process after the United States Medical Licensing Examination Step 1 pass/fail change: Overview for applicants and educators. JMIR Med Educ [Internet]. 2023;9:e37069. Available from: http://dx.doi.org/10.2196/37069

Liu DS, Sawyer J, Luna A, Aoun J, Wang J, Boachie, Lord, et al. Perceptions of US medical students on artificial intelligence in medicine: Mixed methods survey study. JMIR Med Educ [Internet]. 2022;8(4):e38325. Available from: http://dx.doi.org/10.2196/38325

Alkhaaldi SMI, Kassab CH, Dimassi Z, Oyoun Alsoud L, Al Fahim M, Al Hageh C, et al. Medical student experiences and perceptions of ChatGPT and Artificial intelligence: Cross-sectional study. JMIR Med Educ [Internet]. 2023;9:e51302. Available from: http://dx.doi.org/10.2196/51302

Tsang R. Practical applications of ChatGPT in undergraduate medical education. J Med Educ Curric Dev [Internet]. 2023;10:238212052311784. Available from: http://dx.doi.org/10.1177/23821205231178449

Dave T, Athaluri SA, Singh S. ChatGPT in medicine: an overview of its applications, advantages, limitations, future prospects, and ethical considerations. Front Artif Intell [Internet]. 2023;6. Available from: http://dx.doi.org/10.3389/frai.2023.1169595

Mohammad B, Supti T, Alzubaidi M, Shah H, Alam T, Shah Z, Househ M. The Pros and Cons of Using ChatGPT in Medical Education: A Scoping Review. Stud Health Technol Inform. 2023 Jun 29;305:644-647. PMID: 37387114. DOI: 10.3233/SHTI230580

Sok S, Heng K. ChatGPT for education and research: A review of benefits and risks. SSRN Electron J [Internet]. 2023; Available from: http://dx.doi.org/10.2139/ssrn.4378735

Ngo TTA. The perception by university students of the use of ChatGPT in education. Int J Emerg Technol Learn [Internet]. 2023;18(17):4–19. Available from: http://dx.doi.org/10.3991/ijet.v18i17.39019

Downloads

Published

07/02/2024

How to Cite

1.
Khan DM, Dr Syed Abdul Aziz Jameel, Shakil DS, Hassan DS, Abdullah DA, Rizwan DM, et al. Integration of ChatGPT in IMG Study Strategies: An Exploratory Study of User Experiences and Perceptions. IRABCS [Internet]. 2024 Jul. 2 [cited 2024 Dec. 21];2(1):47-54. Available from: https://irabcs.com/ojs/article/view/29

Similar Articles

1-10 of 38

You may also start an advanced similarity search for this article.

Most read articles by the same author(s)

1 2 3 4 5 > >>