United States Medical Licensing Examination

The United States Medical Licensing Examination (USMLE) is a three-step examination for medical licensure in the United States and is sponsored by the Federation of State Medical Boards (FSMB) and the National Board of Medical Examiners (NBME).[1] Physicians with an MD degree are required to pass this examination before being permitted to practice medicine in the United States. (However, this is not the sole requirement, which differs from state-to-state.[2]) See below for requirements of physicians with a DO degree.

Purpose

The USMLE assesses a physician's ability to apply knowledge, concepts, and principles, and to determine fundamental patient-centered skills that are important in health and disease and that constitute the basis of safe and effective patient care. Examination committees composed of medical educators and clinicians from across the United States and its territories create the examination materials each year. At least two committees critically appraise each test item or case, revising or discarding any materials that are in doubt.[3]

Steps

All three steps of the USMLE exam must be passed before a physician with an M.D. degree is eligible to apply for an unrestricted license to practice medicine in the United States. U.S. osteopathic medical school graduates are permitted to take either the USMLE or the Comprehensive Osteopathic Medical Licensing Examination (COMLEX) exam for medical licensure. Students who have graduated from medical schools outside the US and Canada must pass all three steps of the USMLE to be licensed to practice in the US, regardless of the title of their degree.

Overall pass rates for the individual Step exams that comprise the USMLE[4]
Years of data U.S. M.D. medical school graduates (US 1st-time takers) U.S. D.O. osteopathic medical school graduates (US DO 1st time) International medical school graduates (Int'l 1st time)
Step 1 (2015) 94% 96% 93% 93% 72% 78%
Step 2 CK (2014-2015) 94% 96% 92% 92% 71% 75%
Step 2 CS (2014-2015) 96% 96% 90% 90% 78% 80%
Step 3 (2015) 98% 98% 90% 90% 78% 80%
Further information: Comparison of MD and DO in the United States

Step 1

USMLE Step 1 assesses whether medical school students or graduates understand and can apply important concepts of the basic sciences to the practice of medicine. Step 1 ensures mastery of not only the sciences that provide a foundation for the safe and competent practice of medicine in the present, but also the scientific principles required for maintenance of competence through lifelong learning. Step 1 is constructed according to an integrated content outline that organizes basic science material along two dimensions: system and process. It includes the following subjects:[5] Anatomy, Behavioral Sciences, Biochemistry, Microbiology, Pathology, Pharmacology, Physiology, and interdisciplinary topics such as nutrition, genetics, and aging.

Step 1 is a one-day examination. It is divided into seven 60-minute blocks and administered in one 8-hour testing session. The number of questions per block on a given examination form will be 40. The total number of items on the overall examination form will not exceed 280. US medical students take Step 1 at the end of the Basic Sciences portion of the curriculum, usually after the second year of medical school. If the student passes the exam, he or she may not repeat it to achieve a higher score, and any failed attempt is permanently recorded. This situation of the Step 1 exam being a "one-time deal" is the reason it is broadly viewed as the most arduous and paramount examination a medical student will ever sit during his or her career. Its three-digit result has substantial bearing on the specialties and location (tier of hospital) for which a residency applicant is competitive.

In recent years, an applicant's Step 1 score has been cited by residency program directors as their most important criterion in selecting graduating medical students for their residency program, despite lack of evidence or data to support that perversion.[6] Average USMLE Step 1 scores for various residencies are available in Charting Outcomes in the Match. The current use of Step 1 scoring as a major determinant for granting residency interviews has been met with tremendous criticism by the medical community, citing that the Step 1 exam was intended to be one of four licensing tests.[7]

In response to public outcry, in February 2020, the USMLE program announced a plan to change Step 1 score reporting to a pass/fail system in an effort "to reduce overemphasis on Step 1 performance while allowing licensing authorities to continue the original intention to use the test to determine medical license eligibility. " However, this transition will occur no earlier than January 1, 2022.[8][9] The USMLE wrote on their site, "Changing Step 1 score reporting to pass/fail can help reduce the current overemphasis on USMLE performance, while retaining the ability of medical licensing...This change is an important first step toward facilitating broader, systemic change.[10] However, critics of this decision argued that this would just shift the importance of the three-digit number score on to Step 2 CK, as well as putting international medical graduates (IMGs) at a disadvantage, as traditionally IMGs scored exceptionally high on Step 1 in order to distinguish themselves and obtain residency positions in coveted specialties or hospitals.

During the COVID-19 pandemic, the USMLE wrote on their COVID-FAQ page and on Twitter that despite receiving many inquiries to move to immediate pass/fail, they would not consider any early changes to Step 1 reporting as this would affect their "stakeholders."

As of June 2020, the USMLE has not yet decided how the Step 1 will be reported on the ERAS transcripts for the Class of 2022 or later when applying to residency. The USMLE wrote on their website that if you received a score on the STEP before 2022, the "USMLE program has not yet determined how the policy change will impact score reports and transcripts."[10]

Step 2

USMLE Step 2 is designed to assess whether medical school students or graduates can apply medical knowledge, skills and understanding of clinical science essential for provision of patient care under supervision and includes emphasis on health promotion and disease prevention. Step 2 ensures that due attention is devoted to principles of clinical sciences and basic patient-centered skills that provide the foundation for the safe and competent practice of medicine. US medical students typically take Step 2 between the third and fourth year of medical school. Step 2 currently consists of a single exam, Step 2 CK, but was previously divided into two separate exams:

Step 2 CK

USMLE Step 2 Clinical Knowledge is a one-day examination. It is divided into eight 60-minute blocks, administered in one 9-hour testing session. Test item formats may vary within each block. It is constructed according to an integrated content outline that organizes clinical science material along two dimensions: physician task and disease category. It includes the following subjects:[11] internal medicine, obstetrics and gynecology, pediatrics, preventive medicine, psychiatry, surgery, other areas relevant to provision of care under supervision.

Step 2 CS

The USMLE Step 2 Clinical Skills exam is now discontinued. It previously contained the following subjects:

  • Integrated Clinical Encounter (ICE)
  • Communication and Interpersonal Skills (CIS)
  • Spoken English Proficiency (SEP).[12]

Step 2 CS used standardized patients to test medical students and graduates on their ability to gather information from patients, perform physical examinations, and communicate their findings to patients and colleagues. The examination was offered in five U.S. cities: Philadelphia, Chicago, Atlanta, Houston, and Los Angeles.

Administration of the Step 2-CS began in 2004. Prior to 2004, a similar exam, the Clinical Skills Assessment (CSA) was used to assess the clinical skills of foreign medical graduates.

On May 26, 2020, in response to the COVID-19 pandemic, the USMLE "suspended Step 2 CS test administrations for the next 12-18 months."[13]

On January 26, 2021, the USMLE discontinued Step 2 CS.[14]

Step 3
Main article: USMLE Step 3

USMLE Step 3 is the final exam in the USMLE sequence and assesses whether medical school students or graduates can apply medical knowledge and understanding of biomedical and clinical science essential for the unsupervised practice of medicine, with emphasis on patient management in ambulatory settings. Graduates of US medical schools typically take this exam at the end of the first year of residency. Examinees are tested on the following subjects: central nervous system, eye/ear/nose/mouth/throat, respiratory system, circulatory system, digestive system, behavioral/emotional disorders, musculoskeletal system, skin/subcutaneous tissue, endocrine/nutrition/metabolic disorders, kidneys/urinary tract, reproductive system, pregnancy/childbirth, neonate/childhood illnesses, blood and blood-forming organs, infectious/parasitic diseases, injuries/wound/toxic effects/burns, and health maintenance issues.[15]

Step 3 is a two-day examination. The first day of testing includes 233 multiple-choice items divided into 6 blocks of 38-40 items; 60 minutes are allotted for completion of each block of test items. Items with an associated pharmaceutical advertisement or scientific abstract are included in each of these multiple-choice blocks. There are approximately 7 hours in the test session on the first day.

There are approximately 9 hours in the test session on the second day. This day of testing includes 180 multiple-choice items, divided into 6 blocks of 30 items; 45 minutes are allotted for completion of each block of test items. This is followed by 13 case simulations, each of which is allotted a maximum of 10 or 20 minutes of real time.

Test sites and preparation

The USMLE Step 1 and Step 2 CK exams can be taken at Prometric test centers worldwide. The Step 2 CS and the Step 3 can only be taken in the United States.

The USMLE Step 1 is typically taken during a student's second year of medical school. The one-day exam tests them on basic science principles, including behavioral science, microbiology, physiology, and anatomy. The exam moved to a pass/fail model on February 12, 2020 along with other changes due to an attempt by the Federation of State Medical Boards (FSMB) and the National Board of Medical Examiners (NBME) to balance focus between exams and actual coursework.[16]

USMLE mean and median scores have increased significantly in the past decades—so much so that the testing board had to increase the score it takes to pass.[17] A large part of the increase was attributed in empirically-based research articles to performance improvement factors such as using a question bank to prepare for the test.

Relevance of predictive measures

A study from 2016 showed little to no correlation between MCAT scores and USMLE Step 1 scores, as well as little to no correlation between MCAT scores and the NBME scores.[18] However, since the 82 students on whom this study was conducted all attended the same medical school, the usefulness of these results in the broader medical school population may be of limited value.[18]

Furthermore, research conducted on students between 1998 and 2004, although outdated, and conducted on an undisclosed number of students, was conducted on a longer timeline, and shows that the Biological Science (BS) section of the MCAT did indeed predict better performance on the USMLE Step 1, but not any other section, and found that grade point average in undergraduate science courses is a strong predictor of performance on the USMLE Step 1 and Step 2 exams, and that the Biological Science section of the MCAT, but not any other section, predicted USMLE Step 1 and Step 2 exam performance, though this information is outdated, and unclear of whether this was also only conducted at a single institution or more than one, making this study's results of limited value.[19] The same study claims that the selectivity of undergraduate institution is also a predictor of step 1 and step 2 performance, even when controlling for undergraduate GPA and MCAT score.[19]

Controversies

USMLE response to COVID-19

The USMLE was met with heavy criticism for their lack of adaptability during the COVID. The criticism was two-fold: First, for the mishandling and poor communication of exam cancellations by both USMLE program administrators and the third-party exam administrator, Prometric. Second, the pandemic crisis exacerbated existing resentment towards the high-stakes nature of the exam: namely, several students and physicians were upset that the USMLE refused to move up the 2022 deadline of making Step 1 into a pass or fail exam.

Exam Cancellations

Students received little to no information or, in some cases, contradictory information about whether their examination appointments would be upheld.[20][21] Medscape in an article entitled "USMLE Testing Chaos May Harm Current and Future Doctors" reports:[22]

In response to the COVID-19 pandemic, on March 17, the United States Medical Licensing Examination (USMLE) announced that licensing exam testing was suspended for 30 days. On April 17, the private company that administers the exams and runs the testing centers, Prometric, canceled testing once again.

According to medical students, residents, and faculty who spoke with Medscape Medical News, testing has now resumed, although the process has been chaotic, poorly communicated, discriminatory, and outright harmful, largely because of the USMLE's relationship with Prometric.

It is estimated that cancellations affected 17,000 medical students and residents through mid-May, according to student representatives from the Association of American Medical Colleges. Last-minute cancellations continued through early June, sometimes just hours before exams were to start. Students have arrived at testing centers for exams only to find them closed. Many have called testing centers and Prometric's headquarters to find full voicemail boxes, automated messages, or hours-long waits.

Earlier Implementation of Pass/Fail

Students and physicians were upset that the USMLE refused to move up the 2022 deadline of making Step 1 pass or fail, in light of the testing barriers created by COVID.[23][24] Students signed a letter of concern "detailing their concerns and offering alternatives".[25]

Current recommendations under consideration include retroactive Step 1 pass/fail reporting for the class of 2022, or having each student choose how their Step 1 score is reported on their ERAS transcript (pass/fail or scored) beginning with the class of 2021.[26][27]

Racial Bias of Step 1 scoring

Research demonstrates some differences in USMLE scores attributable to race and ethnicity, with self-identified Black, Asian, and Hispanic examinees showing score differences when compared with self-identified White examinees. "The mean USMLE step 1 score was significantly greater among white applicants (223) as compared to black and Hispanic applicants (216).[28] Depending on the threshold score, an African American was 3-6x less likely to be offered an interview."[29] "61% of minority applicants were accepted into an orthopaedic residency versus 73% of White applicants. White and Asian applicants and residents had higher USMLE Step 1. White applicants and matriculated candidates had odds of Alpha Omega Alpha membership compared with Black, Hispanic, and Other groups.[30][31] One of the recommendations for Step 1 changing to pass or fail was to address racial differences. "Among self-identified racial groups, research shows that white students perform higher on the USMLE than any other group."[32][33] The American Academy of Family Physicians and Association of American Medical Colleges supported changing Step 1 to pass or fail to reduce racial bias.[34][35][36]

Katsufrakis & Chaudhry comments against Step 1 changes

In Dec 2018, NBME President Peter Katsufrakis and FSMB President Humayun Chaudhry wrote in opposition of USMLE Step 1 changes in from Improving Residency Selection Requires Close Study and Better Understanding of Stakeholder Needs: "If students reduce time and effort devoted to preparing for Step 1, they may indeed devote attention to other activities that will prepare them to be good physicians. This would arguably be an ideal outcome of such a change. However, if students were to devote more time to activities that make them less prepared to provide quality care, such as binge-watching the most recent Netflix series or compulsively updating their Instagram account, this could negatively impact residency performance and ultimately patient safety. We know that assessment drives learning, so another concern resulting from a shift to pass/fail scoring may be a less knowledgeable physician population."[37] [38]

NBME Executive Salary

The NBME executives received public criticism after their salaries were released after increasing costs for students, showing many executives receiving high said to seven figures. "Former NBME President Dr. Melnick's compensation increased from $399,160 in 2001 to over $1.2 million in 2016, almost perfectly in parallel with the tripling of USMLE costs." [39][40] "As of 2016, NBME President also gets free first-class airfare for himself and his travel partner, as well as a membership to a Philadelphia social club. According to the 2017 Form 990, Schedule J, two lower executives received total compensation over $700,000; another two over $600,000; another three receiving over $500,000; and another 6 receiving over $400,000....Yet, the total number of test-takers for the USMLE Step 1 has been essentially unchanged for the past 10-15 years."[41]

Pricing

USMLE was met with criticism when they announced their raising cost for STEP standardized tests. Kevin MD wrote, "Safeguards are needed to ensure fees for mandatory testing such as the USMLE do not exceed reasonable operating costs, particularly for financially vulnerable medical students."[42]

As part of a broader public plea for systemic changes to the improper use of USMLE STEP exams, STAT wrote that this "multimillion-dollar industry has exploited the opportunity to extract thousands of dollars from already overly indebted students. Registering for STEP exams test cost $645-$1300, while Step preparation materials and courses run much higher."[43]

As of 2020, the USMLE currently charges:

  • $645 for Step 1
  • $645 for Step 2 CK
  • $1300 for Step 2 CS[44]

Similar exams
  • The "Comprehensive Osteopathic Medical Licensing Examination" (COMLEX-USA) is required for osteopathic physicians in the United States
  • The American Podiatric Medical Licensing Examination (APMLE) is required for Podiatric Physicians in the United States.

In other countries

References
  1. "United States Medical Licensing Examination ®". www.usmle.org. Retrieved 2016-08-18.
  2. "State Specific Requirements for Initial Medical Licensure".
  3. "United States Medical Licensing Examination | USMLE Bulletin". www.usmle.org. Retrieved 2016-08-18.
  4. "United States Medical Licensing Examination | Scores & Transcripts". www.usmle.org. Retrieved 2016-08-18.
  5. https://usmle.org/step-1/
  6. Archived December 16, 2011, at the Wayback Machine
  7. https://www.medpagetoday.com/publichealthpolicy/medicaleducation/86427
  8. "United States Medical Licensing Examination | Invitational Conference on USMLE Scoring". www.usmle.org. Retrieved 2020-02-12.
  9. https://www.staffcare.com/physician-blogs/usmle-step-1-moves-to-pass-fail-medical-education/?mobile=0
  10. https://www.usmle.org/usmlescoring/faq.html
  11. https://usmle.org/step-2-ck/
  12. https://usmle.org/step-2-cs/
  13. https://www.usmle.org/announcements
  14. https://www.usmle.org/announcements/?ContentId=309
  15. https://usmle.org/step-3/
  16. https://www.forbes.com/sites/kristenmoon/2020/04/07/usmle-step-1-is-now-passfailwho-benefits-from-this-big-change/#75f22ad04873
  17. Schwartz, Lindsay F.; Lineberry, Matthew; Park, Yoon Soo; Kamin, Carol S.; Hyderi, Abbas A. (2018). "Development and Evaluation of a Student-Initiated Test Preparation Program for the USMLE Step 1 Examination". Teaching and Learning in Medicine. 30 (2): 193–201. doi:10.1080/10401334.2017.1386106. PMID 29240455. S2CID 4014046.
  18. Giordano, C., Hutchinson, D., & Peppler, R. (2016). A Predictive Model for USMLE Step 1 Scores. Cureus, 8(9), e769. http://doi.org/10.7759/cureus.769
  19. Kleshinski, James; Sadik A. Khuder; Joseph I. Shapiro; Jeffrey P. Gold (7 November 2007). "Impact of preadmission variables on USMLE step 1 and step 2 performance". Advances in Health Sciences Education. Springer. 14 (1): 69–78. doi:10.1007/s10459-007-9087-x. PMID 17987399. S2CID 5894276.
  20. Murphy, Brendan (2 June 2020). "Delays, miscommunications add even more stress to USMLE Step exams". American Medical Association.
  21. https://in-training.org/step-1-in-a-time-of-covid-19786
  22. Krupp, Lexi (15 June 2020). "USMLE Testing Chaos May Harm Current and Future Doctors". Medscape. Medscape LLC. Retrieved 3 October 2020.
  23. Tiako, Max Jordan Nguemeni; Muñoz, Rodrigo (24 March 2020). "Amid COVID-19, make USMLE Step 1 pass/fail now". KevinMD.com. KevinMD, LLC. Archived from the original on 2020-05-19.
  24. Quinn, Colin (1 May 2020). "How the USMLE fails COVID-19". KevinMD.com. KevinMD LLC.
  25. Frellick, Marcia (4 May 2020). "Students Upset by USMLE Response to COVID-19 Demand Changes". Medscape. Medscape LLC.
  26. https://forums.studentdoctor.net/threads/class-of-2023-step-1-scores-possibly-may-be-converted-to-p-f-on-residency-application-per-usmle-town-hall.1413758
  27. https://www.usmle.org/incus
  28. Williams, Myia; Kim, Eun Ji; Pappas, Karalyn; Uwemedimo, Omolara; Marrast, Lyndonna; Pekmezaris, Renee; Martinez, Johanna (2020). "The impact of United States Medical Licensing Exam ( USMLE ) step 1 cutoff scores on recruitment of underrepresented minorities in medicine: A retrospective cross‐sectional study". Health Science Reports. 3 (2): e2161. doi:10.1002/hsr2.161. PMC 7170452. PMID 32318628.
  29. https://journals.lww.com/academicmedicine/fulltext/2001/12000/racial_bias_in_using_usmle_step_1_scores_to_grant.21.aspx
  30. Poon, S.; Nellans, K.; Rothman, A.; Crabb RAL; Wendolowski, S. F.; Kiridly, D.; Gecelter, R.; Gorroochurn, P.; Chahine, N. O. (2019). "Underrepresented Minority Applicants Are Competitive for Orthopaedic Surgery Residency Programs, but Enter Residency at Lower Rates". The Journal of the American Academy of Orthopaedic Surgeons. 27 (21): e957–e968. doi:10.5435/JAAOS-D-17-00811. PMID 30614894.
  31. https://journals.lww.com/jaaos/Abstract/2019/11010/Underrepresented_Minority_Applicants_Are.7.aspx
  32. https://www.aamc.org/news-insights/should-usmle-be-pass-fail
  33. https://www.ama-assn.org/residents-students/usmle/usmle-step-1-moves-pass-fail-answers-7-key-questions
  34. https://www.aafp.org/media-center/releases-statements/all/2020/usmle-step-1-scoring-change-removes-a-harmful-barrier-to-holistic-specialty-selection.html
  35. https://www.aafp.org/news/education-professional-development/20200220usmlechange.html
  36. Edmond, M. B.; Deschenes, J. L.; Eckler, M.; Wenzel, R. P. (2001). "Racial bias in using USMLE step 1 scores to grant internal medicine residency interviews". Academic Medicine : Journal of the Association of American Medical Colleges. 76 (12): 1253–6. doi:10.1097/00001888-200112000-00021. PMID 11739053. S2CID 7029050.
  37. https://in-housestaff.org/dear-nbme-and-fsmb-i-watch-hgtv-more-than-netflix-a-response-to-the-invited-commentary-on-usmle-step-1-1274
  38. https://opmed.doximity.com/articles/step-1-vs-netflix-and-instagram?_csrf_attempted=yes
  39. https://forums.studentdoctor.net/threads/step-3-trick-works.1271481/page-32
  40. https://projects.propublica.org/nonprofits/organizations/231352238
  41. https://thesheriffofsodium.com/2019/02/01/a-non-mbas-guide-to-nbme-revenue-in-9-simple-charts/
  42. https://www.kevinmd.com/blog/2016/07/cost-taking-usmle-exams-staggering.html
  43. https://www.statnews.com/2019/03/08/make-step-1-test-pass-fail-medical-students
  44. https://www.nbme.org/taking-assessment/united-states-medical-licensing-examr-usmler
This article is issued from Wikipedia. The text is licensed under Creative Commons - Attribution - Sharealike. Additional terms may apply for the media files.