The Archives

In chronologic order…

Checking the references: the evidence in support of Step 1

  • We’re told that Step 1 scores predict measures of physician quality. But do they? Let’s check the references.

_

USMLE Step 1: leveling the playing field – or perpetuating disadvantage?

  • Do students from “lower tier” medical schools benefit from a scored USMLE? Or would they be better off by playing a different game altogether?

_

USMLE Step 1: the “antidote to implicit bias”?

  • Under-represented minorities in medicine score lower on Step 1. So why do NBME executives think it’s a cure for bias?

_

Raising the bar: encouraging trends in USMLE Step 1 performance, 1997-2017

  • Are rising Step 1 scores just “score creep” – or a sign of improving physician quality?

_

A peek inside the USMLE sausage factory: setting the Step 1 minimum passing score

  • Why is the minimum passing score for Step 1 frequently increased? To understand why, we first need to understand how the passing standard for is set. Let’s find out how the sausages get made.

_

A two-step plan for a better USMLE Step 1

  • If you turned Step 1 over to me, here’s what I’m gonna do.

_

A non-MBA’s guide to NBME revenue in 9 simple charts

  • The NBME has a financial conflict of interest in maintaining a scored USMLE. Here’s why.

_

A MCQ exam on the USMLE

  • I’ve studied the business of the NBME. Ready to take the exam?

_

The new USMLE score report

  • Since January 2019, USMLE score reports have looked different. What changed – and why?

_

On pi and Step 1 Mania

  • What would happen if we asked medical students to memorize digits of pi?

_

The intellectual opportunity cost of USMLE Step 1

  • Students spend a lot of time studying for Step 1. What else could we do with that time?

_

The etiology of Application Fever

  • Medical students are submitting more residency applications than ever before. Why? Who benefits?

_

Symbiosis: the USMLE, ERAS, and medical education

  • Step 1 Mania and Application Fever need each other.

_

The mythology of USMLE Step 1 scores and board certification

  • Do Step 1 scores predict success on the boards? Yes… but maybe not in the way you expect.

_

The InCUS is coming – are we ready?

  • The corporate sponsors of the USMLE have organized an invitation-only conference to determine the future of USMLE scoring. The InCUS is nigh.

_

InCUS wrap

  • What happened at InCUS? Who knows. Attendees have been asked to stay silent.

_

What’s on USMLE Step 1?

  • Physicians who took Step 1 more than 5 years ago honestly have no clue what’s on the exam. Want to remind yourself what’s really tested on Step 1?

_

Stonewalled: A brief update on InCUS, the NBME, and financial COI

  • I asked the NBME whether InCUS attendees received financial compensation. The answer? Silence.

_

What can the NFL Draft teach us about residency selection?

  • Getting into residency programs is competitive… but nowhere near as competitive as the NFL. What can we learn from the metrics used to select NFL players?

_

Step 1 Mania: The Case for #USMLEPassFail

  • Links to a video podcast of a Grand Rounds presentation with an overview of the case for a pass/fail USMLE.

_

Another MCQ Test on the USMLE

  • Most of us do not interpret USMLE Step 1 scores appropriately. They’re not as precise and reliable as you might imagine.

_

What’s the Antipyretic for Application Fever?

  • We have a major problem with Application Fever. The question is, what do we do about it?

_

A Field Guide to USMLE Step 1 Apologists

  • You know what you never hear in the USMLE Pass/Fail debate? The full-throated defense of USMLE Step 1 as a great test. Here’s your field guide to the various USMLE Step 1 Apologists.

_

Application Fever: The Movie

  • It’s not really a movie. More like a video podcast compiling my thoughts on the mess we’ve made with residency application inflation – and how we can get out of it.

_

InCUS: The Conversation Continues

  • Preliminary recommendations from InCUS were just released. Unfortunately, they don’t tell us much – and what they do tell us isn’t what I hoped to hear.

_

Applying Smarter, Part I: Breaking Down the AAMC’s Apply Smart Campaign

  • The AAMC’s Apply Smart campaign perpetuates misinformation, employs faulty logic, presents biased probabilities of residency entry, and is likely to encourage medical students to submit even more residency applications.

_

Applying Smarter, Part II: How to Give Students the Information They Really Need

  • For informational strategies to reduce Application Fever, the information provided has to be… well, informative. Here’s how to provide the data that students really need when they’re applying for residency.

_

Why Can’t I Retake USMLE Step 1?

  • It’s a question I’m often asked. But there’s a fundamental difference between the USMLE and other tests used for admission, and this explains why the NBME is highly unlikely to ever allow re-takes.

_

How Much Does Step 1 Mania Cost Medical Schools?

  • For one prominent U.S. medical school, it’s $495,000/year. Where does that money go? And more importantly, is it worth it?

_

What’s the REAL Match rate?

  • The NRMP reported record-setting statistics for Match rates in 2019. Are things as good as they appear? Or do the NRMP’s figures overestimate the real likelihood of success for certain applicants, like IMGs?

_

The USMLE for DOs: How to Stop Fleecing Osteopathic Medical Students

  • In 2018, 4186 osteopathic medical students took USMLE Step 1, and the NBME made $4,399,320 on DO students who took USMLE tests. Thing is, these tests are not required for osteopathic licensure. How can we stop DO students from paying twice for licensing exams?

Why do we have residency training?

  • You might think that residency training evolved as a natural outgrowth of undergraduate medical education. Think again. The real forces that led to the requirement for residency training were a bit more complicated.

Step 2 CS, Part One: How Did We Get Here?

  • Medical students today have to pay $1300 and travel to one of only a handful of testing centers to take the USMLE Step 2 CS exam. This is the story of how the CS exam came to be.

How is the three-digit USMLE score calculated?

  • The NBME does not disclose how it generates an examinee’s three-digit USMLE score from the percentage of questions answered correctly. However, I stumbled on a key clue from the psychometric literature that sheds light on how this is done for USMLE Step 2 CK.

Step 2 CS, Part Two: The Resistance

  • From its inception, medical students have been opposed to USMLE Step 2 CS. This is the story of organized opposition to the CS exam – and why it always failed.

_

The Match, Part 1: Why do we have a Match?

  • The Match is so ingrained into medical education that it’s hard to imagine life without it. But when you step back and think about it, it’s a question worth asking. Why is getting a residency position so different than applying for any other job?

_

As more essays are posted, I’ll continue to update this page.

Home