I literally rode into the sunset recently as I finished my tour of duty as one of the Director examiners for the American Board of Surgery. I was heading out of St. Louis westward toward my home in Kansas. It was a 9-hour drive, which gave me plenty of time to reflect on the 6 years I shared the responsibility of administering the certifying exam known by most surgeons as “the oral exam.”
Dr. Tyler G. Hughes
Over the last dozen years, Directors V. Suzanne Klimberg and Karen J. Brasel, along with former Executive Director Frank Lewis, a team of psychometricians at the Board, and members of the certification committee of the Board, worked tirelessly to create a testing instrument as fair and statistically sound as possible given the inherently qualitative exam. I believe they did a magnificent job. Gone are the legends of yesteryear where candidates were subjected to the whims of whatever crossed the mind of the examiners, including their prejudices about the “right” answer. The oral exam now represents a well-constructed survey of surgical judgment issues that have been thoroughly vetted.
Being an examiner for the orals means you arrive Sunday afternoon before the exams that are given over the next two and a half days. Each examiner undergoes an overview briefing on Sunday afternoon and then studies “the book” for that test’s content usually until late into the night. This book is an impressive document.
We arise around 0530 to attend a breakfast meeting, which includes breaking into our six-person teams and going over each question that will be given that day. At 0800, the first candidates for the first session walk into a room and meet the two surgeons who will make some of the most important decisions affecting that candidate’s career. If you rate the intensity of this moment on a scale of 1 to 10, this is an 11 for both candidates and examiners. No one in the room knows how it will turn out because every session has its own twists and turns. Everyone there wants to see a passing score, but the two examiners know that they must make a decision that is safe for the public and fair for the candidate.
Twelve exams are given per team per day except for the final day which has only six. So, each team examines 30 candidates over 3 days. I’ve opened a door and shaken the moist hand of 438 candidates. I’ve seen every sort of emotion during those sessions. I’ve had moments of great joy and times of profound sadness as candidates respond to the questions. I’ve always tried to be friendly, but just like surgery, it is a serious business and decisions have to be made. That means ignoring one’s hopes and acting on the best facts available at the moment. Most surgeons remember their oral examiners and what they were asked for a lifetime. I know I do.
I could write a book on this experience (I won’t, though). But as I reflect on my time as a Director, what stands out in my mind are the associate examiners with whom I’ve worked. These surgeons are invited to participate and receive no compensation. It’s 3 days out of their lives, and because they don’t give the exam as frequently as the Directors do, the amount of study and effort is greater for them. Each is selected because he or she is considered to be a thoughtful surgeon with high standards. These surgeons do this job because they care about quality in our profession.