From the Executive Director

From the Executive Director

Advances in the Remote Exam Platform Improve Candidate Experience

By Brent Wagner, MD, MBA, ABR Executive Director

2022;15(6):3

Brent Wagner, MD

The ABR embarked on a path to develop remote exams in the early summer of 2020. At the outset, the model for remote high stakes medical specialty certification assessments had not yet been defined. Along with many of our colleagues in other specialties, we found ourselves innovating and, to some degree, experimenting with platforms that would strike a balance between maintaining a valid credential and creating an acceptable user experience.

In early 2021, we administered our first remote exams. We used a third-party remote proctor system, with a long history of success in higher education testing, to allow examinees to avoid the risk, stress, and expense of travel at a time when infection rates were high and vaccines were unavailable. Although we were confident that this allowed us to satisfy the first criterion (a secure exam as part of a valid credential), there were opportunities for improvement of the user experience. This past year, we developed a remote proctor system that is integrated with our exam software. Following a pilot in early July, this was implemented across several exams beginning in September. For the user, this provides a more seamless process for entering the exam. For ABR staff, it allows us to do “real time” monitoring of the video, so we can coach candidates to correct minor issues during the exam. In contrast, with the former method, we might not discover until many days later, during retrospective review, that the camera was incorrectly positioned or that we received incomplete video.

Another upgrade of the computer-based exams was introduced a few months ago: authentication of identification in advance of the exam. By removing as many steps as possible from the sign-in process, we hope to anticipate problems and mitigate examinee confusion and stress on exam day. In a post-exam survey, 94% of examinees agreed that “the process for providing my identification was easy to complete” and 96% agreed that “overall, the check-in process was easy to complete.”

Although no system is perfect, and occasional dropped connections or other problems will inevitably occur, the feedback we have received regarding our remote exam platform has been overwhelmingly favorable. This is especially true as it relates to the convenience for examinees. We are not surprised that nearly 100% of examinees are not only cooperating with the software and hardware requirements but also participating in ways that speak to the high level of ethics and professionalism that we expect of each other in the radiologic sciences.

Return to The Beam

CategoryBeam

Help spread the word
                   
https://www.theabr.org/beam/from-the-executive-director-december-2022
 
© 2023 American Board of Radiology    |   
Privacy & Legal    |   
Americans with Disabilities Act (ADA) Site Map
The American Board of Radiology does not and shall not discriminate based on race, color, religion (creed), gender, gender expression, age, national origin (ancestry), disability, marital status, sexual orientation, or military status in any of its activities or operations. These activities include but are not limited to hiring and firing of staff, selection of volunteers, conducting committee meetings, and administering exams. We are committed to an environment free from discrimination, sexual harassment, and other unlawful forms of harassment. To report any actions of discrimination, sexual harassment, or other unlawful harassment, please contact Karyn Howard, Managing Director, at 520-790-2900 extension 2171 or you can call our confidential hotline at 844-280-0005.
Version: 3.0.49
The American Board of Radiology