Examinees Provide Positive Feedback on First Remote Exam Administration
by Donald J. Flemming, MD, ABR Board of Trustees Chair
2021;14(1):6
The Diagnostic Radiology Certifying Pilot Exam in January provided an opportunity for us to gain a real-life look at a computer-based remote administration with a limited group of candidates. It was the first time we had administered a remote computer-based exam and the experience was largely a success.
The pilot was taken by 161 candidates, all of whom were given the chance to respond to a post-exam survey. We appreciate the 127 who shared their opinions about the experience; we will use their feedback to improve our platforms and processes.
Some interesting details emerged from the survey:
- More than 95% of respondents found the practice exam useful in helping them prepare.
- More than 80% took the exam at home rather than in a hospital or private practice office.
- More than 95% thought* that installation of the Proctorio®extension was easy to complete.
- More than 95% thought* that check-in through the Proctorio®platform was easy.
- More than 95% thought* that the exam platform (imaging tools, load times, answer entry, etc.) worked well.
- More than 90% thought* that “the image quality was adequate for testing purposes.”
* “Agreed” or “Strongly Agreed”
Common themes that emerged from provided comments are described below.
- To uncover potential issues, it is critically important to practice, more than once, using the same computer in the same location you anticipate using on exam day. Problems encountered included webcam and microphone technical difficulties, ID capture issues, challenges performing the required room scan without a detachable or portable webcam, and access being blocked by an institutional firewall.
- The time allotted for mandatory breaks between portions of the exam was considered too long by 51% of respondents. The break time is long by design to allow for management of technical issues that can occur for up to 10% of test takers. A uniform restart of the exam after a mandatory break helps protect the integrity of the test.
We appreciate everyone who provided feedback. It’s instrumental in helping us ensure the continued delivery of a secure and valid exam, while keeping the exam day experience as pleasant as possible for the new remote administrations.
