DeepAI AI Chat
Log In Sign Up

Watching the watchers: bias and vulnerability in remote proctoring software

by   Ben Burgess, et al.

Educators are rapidly switching to remote proctoring and examination software for their testing needs, both due to the COVID-19 pandemic and the expanding virtualization of the education sector. State boards are increasingly utilizing these software for high stakes legal and medical licensing exams. Three key concerns arise with the use of these complex software: exam integrity, exam procedural fairness, and exam-taker security and privacy. We conduct the first technical analysis of each of these concerns through a case study of four primary proctoring suites used in U.S. law school and state attorney licensing exams. We reverse engineer these proctoring suites and find that despite promises of high-security, all their anti-cheating measures can be trivially bypassed and can pose significant user security risks. We evaluate current facial recognition classifiers alongside the classifier used by Examplify, the legal exam proctoring suite with the largest market share, to ascertain their accuracy and determine whether faces with certain skin tones are more readily flagged for cheating. Finally, we offer recommendations to improve the integrity and fairness of the remotely proctored exam experience.


On the Legal Compatibility of Fairness Definitions

Past literature has been effective in demonstrating ideological gaps in ...

Understanding Privacy Attitudes and Concerns Towards Remote Communications During the COVID-19 Pandemic

Since December 2019, the COVID-19 pandemic has caused people around the ...

Virtual Classrooms and Real Harms

Universities have been forced to rely on remote educational technology t...

Remote Working Pre- and Post-COVID-19: An Analysis of New Threats and Risks to Security and Privacy

COVID-19 has radically changed society as we know it. To reduce the spre...

Benefits and Limitations of Remote Work to LGBTQIA+ Software Professionals

Background. The mass transition to remote work amid the COVID-19 pandemi...

Adversarial Scrutiny of Evidentiary Statistical Software

The U.S. criminal legal system increasingly relies on software output to...

Forensic analysis of the Turkey 2023 presidential election reveals extreme vote swings in remote areas

Concerns about the integrity of Turkey's elections have increased with t...