Auditing Algorithms: Research Methods for Detecting Discrimination on Internet Platforms

We take the perspective that virtually any algorithm may deserve scrutiny. In the popular mind, algorithms like the Google search engine algorithm exist in order to satisfy their users, and so Crandall’s pessimistic perspective that all algorithms are probably rigged might seem counter-intuitive. However, while it is true that a search algorithm that did not satisfy its users would be unlikely to continue operation for very long, it is important to note that most situations in which algorithms are employed permit the algorithms to satisfy multiple goals simultaneously. There are also many ways an algorithm might be “rigged” that are normatively problematic. We argue that public interest scrutiny of algorithms is required that will focus on subtle patterns of problematic behavior and that this may not be discernable directly or via a particular instance.

- Full Paper Here