By Robert E. Worden,  Sarah J. McLean,  Robin S. Engel,  Hannah Cochran,  Nicholas Corsaro,  Danielle Reynolds,  Cynthia J. Najdowski Gabrielle T. Isaza

 In February of 2018, the New York City Police Department (NYPD) began in service training on implicit bias for its 36,000 sworn personnel, using the Fair and Impartial Policing (FIP) curriculum. A team of researchers from the John Finn Institute for Public Safety and the IACP/UC Center for Police Research and Policy partnered with the NYPD to conduct evaluation research on the impacts of the training. The evaluation concentrated on the effects of the training among patrol officers assigned to commands in the Patrol Services Bureau, Transit Bureau, and Housing Bureau, whose training commenced in May, 2018 and concluded in April, 2019. We assessed the immediate effects of the training on officers’ beliefs and attitudes: their knowledge about the science of implicit bias and the potential implications for policing, and their attitudes about the salience of bias and discrimination as a social problem, and the importance of policing without prejudice. A survey was administered on the day of FIP training, either prior to or following the training on alternating days. We drew inferences about immediate training effects from the differences in pre- and post-training survey responses. The effect of the training on officers’ knowledge about implicit bias was of moderate magnitude, though many officers’ comprehension of the science of bias was limited. The effects of the training on officers’ attitudes toward discrimination, and their motivation to act without prejudice, were fairly small, though prior to the training, most officers considered discrimination a social problem and felt individually motivated to act without bias. Officers regarded the training as beneficial: 70 percent reportedly gained a better understanding of implicit bias and more than two-thirds reportedly learned new strategies and skills that they expected to apply to their work. Nearly half rated the likelihood of using all five bias management strategies as either a 6 or 7 on a 7-point scale anchored at 7 as ‘very likely.’ We conducted a follow-up survey about officers’ beliefs and attitudes and their actual utilization of FIP strategies, which was administered from June through August of 2019, ranging from 2 to 13 months following the training. Asked whether they attempted “to apply the FIP training in your duties over the last month,” 42 percent said they had not, 31 percent said they attempted to use the bias-management strategies sometimes, and 27 percent said they attempted using them frequently. Comparing the follow-up survey responses to those on the days of training, we also detected some decay in the immediate effects of the training on officers’ comprehension of the science of implicit bias. The impact of police training is likely to be greater when it is supported by other organizational forces, of which immediate supervisors may be the most important. We surveyed sergeants post-training. We found that most sergeants view monitoring for bias as one of their responsibilities, and that they are willing to intervene as needed with  individual officers. One-quarter reported that they had intervened with an officer whose performance warranted intervention. Slightly more than half of the sergeants reportedly address issues of implicit bias during roll calls, thereby reinforcing the training. Insofar as officers’ unconscious biases may influence their enforcement decisions, and to the extent that officers apply their training in FIP strategies to manage their unconscious biases, we hypothesized that the training would lead to reductions in racial/ethnic disparities in enforcement actions, including stops, frisks, searches, arrests, summonses, and uses of force. We examined enforcement disparities at multiple levels of analysis – at the aggregate level of commands and the level of individual enforcement events. To isolate the effect of the training from other factors, the NYPD adhered to a protocol for a randomized controlled trial that provided for grouping commands into clusters scheduled for training by random assignment. This experimental control was supplemented by statistical controls in the analytical models. Overall, we found insufficient evidence to conclude that racial and ethnic disparities in police enforcement actions were reduced as a result of the training. It is very difficult to isolate the effects of the training from other forces that produce disparate enforcement outcomes. Training impacts might be a signal that is easily lost in the noise of everyday police work. Estimating the effect of a single training curriculum on officers’ decisions to invoke the law or otherwise exercise police authority may well be akin to finding the proverbial needle in a haystack. Furthermore, it has been presumed but not demonstrated that enforcement disparities stem, at least in part, from officers’ implicit biases. Though research has shown that police officers, like the general public, hold unconscious biases, no scientific evidence directly links officers’ implicit bias with enforcement disparities. To the contrary, the evidence – which is thin, to be sure – suggests that officers practice controlled responses even without implicit bias training. If disparities stem from forces other than implicit bias, then even a well designed training that is flawlessly delivered cannot be expected to alter patterns of police enforcement behavior.   

Albany, NY: The John F. Finn Institute, 2020.   188p.

By Jeffrey Fagan and Lila Nojima

Theories of rational behavior assume that actors make decisions where the benefits of their acts exceed their costs or losses. If those expected costs and benefits change over time, the behavior will change accordingly as actors learn and internalize the parameters of success and failure. In the context of proactive policing, police stops that achieve any of several goals—constitutional compliance, stops that lead to “good” arrests or summonses, stops that lead to seizures of weapons, drugs, or other contraband, or stops that produce good will and citizen cooperation—should signal to officers the features of a stop that increase its rewards or benefits. Having formed a subjective estimate of success (i.e., prior beliefs), officers should observe their outcomes in subsequent encounters and form updated probability estimates, with specific features of the event, with a positive weight on those features. Officers should also learn the features of unproductive stops and adjust accordingly. A rational actor would pursue “good” or “productive” stops and avoid “unproductive” stops by updating their knowledge of these features through experience. We analyze data on 4.9 million Terry stops in New York City from 2004–2016 to estimate the extent of updating by officers in the New York Police Department. We compare models using a frequentist analysis of officer behavior with a Bayesian analysis where subsequent events are weighted by the signals from prior events. By comparing productive and unproductive stops, the analysis estimates the weights or values—an experience effect—that officers assign to the signals of each type of stop outcome. We find evidence of updating using both analytic methods, although the “hit rates”—our measure of stop productivity including recovery of firearms or arrests for criminal behavior—remain low. Updating is independent of total officer stop activity each month, suggesting that learning may be selective and specific to certain stop features. However, hit rates decline as officer stop activity increases. Both updating and hit rates improved as stop rates declined following a series of internal memoranda and trial orders beginning in May 2012. There is also evidence of differential updating by officers conditional on a variety of features of prior and current stops, including suspect race and stop legality. Though our analysis is limited to NYPD stops, given the ubiquity of policing regimes of intensive stop and frisk encounters across the United States, the relevance of these findings reaches beyond New York City. These regimes reveal tensions between the Terry jurisprudence of reasonable suspicion and evidence on contemporary police practices across the country.

New York, NY: Columbia Public Law School, 2023, 61p.