By Kateira Aryaeinejad and Thomas Leo Scherer
In 2012, the National Institute of Justice’s (NIJ) Domestic Radicalization to Terrorism program began funding research on issues related to domestic radicalization and terrorism in the United States. A component of this portfolio is focused specifically on evaluations and assessments of terrorism prevention programs implemented across different populations. This report synthesizes these efforts, reviewing shared and singular lessons from NIJ-sponsored evaluations of terrorism prevention and terrorism prevention-relevant programming and focusing on both evaluation findings and processes. The projects reviewed for this report vary notably in their timelines, methods, programmatic focuses, and audiences. As such, the lessons drawn from them are not necessarily scientifically comparable or generalizable. However, important lessons emerge from this research, underscoring shared insights from NIJ-sponsored evaluative efforts and illuminating important areas for consideration in future programmatic and evaluative endeavors. First, findings from NIJ-sponsored evaluations emphasize the importance of gaining community buy-in and assuring program relevance for participants before implementing terrorism prevention or terrorism prevention-relevant programs. Although this may vary based on the intended program audience (e.g., youth, communities, law enforcement), the findings overall suggest that to ensure program fidelity, utility, relevance, and buy-in, programs should be developed in close consultation and cooperation with the audiences for which they are constructed. Doing so can also help alleviate concerns regarding the perceived stigmatization or targeting of specific communities in which terrorism prevention efforts take place and help address concerns about and issues in associating specific communities or demographics with national security threats. Second, programs for terrorism prevention and preventing/countering violent extremism can yield benefits beyond meeting terrorism prevention goals. They can also be complementary to and even carried out within public health or community resilience initiatives. The utility of incorporating terrorism prevention into these frameworks may vary based on the intended program audience and outputs. Careful attention should be paid in framing program activities and language when they are implemented via these larger frameworks. Indeed, if violent extremism awareness and prevention efforts are not appropriately integrated into a public health or community resilience model, participants may be confused as to the purpose, goals, and nature of the activities in which they are participating, to the detriment of short- and long-term programmatic goals and awarenessraising activities. Third, evaluative efforts in general face programmatic and methodological challenges that limit their ability to assess the impact of a program and the generalizability and veracity of their findings. NIJ-sponsored evaluations went to commendable lengths to address issues associated with data availability, generalizability, validity, and determinations of impact; however, certain challenges — including participant attrition rates and lack of available data — limited their ability to do so. These challenges offer important lessons for future evaluations of terrorism prevention programs. These evaluation findings suggest that several activities should be considered in addressing challenges that may arise during the evaluation process. These activities could include implementing formative evaluations or evaluability assessments prior to program implementation and evaluation, implementing strategies to limit participant attrition in the interest of maintaining appropriate sample sizes, and ensuring adequate resourcing for continued engagement in terrorism prevention initiatives. In addition, NIJ-sponsored evaluation findings suggest that program evaluators should consider incorporating control or comparison groups to assess programmatic impact on individual attitudes, behaviors, and outcomes, along with comparative analysis focused on assessing the outcomes and impact of programs replicated in different communities and settings to increase the generalizability, validity, and utility of evaluation findings. More information about NIJ-sponsored efforts to incorporate these elements is detailed in this report. Looking forward, findings from this review suggest important gaps and considerations that should be addressed by and incorporated in future programmatic and evaluation decisions. These include evaluating the long-term impact of programs through follow-up assessments, incorporating additional indicators for measuring and assessing potential behavioral change and knowledge retention, and assessing the comparability of programs’ impact on different forms of terrorism across different ideological spectrums. Finally, further consideration should be given to determining the appropriate approach, strategy, and goals for terrorism prevention activities based on the audiences they are geared toward. Based on the evaluation findings, in some cases it may be beneficial to explore and test efforts aimed at incorporating terrorism prevention activities and programs within a broader portfolio of public health and violence reduction-focused efforts. Future programmatic, research, and policy-oriented activities might consider further exploration of the benefits and potential issues associated with doing so in addressing radicalization to terrorism within the United States
Washington, DC: U.S. National Institute of Justice, Office of Justice Programs, 2024. 33p.