Mixed Methods for Policy Research and Program Evaluation
- Patricia Burch - University of Southern California, USA
- Carolyn J. Heinrich - Vanderbilt University, USA, University of Texas, Austin, USA, University of Wisconsin, Madison, USA, University of North Carolina, Chapel Hill, USA
This practical text equips students, researchers, and policymakers in the social sciences with the tools they need for applying mixed methods in policy research and program evaluation, from design, through data collection, and dissemination. Emphasizing the “how-to”—the set of conceptual and active tasks carried out by mixed methods researchers—the book is illustrated with rich case studies from the authors’ own research projects in education and public policy. These examples help readers identify and explain policy and program impacts and better understand the “why” and “how” of observed effects. Throughout the book, the authors describe challenges that both beginners and advanced scholars are likely to encounter when doing mixed methods research and recommend practical tools available to address them.
Drawing on their extensive experience in large scale project management, Patricia Burch and Carolyn Heinrich clearly articulate an agenda for program and policy evaluation that is designed to ensure actionable evidence of the effectiveness of a program and its implementation is generated for all stakeholders. The examples they provide, while not minimizing the challenges of employing a mixed methods approach, will convince readers of the practicality and value of iteratively integrating both qualitative and quantitative approaches throughout the entire evaluation process, from initial design through data integration and analysis to dissemination of research findings. We can all learn from their experiences, so generously shared.
In a time of scarce resources for social programs, wise policy requires making tough choices. To do this well, policymakers need reliable information on what works, why some approaches are more successful than others, and what can be done to improve effectiveness. This book is a vital primer on how to do that. It attacks the mistaken view that quantitative and qualitative research are alternatives, rather than essential complements that, when combined in a mix of research methods, can best provide guidance to policymakers and practitioners.
This book is just what is needed as we move into a new phase of evidence informed policy and practice. It advocates an integrated and coherent approach to policy research and program evaluation while recognizing the realities and complexities of both policy and research. It will be immensely helpful to those engaged in mixed methods research across a variety of policy fields.
The gulf between qualitative and quantitative researchers is an old problem. With this useful and important new book, Burch and Heinrich help to bridge the divide, highlighting the need for a more complementary and integrated approach that can help us learn not just whether programs "work", but how and why they do.
This rich and sophisticated book provides a wealth of insights and practical guidelines that will enhance the work of both novice and experienced researchers. Burch and Heinrich show the way to making mixed methods research more relevant and more rigorous.
This is a very useful book for researchers and evaluators contemplating or already using mixed methods in policy research and evaluation, as well as for those teaching applied evaluation courses.
In this book, Burch and Heinrich have successfully explained how a mixed methods approach can be applied to policy analysis and evaluation. I highly recommend it for scholars applying mixed methods to the study of public policy issues. This book should be required reading for all public policy students and researchers.
The book’s biggest strength is its emphasis on the practicalities of integrating different methods throughout the life cycle of a research project. For example, all the chapters end with discussion questions, which force the reader to think through and better understand how the material presented might apply to their own work. The book is also illustrated with rich case studies (mostly from the education and social welfare arenas) to aid understanding.
This book provides a great foundation for my Intro to Program Evaluation course.