Probing and prioritizing the public policy Evaluation models

Vaezi, Reza; Sharif Zadeh, Fattah; Mohammadi, Mohsen

Probing and prioritizing the public policy Evaluation models

Document Type : Original Manuscript

Authors

Abstract

Abstract: Policy evaluation has important functions in public policy and governance processes. However, Iranian researchers have paid less attention to this critical subject of study and as a result, the field has been relatively suffered from this inattention. This paper, attempts to answer this fundamental question: What are the criteria for assessing the desirability of an evaluation model and among the most popular models, which are more favorable?. In order to answer this question, we reviewed the eighteen prevalent evaluation models and placed them for examination by public policy experts. In this research sixteen academic and administrative experts specializing in policy evaluation, participated in a Delphi panel. Then, we used TOPSIS technique to analyze the experts opinions. Findings suggest that within the Iranian context, regardless of subject requirements, the Utilization-focused model and the Accountability evaluation model have the highest and lowest score respectively.

Keywords

References

آذر، عادل.، رجب زاده، علی. (1387) . تصمیم‌گیری کاربردی با رویکرد MADM (چاپ سوم). تهران: انتشارات نگاه دانش.

الوانی، سیدمهدی.، شریف زاده، فتاح. (۱۳94) . فرآیند خطمشی گذاری عمومی (چاپ سیزدهم). تهران: انتشارات دانشگاه علامه طباطبایی.

امامی میبدی، راضیه.، اشتریان، کیومرث. (1391) . طراحی نظام ارزیابی خط‌مشی عمومی در جمهوری اسلامی ایران. پژوهشنامه علوم سیاسی، سال هفتم، شماره دوم، صص 7-47.

حبیبی، آرش.، ایزدیار، صدیقه.، سرافرازی، اعظم. (1393) . تصمیم‌گیری چندمعیاره فازی. تهران: انتشارات کتیبه گیل.

قلی‌پور، رحمت الله. (1393) . تصمیم‌‌گیری سازمانی و خط‌مشی‌گذاری عمومی (چاپ ششم). تهران: انتشارات سمت.

محقق‌معین، محمد حسن. (1388) . مبانی ارزشیابی برنامه. تهران: نشر موسسه ارزشیابی توانمند ساز معین.

مجمع تشخیص مصلحت نظام (1394)، سیاستهای کلی نظام، بدست آمده از تارنما به آدرس:

http://maslahat.ir/DocLib2/Approved%20Policies/Offered%20General%20Policies.aspx.

Alkin, M. C., Christie, C. A. (2012) . An Evaluation Theory Tree. In M. Alkin (Ed.), Evaluation roots، A Wider Perspective of Theorists' Views and Influences (pp. 11-58). Thousand Oaks: SAGE.

Barrett, P. (2011) . The Use of Sensory and Analytical Evaluation to Match the Flavor of Onion Powder in a White sauce. Kalamazoo: Western Michigan University Evaluation Center.

Borenstein, M., Hedges, L. V., Higgins, P. T., Rothstein, H. R. (2009) . Introduction to Meta-Analysis. Chichester, UK : Wiley.

Brinkerhoff, R. O. (2005) . The Success Case Method، a strategic evaluation approach to increasing the value and effect of training. Advances in Developing Human Resources, 7, 86–101.

Coryn, C., Stufflebeam, D. (2014) . Evaluation Theory, Models, and Applications. San Francisco: Jossey-Bass.

Cousins, J. B. (1996) . Consequences of researcher involvement in participatory evaluation. Studies in Educational Evaluation, 22, 3–27.

Dye, T. (2008) . Understanding Public Policy (11th ed.). New Jersey: Pearson Prentice Hall.

Funnell, S. C. , Rogers, P. J. (2011) . Purposeful Program Theory، Effective Use of Theories Of Change And Logic Models. San Francisco: Jossey-Bass.

Fetterman, D. M., Wandersman, A. (2005) . Empowerment evaluation principles in practice, New York: Guilford Press.

Grisham, T. (2009) . The Delphi Technique، A Method For Testing Complex And Multifaceted Topics. International Journal of Managing Projects in Business, 2 (1), 71-105.

Guba, E. G., Lincoln, Y. S. (1989) . Fourth Generation Evaluation (1th ed. ) . New Delhi: SAGE Publications.

Hansen, H. F., (2005). Choosing Evaluation Models: A Discussion on Evaluation Design. Evaluation, 11 (4), pp. 447–62.

Hewitt, G. S., Sims, R. H. (2012) . The Realist Approach to Evaluation Research، an Introduction, International Journal of Therapy and Rehabilitation 19 (5), 205–259.

Keeney, S. Hasson, F., McKenna, H. P. (2001) . A Critical Review of the Delphi Technique as A Research Methodology for Nursing. International Journal of Nursing Studies, 38 (2), pp. 195-200.

Landeta, J. (2006) . Current Validity of Delphi Method in Social Sciences. Technological Forecasting and Social Change, 37(5), 54-81.

Mark, M., Henry, G., Julnes, G. (2000) . Evaluation: An Integrated Framework for Understanding, Guiding, and Improving Policies and Programs (1th ed.). San Francisco: Jossey-Bass.

Mertens, D. M., Wilson, A. T. (2012) . Program Evaluation Theory and Practice: A Comprehensive Guide (1th ed.). New York: The Guilford Press.

Miles, I., Cunningham, P., Cox, D., Crowe, C., Malik, K. (2006) . Smart Innovation، A Practical Guide to Evaluating Innovation Programmes. Brussels-Luxembourg: ECSC-EC-EAEC, European Commission.

Owen, J. M. (2012 ). Evaluation Forms، toward an Inclusive Framework for Evaluation Practice. In M. Alkin (Ed.), Evaluation roots، A Wider Perspective of Theorists' Views and Influences (pp. 386-393). Thousand Oaks: SAGE.

Pawson, R. (2013). The science of evaluation: a realist manifesto, London, SAGE Publications. P. 13

Potter, C. (2006) . Psychology and the art of programme evaluation. South African Journal of Psychology, 36(1), 89-105.

Patton, M. Q. (2005) . Utilization-Focused Evaluation. In S. Mathison (Ed.), Encyclopedia of evaluation (pp. 429–432). Thousand Oaks: SAGE.

Rossi, P., Lipsey, M., Freeman, H. (2003) . Evaluation: A Systematic Approach (7th ed.). Thousand Oaks: SAGE.

Sanderson, I. (2002) Evaluation, Policy Learning and Evidence-Based Policy Making, Public administration (80), pp 1–22.

Shadish, W. R., Cook, T. D., Campbell, D. T. (2002) . Experimental and Quasi-Experimental Designs for Generalized Causal Inference. Boston, MA: Houghton Mifflin.

Stake, R. (2010) . Program Evaluation Particularly Responsive Evaluation, Journal of MultiDisciplinary Evaluation, 7(15), 35-59.

Stufflebeam, Daniel (2003). Evaluation Models, New Directions for Evaluation, 89. San Francisco: Jossey Bass.

Skulmoski, G. J., Hartman, F. T., Krahn, J. (2007) . The Delphi Method for Graduate Research, Journal of Information Technology Education, 6, 10-26.

Scriven, M. (2015) . Key Evaluation Checklist (Kec). Retrieved from http://www.michaelscriven.info/.

The University of Texas at Austin (2015). The Texas Politics Project. Retrieved from http://texaspolitics.utexas.edu/.