Economics & Sociology

ISSN: 2071-789X eISSN: 2306-3459 DOI: 10.14254/2071-789X
Index PUBMS: f5512f57-a601-11e7-8f0e-080027f4daa0
Article information
Title: Efficiency vs Effectiveness: a Benchmarking Study on European Healthcare Systems
Issue: Vol. 10, No 3, 2017
Published date: 10-2017 (print) / 10-2017 (online)
Journal: Economics & Sociology
ISSN: 2071-789X, eISSN: 2306-3459
Authors: Corrado lo Storto
University of Naples Federico II

Anatoliy G. Goncharuk
International Humanitarian University, Odessa, Ukraine
Keywords: efficiency, effectiveness, DEA, healthcare systems, Europe
DOI: 10.14254/2071-789X.2017/10-3/8
Index PUBMS: a58737a6-f270-11e7-9371-fa163e5d4f72
Language: English
Pages: 102-115 (14)
JEL classification: C14, H51, I18, M40

ABSTRACT. This paper illustrates a benchmarking study concerning the healthcare systems in 32 European countries as of 2011 and 2014. Particularly, this study proposes a two-dimensional approach (efficiency/effectiveness models) to evaluate the performance of national healthcare systems. Data Envelopment Analysis has been adopted to compute two performance indices, measuring efficiency and effectiveness of these healthcare systems. The results of the study emphasize that the national healthcare systems achieve different efficiency and effectiveness levels. Their performance indices are uncorrelated and behave differently over time, suggesting that there might be no real trade-off between them. The healthcare systems’ efficiencies remain generally stable, while the effectiveness values significantly improved from 2011 to 2014. However, comparing the efficiency and effectiveness scores, the authors identified a group of countries with the lowest performing healthcare systems that includes Ukraine, Bulgaria, Switzerland, Lithuania, and Romania. These countries need to implement healthcare reforms aimed at reducing resource intensity and increasing the quality of medical services. The results also showed the benefits of the proposed approach, which can help policy makers to identify shortcomings in national healthcare systems and justify the need for their reform.


1. Adam, A., Delis, M., Kammas, P. (2011). Public sector efficiency: leveling the playing field between OECD countries. Public Choice, 146(1/2), 163-183.

2. Afonso, A., St. Aubyn, M. (2006). Relative Efficiency of Health Provision: a DEA Approach with Non-discretionary Inputs. ISEG-UTL Economics Working Paper No. 33/2006/DE/UECE (

3. Anton, S. G., Onofrei, M. (2012). Health care performance and health financing systems in countries from Central and Eastern Europe. Transylvanian Review of Administrative Sciences, 35 E/2012, 22-32.

4. Berger, M. C., Messer, J. (2002). Public financing of health expenditures, insurance, and health outcomes. Applied Economics, 34, 2105-2113.

5. Bhat, R., Verma, B. B., Reuben, E. (2001). Methodology note: Data Envelopment Analysis (DEA). Journal of Health Management, 3(2), 309-328.

6. Bhat, V. N. (2005). Institutional arrangements and efficiency of health care delivery systems. European Journal of Health Economics, 50, 215-222.

7. Borisov, D., Cicea C., Turlea, C. (2012). DEA model for assessing efficiency in providing health care. Management Research and Practice, 4(1), 5-18.

8. Chang, S. J., Hsiao, H. C., Huang, L. H., Chang, H. (2011). Taiwan quality indicator project and hospital productivity growth. Omega, 39(1), 14-22.

9. Charnes, A., Cooper, W. W., Rhodes, E. (1978). Measuring the efficiency of decision making units. European Journal of Operational Research, 2, 429-444.

10. de Cos, P. H., Moral-Benito, E. (2014). Determinants of health-system efficiency: evidence from OECD countries. International Journal of Health Care Finance Economics, 14, 69-93.

11. DeRosario, J. M. (1999). Healthcare system performance indicators: a new beginning for a reformed Canadian healthcare system. Journal of Healthcare Quality, 21(1), 37-41.

12. Evans, D. E., Tandon, A., Murray, C. J. L., Lauer, J. A. (2001). Comparative Efficiency Of National Health Systems: Cross National Econometric Analysis. BMJ: British Medical Journal, 323(7308), 307-310.

13. Färe, R., Grosskopf, S., Lindgren, B., Poullier, J. (1997). Productivity growth in health-care delivery. Medical Care, 35(4), 354-366.

14. Frogner, B. K., Frech, H. E., Parente, S. T. (2015). Comparing efficiency of health systems across industrialized countries: a panel analysis. BMC Health Services Research, 15, 415-426.

15. Goncharuk, A. G. (2017). Socioeconomic Criteria of Healthcare Efficiency: An International Comparison. Journal of Applied Management and Investments, 6(2), 89-95.

16. Goncharuk, A. G., Getman, M. (2014). Benchmarking to improve a strategy and marketing in pharmaceuticals. Benchmarking: An International Journal, 21(3), 364-385.

17. González, E., Cárcaba, A., Ventura, J. (2010). Value efficiency analysis of health systems: does public financing play a role? Journal of Public Health, 18(4), 337-350.

18. Giuffrida, A., Gravelle, H. (2001). Measuring performance in primary care: econometric analysis and DEA. Applied Economics, 33, 163-175.

19. Hadad, S., Hadad, Y., Simon-Tuval, T. (2013). Determinants of healthcare system’s efficiency in OECD countries. European Journal of Health Economics, 14, 253-265.

20. Hollingsworth, B. (2003). Non-parametric and parametric applications measuring efficiency in health care. Health Care Management Science, 6, 203-218.

21. Hollingsworth, B., Wildman, J. (2003). The efficiency of health production: re-estimating the WHO panel data using parametric and non-parametric approaches to provide additional information. Health Economics, 12, 493-504.

22. Laine, J., Linna, M., Häkkinen, U., Noro, A. (2005). Measuring the productive efficiency and clinical quality of institutional long-term care for the elderly. Health Economics, 14(3), 245-256.

23. lo Storto, C. (2016). Ecological efficiency based ranking of cities: A combined DEA cross-efficiency and Shannon’s entropy method. Sustainability, 8, 124.

24. lo Storto, C. (2017). Performance analysis of healthcare systems in European countries. Bulgarian Journal of Business Research, 2, 7-17.

25. Martini, G. M., Berta, P., Mullahy, J., Vittadini, G. (2014). The effectiveness – efficiency trade-off in health care: The case of hospitals in Lombardy, Italy. Regional Science and Urban Economics, 49, 217-231.

26. Kim, Y., Kang, M. (2014). The Measurement of Health Care System Efficiency: Cross-country Comparison by Geographical Region. The Korean Journal of Policy Studies, 29(1), 21-44.

27. Kim, Y. Oh. D., Kang, M. (2016). Productivity changes in OECD healthcare systems: bias-corrected Malmquist productivity approach. International Journal of Health Planning Management, 31, 537-553.

28. Murray, C. J. L. and Evans, D. (eds.) (2003). Health systems performance assessment: Debates, Methods and Empiricism. Geneva: World Health Organization (retrieved online from on September 10, 2017).

29. Nayar, P., Ozcan, Y. A. (2008). Data envelopment analysis comparison of hospital efficiency and quality. Journal of Medical Systems, 32(3), 193-199.

30. Nolte, E., Wait, S., McKee, M. (2006). Investing in health: benchmarking health systems. Technical report published by The Nuffield Trust, London.

31. OECD (2014). Geographic Variations in Health Care: What Do We Know and What Can Be Done to Improve Health System Performance? OECD Health Policy Studies,

32. Ozcan, Y. A. (2008). Health care benchmarking and performance evaluation: an assessment using data envelopment analysis (DEA). New York, NY: Springer.

33. Palmer, S., Torgerson, D. J. (1999). Definitions of efficiency. BMJ, 318, 1136.

34. Papanicolas, I., Smith, P. C. (eds.) (2013). Health systems performance comparison: an agenda for policy, information and research. New York, NY: Open University Press.

35. Perić, N., Hofmarcher-Holzhacker, M. M., Simon, J. (2017). Health system performance assessment landscape at the EU level: a structured synthesis of actors and actions. Archives of Public Health, 75(5), 1-10.

36. Rentzlaff-Roberts, D., Change, C. F., Robin, R. M. (2004). Technical efficiency in the use of health care resources: a comparison of OECD countries. Health Policy, 69(1), 55-72.

37. Scheel, H. (2001). Undesirable outputs in efficiency valuations. European Journal of Operational Research, 132, 400-410.

38. Spinks, J., Hollingsworth, B. (2009). Cross-country comparisons of technical efficiency of health production: a demonstration of pitfalls. Applied Economics, 41(4), 417-427.

39. Sudit, E. F. (1996). Effectiveness, Quality and Efficiency: a Management Oriented Approach. The Netherlands, Dordrecht: Kluwer Academic Publishers.

40. Tandon, A., Murray, C. J., Lauer, J. A., Evans, D. B. (2000). Measuring overall health system performance for 191 countries. Geneva: World Health Organization (retrieved online from on September 4, 2017).

41. Tchouaket, É. N., Lamarche, P. A., Goulet, L., Contandriopoulos, A. P. (2012). Health care system performance of 27 OECD countries. International Journal of Health Planning Management, 27, 104-129.

42. Tone, K. (2001). A slacks-based measure of efficiency in data envelopment analysis. European Journal of Operational Research, 130, 498-509.

43. Varabyova, Y., Schreyögg, J. (2013). International comparisons of the technical efficiency of the hospital sector: Panel data analysis of OECD countries using parametric and non-parametric approaches. Health Policy, 112, 70-79.

44. Varabyova, Y., Müller, J. M. (2016). The efficiency of health care production in OECD countries: A systematic review and meta-analysis of cross-country comparisons. Health Policy, 120, 252-263.

45. World Health Organization (2000). Health systems: Improving performance. The World Health Report.

46. World Health Organization (2010). Monitoring the building blocks of health systems: a handbook of indicators and their measurement strategies. Geneva: WHO Press.

47. World Bank (2017). Database: Health Indicators. (data retrieved on May 20, 2017).