Application of DEA in benchmarking: a systematic literature review from 2003–2020

    Reza Rostamzadeh   Affiliation
    ; Omid Akbarian   Affiliation
    ; Audrius Banaitis   Affiliation
    ; Zeynab Soltani   Affiliation


Benchmarking is an effective method for organizations to increase their productivity, quality of products, reliability of processes or services. The organization may make a comparison between its performance and that of the peers from benchmarking, and recognize their advantages as well as disadvantages. The main objective of the present systematic literature review has been the study of DEA benchmarking process. Therefore, it examined and gave a summary of various DEA models applied worldwide to improve benchmarking. Accordingly, a list of published academic papers that appeared in high-ranking journals between 2003 and February 2020 was collected for a systematic review of the DEA benchmarking application. Consequently, the papers selected have been classified according to year of publication, purpose of research, outcomes and results. This study has identified eight major applications including: transportation, service sector, product planning, maintenance, hotel industry, education, distribution and environmental factors. They take up a total of 82% of all application-embedded papers. Among all the applications, the highest recent development has been in both the transportation and service sectors. Results showed higher potential of DEA as a suitable evaluation method for the further benchmarking researches, wherein the production feature between outputs and inputs has been practically lacked or very hard to obtain.

First published online 4 January 2021

Keyword : benchmarking, data envelopment analysis (DEA), systematic literature review (SLR)

How to Cite
Rostamzadeh, R., Akbarian, O., Banaitis, A., & Soltani, Z. (2021). Application of DEA in benchmarking: a systematic literature review from 2003–2020. Technological and Economic Development of Economy, 27(1), 175-222.
Published in Issue
Jan 18, 2021
Abstract Views
PDF Downloads
Creative Commons License

This work is licensed under a Creative Commons Attribution 4.0 International License.


Adler, N., Liebert, V., & Yazhemsky, E. (2013). Benchmarking airports from a managerial perspective. Omega, 41(2), 442–458.

Aires, R. F. de. F., Salgado, C. C. R., & Ayres, K. V. (2014). The PDCA cycle in practice: The experience of managing subjects of the administration course of the Federal University of Paraíba–UFPB– Campus I. International Journal of Advanced Operations Management, 6(4), 324–334.

Ajodhia, V. (2010). Integrated cost and quality benchmarking for electricity distribution using DEA. International Journal of Energy Sector Management, 4(3), 417–433.

Alosani, M. S., Al-Dhaafri, H. S., & Yusoff, R. Z. B. (2016). Mechanism of benchmarking and its impact on organizational performance. International Journal of Business and Management, 11(10), 172.

Álvarez-Rodríguez, C., Martín-Gamboa, M., & Iribarren, D. (2019). Combined use of data envelopment analysis and life cycle assessment for operational and environmental benchmarking in the service sector: A case study of grocery stores. Science of The Total Environment, 667, 799–808.

Anand, G., & Kodali, R. (2008). Benchmarking the benchmarking models. Benchmarking: An International Journal, 15(3), 257–291.

Asher, M., & Kanji, G. K. (1996). 100 methods for total quality management. Sage Publications.

Ashuri, B., Wang, J., Shahandashti, M., & Baek, M. (2019). A data envelopment analysis (DEA) model for building energy benchmarking. Journal of Engineering, Design and Technology, 17(4), 747–768.

Assaf, A. G. (2012). Benchmarking the Asia Pacific tourism industry: A Bayesian combination of DEA and stochastic frontier. Tourism Management, 33(5), 1122–1127.

Assaf, S. A., Hadidi, L. A., Hassanain, M. A., & Rezq, M. F. (2015). Performance evaluation and benchmarking for maintenance decision making units at petrochemical corporation using a DEA model. The International Journal of Advanced Manufacturing Technology, 76(9–12), 1957–1967.

Azadeh, A., Ghaderi, S., & Izadbakhsh, H. (2008). Integration of DEA and AHP with computer simulation for railway system improvement and optimization. Applied Mathematics and Computation, 195(2), 775–785.

Baek, C., & Lee, J.-d. (2009). The relevance of DEA benchmarking information and the Least-Distance Measure. Mathematical and Computer Modelling, 49(1–2), 265–275.

Barber, E. (2004). Benchmarking the management of projects: A review of current thinking. International Journal of Project Management, 22(4), 301–307.

Belton, V., & Vickers, S. P. (1993). Demystifying DEA – a visual interactive approach based on multiple criteria analysis. Journal of the Operational research Society, 44(9), 883–896.

Bogan, C. E., & English, M. J. (1994). Benchmarking for best practices: Winning through innovative adaptation. McGraw-Hill.

Boxwell Jr, R. J. (1994). Benchmarking for competitive advantage. McGraw-Hill.

Braglia, M., Zanoni, S., & Zavanella, L. (2003). Measuring and benchmarking productive systems performances using DEA: An industrial case. Production Planning & Control, 14(6), 542–554.

Brah, S. A., Lin Ong, A., & Madhu Rao, B. (2000). Understanding the benchmarking process in Singapore. International Journal of Quality & Reliability Management, 17(3), 259–275.

Camp, R. C. (1989). Benchmarking: The search for industry best practices that lead to superior performance. ASQ Quality Press.

Charnes, A., Cooper, W. W., & Rhodes, E. (1978). Measuring the efficiency of decision making units. European Journal of Operational Research, 2(6), 429–444.

Chen, H.-L. (2002). Benchmarking and quality improvement: A quality benchmarking deployment approach. International Journal of Quality & Reliability Management, 19(6), 757–773.

Chiu, S.-H., & Lin, T.-Y. (2018). Performance evaluation of taiwanese international tourist hotels: Evidence from a modified NDEA model with ICA technique. Technological and Economic Development of Economy, 24(4), 1560–1580.

Chodakowska, E., & Nazarko, J. (2017). Environmental DEA method for assessing productivity of European countries. Technological and Economic Development of Economy, 23(4), 589–607.

Cook, W. D., Ruiz, J. L., Sirvent, I., & Zhu, J. (2017). Within-group common benchmarking using DEA. European Journal of Operational Research, 256(3), 901–910.

Cook, W. D., Seiford, L. M., & Zhu, J. (2004). Models for performance benchmarking: Measuring the effect of e-business activities on banking performance. Omega, 32(4), 313–322.

Cook, W. D., & Zhu, J. (2007). Within-group common weights in DEA: An analysis of power plant efficiency. European Journal of Operational Research, 178(1), 207–216.

Das, S., & Kundu, A. (2019). Benchmarking a country for efficiency improvement: A DEA-based approach. Journal of Global Entrepreneurship Research, 9(1), 49.

De Koster, M., Balk, B., & van Nus, W. (2009). On using DEA for benchmarking container terminals. International Journal of Operations & Production Management, 29(11), 1140–1155.

Deville, A. (2009). Branch banking network assessment using DEA: A benchmarking analysis – a note. Management Accounting Research, 20(4), 252–261.

Díaz, J. R., Poyato, E. C., & Luque, R. L. (2004). Applying benchmarking and data envelopment analysis (DEA) techniques to irrigation districts in Spain. Irrigation and Drainage: The Journal of the International Commission on Irrigation and Drainage, 53(2), 135–143.

Didehkhani, H., Lotfi, F. H., & Sadi-Nezhad, S. (2019). Practical benchmarking in DEA using artificial DMUs. Journal of Industrial Engineering International, 15(2), 293–301.

Donthu, N., Hershberger, E. K., & Osmonbekov, T. (2005). Benchmarking marketing productivity using data envelopment analysis. Journal of Business Research, 58(11), 1474–1482.

Doyle, J., & Green, R. (1993). Data envelopment analysis and multiple criteria decision making. Omega, 21(6), 713–715.

Egilmez, G., & McAvoy, D. (2013). Benchmarking road safety of us states: A DEA-based Malmquist productivity index approach. Accident Analysis & Prevention, 53, 55–64.

Elmuti, D., & Kathawala, Y. (1997). An overview of benchmarking process: A tool for continuous improvement and competitive advantage. Benchmarking for Quality Management & Technology, 4(4), 229–243.

Emrouznejad, A., & Yang, G.-l. (2018). A survey and analysis of the first 40 years of scholarly literature in DEA: 1978–2016. Socio-Economic Planning Sciences, 61, 4–8.

Farrell, M. J. (1957). The measurement of productive efficiency. Journal of the Royal Statistical Society. Series A (General), 120(3), 253–290.

Fernandez, P., McCarthy, I. P., & Rakotobe‐Joel, T. (2001). An evolutionary approach to benchmarking. Benchmarking: An International Journal, 8(4), 281–305.

Gourishankar, V., & Sai Lokachari, P. (2012). Benchmarking educational development efficiencies of the Indian states: A DEA approach. International Journal of Educational Management, 26(1), 99–130.

Gouveia, M., Dias, L., Antunes, C., Boucinha, J., & Inácio, C. (2015). Benchmarking of maintenance and outage repair in an electricity distribution company using the value-based DEA method. Omega, 53, 104–114.

Heib, R., & Daneva, M. (1995). Benchmarks and benchmarking: A definitional analysis. Institute for Information System, University of Saarlandes.

Hong, S.-M., Paterson, G., Mumovic, D., & Steadman, P. (2014). Improved benchmarking comparability for energy consumption in schools. Building Research & Information, 42(1), 47–61.

Horta, I. M., Kapelko, M., Oude Lansink, A., & Camanho, A. S. (2016). The impact of internationalization and diversification on construction industry performance. International Journal of Strategic Property Management, 20(2), 172–183.

Hung Lau, K. (2012). Distribution network rationalisation through benchmarking with DEA. Benchmarking: An International Journal, 19(6), 668–689.

Jha, D. K., Yorino, N., & Zoka, Y. (2008). Benchmarking of generation and distribution units in Nepal using modified DEA models. IEEJ Transactions on Power and Energy, 128(9), 1082–1090.

Kaganova, O., & Telgarsky, J. (2018). Management of capital assets by local governments: An assessment and benchmarking survey. International Journal of Strategic Property Management, 22(2), 143–156.

Karbassi Yazdi, A., & Abdi, F. (2017). Designing robust model for banks benchmarking based on Rembrandt method and DEA. Benchmarking: An International Journal, 24(2), 431–444.

Kılkış, Ş. (2015). Composite index for benchmarking local energy systems of Mediterranean port cities. Energy, 92, 622–638.

Kumar, A., Antony, J., & Dhakar, T. S. (2006). Integrating quality function deployment and benchmarking to achieve greater profitability. Benchmarking: An International Journal, 13(3), 290–310.

Kumar, M., & Vincent, C. (2011). Benchmarking Indian banks using DEA in post-reform period: A progressive time-weighted mean approach. The Service Industries Journal, 31(14), 2455–2485.

Lai, M.-C., Huang, H.-C., & Wang, W.-K. (2011). Designing a knowledge-based system for benchmarking: A DEA approach. Knowledge-Based Systems, 24(5), 662–671.

Li, L., Su, Q., & Chen, X. (2011). Ensuring supply chain quality performance through applying the scor model. International Journal of Production Research, 49(1), 33–57.

Lim, S., Bae, H., & Lee, L. H. (2011). A study on the selection of benchmarking paths in DEA. Expert Systems with Applications, 38(6), 7665–7673.

Liu, X., Zhu, Q., Chu, J., Ji, X., & Li, X. (2019). Environmental performance and benchmarking information for coal-fired power plants in China: A DEA approach. Computational Economics, 54(4), 1287–1302.

Makui, A., Alinezhad, A., Kiani Mavi, R., & Zohrehbandian, M. (2008). A goal programming method for finding common weights in DEA with an improved discriminating power for efficiency. Journal of Industrial and Systems Engineering, 1(4), 293–303.

Mardani, A., Zavadskas, E. K., Streimikiene, D., Jusoh, A., & Khoshnoudi, M. (2017). A comprehensive review of data envelopment analysis (DEA) approach in energy efficiency. Renewable and Sustainable Energy Reviews, 70, 1298–1322.

Martín, J. C., & Román, C. (2006). A benchmarking analysis of Spanish commercial airports. A comparison between SMOP and DEA ranking methods. Networks and Spatial Economics, 6(2), 111–134.

Melo, I. C., Junior, P. N. A., Perico, A. E., Guzman, M. G. S., & Rebelatto, D. A. d. N. (2018). Benchmarking freight transportation corridors and routes with data envelopment analysis (DEA). Benchmarking: An International Journal, 25(2), 713–742.

Min, H., & Jong Joo, S. (2006). Benchmarking the operational efficiency of third party logistics providers using data envelopment analysis. Supply Chain Management: An International Journal, 11(3), 259–265.

Mishra, R. K., & Pal, S. (2017). Benchmarking Indian SMEs: A DEA approach. International Journal of Process Management and Benchmarking, 7(3), 305–331.

Mollaee, N., & Rahimi, R. (2009). New method for effective benchmarking in health, safety & environment management. Paper presented at the Proceeding Book of the Environment 2009 Seminar, Abu Dhabi.

Nasrabadi, N., Dehnokhalaji, A., Korhonen, P., & Wallenius, J. (2019). A stepwise benchmarking approach to DEA with interval scale data. Journal of the Operational Research Society, 70(6), 954–961.

Nazarko, J., & Chodakowska, E. (2017). Labour efficiency in construction industry in Europe based on frontier methods: Data envelopment analysis and stochastic frontier analysis. Journal of Civil Engineering and Management, 23(6), 787–795.

Nigam, V., Thakur, T., Sethi, V., & Singh, R. (2012). Benchmarking of Indian mobile telecom operators using DEA with sensitivity analysis. Benchmarking: An International Journal, 19(2), 219–238.

Oh, S.-C., & Shin, J. (2015). The impact of mismeasurement in performance benchmarking: A Monte Carlo comparison of SFA and DEA with different multi-period budgeting strategies. European Journal of Operational Research, 240(2), 518–527.

Papagapiou, A., Mingers, J., & Thanassoulis, E. (1997). Would you buy a used car with DEA? OR Insight, 10(1), 13–19.

Park, J., Lim, S., & Bae, H. (2012). DEA-based port efficiency improvement and stepwise benchmarking target selection. Information: An International Interdisciplinary Journal, 15, 6155–6172.

Park, J., & Sung, S.-I. (2016). Integrated approach to construction of benchmarking network in DEAbased stepwise benchmark target selection. Sustainability, 8(7), 600.

Peng Wong, W., & Yew Wong, K. (2008). A review on benchmarking of supply chain performance measures. Benchmarking: An international Journal, 15(1), 25–51.

Pickrell, S., Garnett, N., & Baldwin, J. (1997). Measuring up: A practical guide to benchmarking in construction. Construction Research Communications Watford.

Portela, M. C. A. S., Camanho, A. S., Almeida, D. Q., Lopes, L., Silva, S. N., & Castro, R. (2016). Benchmarking hospitals through a web based platform. Benchmarking: An International Journal, 23(3), 722−739.

Quaresma Dias, J. C., Garrido Azevedo, S., Ferreira, J., & Palma, S. F. (2009). A comparative benchmarking analysis of main Iberian container terminals: A DEA approach. International Journal of Shipping and Transport Logistics, 1(3), 260−275.

Radojicic, M., Savic, G., & Jeremic, V. (2018). Measuring the efficiency of banks: The bootstrapped i-distance GAR DEA approach. Technological and Economic Development of Economy, 24(4), 1581−1605.

Ramón, N., Ruiz, J. L., & Sirvent, I. (2018). Two-step benchmarking: Setting more realistically achievable targets in DEA. Expert Systems with Applications, 92, 124−131.

Ramón, N., Ruiz, J. L., & Sirvent, I. (2020). Cross-benchmarking for performance evaluation: Looking across best practices of different peer groups using DEA. Omega, 92, 102169.

Reichmann, G., & Sommersguter-Reichmann, M. (2006). University library benchmarking: An international comparison using DEA. International Journal of Production Economics, 100(1), 131−147.

Ruiz, J. L., & Sirvent, I. (2016). Common benchmarking and ranking of units with DEA. Omega, 65, 1−9.

Ruiz, J. L., & Sirvent, I. (2020). Benchmarking within a DEA framework: Setting the closest targets and identifying peer groups with the most similar performances. International Transactions in Operational Research.

Samoilenko, S., & Osei-Bryson, K.-M. (2019). A data analytic benchmarking methodology for discovering common causal structures that describe context-diverse heterogeneous groups. Expert Systems with Applications, 117, 330−344.

Sarkis, J. (2001). Benchmarking for agility. Benchmarking: An International Journal, 8(2), 88−107.

Sellitto, M. A., Pereira, G. M., Borchardt, M., Da Silva, R. I., & Viegas, C. V. (2015). A scor-based model for supply chain performance measurement: Application in the footwear industry. International Journal of Production Research, 53(16), 4917−4926.

Seol, H., Choi, J., Park, G., & Park, Y. (2007). A framework for benchmarking service process using data envelopment analysis and decision tree. Expert Systems with Applications, 32(2), 432−440.

Shabanpour, H., Yousefi, S., & Saen, R. F. (2017). Future planning for benchmarking and ranking sustainable suppliers using goal programming and robust double frontiers DEA. Transportation Research Part D: Transport and Environment, 50, 129−143.

Sharma, M. G., Debnath, R. M., Oloruntoba, R., & Sharma, S. M. (2016). Benchmarking of rail transport service performance through DEA for Indian railways. The International Journal of Logistics Management.

Sherman, H. D., & Zhu, J. (2006). Benchmarking with quality-adjusted DEA (Q-DEA) to seek lowercost high-quality service: Evidence from a U.S. bank application. Annals of Operations Research, 145(1), 301−319.

Silva, A. S., Medeiros, C. F., & Vieira, R. K. (2017). Cleaner production and PDCA cycle: Practical application for reducing the Cans Loss Index in a beverage company. Journal of Cleaner Production, 150, 324−338.

Soheilirad, S., Govindan, K., Mardani, A., Zavadskas, E. K., Nilashi, M., & Zakuan, N. (2018). Application of data envelopment analysis models in supply chain management: A systematic review and meta-analysis. Annals of Operations Research, 271(2), 915−969.

Stewart, T. J. (1994). Data envelopment analysis and multiple criteria decision making: A response. Omega, 22(2), 205−206.

Stewart, T. J. (1996). Relationships between data envelopment analysis and multicriteria decision analysis. Journal of the Operational Research Society, 47(5), 654c665.

Sufian, F. (2011a). Benchmarking the efficiency of the Korean banking sector: A DEA approach. Benchmarking: An International Journal, 18(1), 107−127.

Swanson, D. (2016). Transportation price benchmarking: Implications for firm performance. Benchmarking: An International Journal, 23(4), 1015−1026.

Trappey, A. J., & Chiang, T.-A. (2008). A DEA benchmarking methodology for project planning and management of new product development under decentralized profit-center business model. Advanced Engineering Informatics, 22(4), 438−444.

Van Eck, N. J., & Waltman, L. (2014). Visualizing bibliometric networks. In Measuring scholarly impact (pp. 285−320). Springer.

Wang, Y.-G. (2017). Benchmarking establishment for green building based on DEA and individual advantage identification. Journal of Interdisciplinary Mathematics, 20(6−7), 1459−1463.

Wong, W. P., & Wong, K. Y. (2008). A review on benchmarking of supply chain performance measures. Benchmarking, 15(1), 25−51.

Wu, H., Chen, B., Xia, Q., & Zhou, H. (2013). Ranking and benchmarking of the Asian games achievements based on DEA: The case of Guangzhou 2010. Asia-Pacific Journal of Operational Research, 30(06), 1350028.

Wu, J., Liang, L., & Song, M. (2010). Performance based clustering for benchmarking of container ports: An application of DEA and cluster analysis technique. International Journal of Computational Intelligence Systems, 3(6), 709−722.

Wu, J., Zhu, Q., Chu, J., An, Q., & Liang, L. (2016). A DEA-based approach for allocation of emission reduction tasks. International Journal of Production Research, 54(18), 5618−5633.

Wu, W.-W. (2012). An integrated solution for benchmarking using DEA, gray entropy, and Borda count. The Service Industries Journal, 32(2), 321−335.

Wu, W.-W., Lan, L. W., & Lee, Y.-T. (2013). Benchmarking hotel industry in a multi-period context with DEA approaches: A case study. Benchmarking: An International Journal, 20(2), 152−168.

Yasin, M. M. (2002). The theory and practice of benchmarking: Then and now. Benchmarking: An International Journal, 9(3), 217−243.

Yazdani, M., Wen, Z., Liao, H., Banaitis, A., & Turskis, Z. (2019). A grey combined compromise solution (CoCoSo-G) method for supplier selection in construction management. Journal of Civil Engineering and Management, 25(8), 858−874.

Yeravdekar, S., & Behl, A. (2017). Benchmarking model for management education in India: A total interpretive structural modeling approach. Benchmarking, 24(3), 666−693.

Yoshida, Y., & Fujimoto, H. (2004). Japanese-airport benchmarking with the DEA and endogenousweight TFP methods: Testing the criticism of overinvestment in Japanese regional airports. Transportation Research Part E: Logistics and Transportation Review, 40(6), 533−546.

Zhou, X., Luo, R., An, Q., Wang, S., & Lev, B. (2019). Water resource environmental carrying capacitybased reward and penalty mechanism: A DEA benchmarking approach. Journal of Cleaner Production, 229, 1294−1306.

Žižka, M., Hovorková Valentová, V., & Turčok, L. (2016). Performance evaluation of Czech innovative companies: data envelopment analysis approach. International Journal of Strategic Property Management, 20(4), 427−438.