Sustainability Measurement Scales: criteria, specificities, and basic protocol

Edson Luis Kuzma, Simone Sehnem, Marcelo Luiz Dias da Silva Gabriel, Eric David Cohen, Maciel Manoel de Queiróz

Abstract


Sustainability is an important construct for social and economic development. It requires an objective definition of measurement methods, and it helps decision makers to clarify and discern their choices. This article aims to map and to analyse the specifics of measurement scales with a scope aimed at sustainability, with a goal of advancing the study of sustainability measures. The final sample consists of 31 articles collected in order to: i) identify analytical elements regarding the specificities of the scales; ii) check its scope; iii) evaluate the reliability and validity measures used; iv) map the main limitations; and v) propose a sustainability research agenda. The study contributes by categorising and analysing the measurement process. It makes it possible to understand the stages necessary for the elaboration and validation of measurement instruments specific to this field of research.


Keywords


Sustainability; measurement scales; sustainability metrics; development of scales

Full Text:

PDF

References


Adams, R., Jeanrenaud, S., Bessant, J., Denyer, D., Overy, P., 2016. Sustainability-oriented Innovation: A Systematic Review. International Journal of Management Reviews, 18(2), 180–205. doi:10.1111/ijmr.12068

Ahmad, S., Omar, R., Quoquab, F., 2019. Corporate Sustainable Longevity: Scale Development and Validation. SAGE Open, 9(1), 215824401882237. doi:10.1177/2158244018822379

Alvarado-Herrera, A., Bigne, E., Aldas-Manzano, J., Curras-Perez, R., 2017. A Scale for Measuring Consumer Perceptions of Corporate Social Responsibility Following the Sustainable Development Paradigm. Journal of Business Ethics, 140(2), 243–262. doi:10.1007/s10551-015-2654-9

Asokan, V. A., Yarime, M., Onuki, M., 2019. A review of data-intensive approaches for sustainability: methodology, epistemology, normativity, and ontology. Sustainability Science. doi:10.1007/s11625-019-00759-9

Biasutti, M., Frate, S., 2016. A validity and reliability study of the Attitudes toward Sustainable Development scale. Environmental Education Research, 23(2), 214–230. doi:10.1080/13504622.2016.1146660

Bonett, D. G., Wright, T. A., 2014. Cronbach’s alpha reliability: Interval estimation, hypothesis testing, and sample size planning. Journal of Organizational Behavior, 36(1), 3–15. doi:10.1002/job.1960

Bonisoli, L., Galdeano-Gómez, E., Piedra-Muñoz, L., 2018. Deconstructing criteria and assessment tools to build agri-sustainability indicators and support farmers' decision-making process. Journal of Cleaner Production, 182, 1080-1094, doi: 10.1016/j.jclepro.2018.02.055.

Borsboom, D., Mellenbergh, G. J., van Heerden, J., 2004. The concept of validity. Psychological Review, 111(4), 1061- 1071.

Brink, M., Hengeveld, G. M., Tobi, H., 2020. Interdisciplinary measurement: A systematic review of the case of sustainability. Ecological Indicators, 112, 106145. doi:10.1016/j.ecolind.2020.106145

Cabrera-Nguyen, P., 2010. Author Guidelines for Reporting Scale Development and Validation Results in the Journal of the Society for Social Work and Research. Journal of the Society for Social Work and Research, 1(2), 99–103. doi:10.5243/jsswr.2010.8

Carson, R., 1962. Silent Spring. Fawcett Publications, Greenwich.

Churchill, G.A., 1991. Marketing Research: Methodological Foundation, 5th Edition, The Dryden Press, Fort Worth.

Coltman, T., Devinney, T. M., Midgley, D. F., Venaik, S., 2008. Formative versus reflective measurement models: Two applications of formative measurement. Journal of Business Research, 61(12), 1250–1262. doi:10.1016/j.jbusres.2008.01.013

Comin, L. C.; Aguiar, C. C.; Sehnem, S.; Yusliza, M.Y.; Cazella, C. F.; Julkovski, D. J., 2019. Sustainable business models: a literature review. Benchmarking: An International Journal, (), BIJ-12-2018-0384–. doi:10.1108/BIJ-12-2018-0384

Corona, B., Shen, L., Reike, D., Rosales Carreón, J., Worrell, E., 2019. Towards sustainable development through the circular economy—A review and critical assessment on current circularity metrics. Resources, Conservation and Recycling, 151, 104498. doi:10.1016/j.resconrec.2019.104498

Dabija, D.-C., Postelnicu, C., Dinu, V., Mihăilă, A., 2017. Stakeholders’ perception of sustainability orientation within a major Romanian University. International Journal of Sustainability in Higher Education, 18(4), 533–553. doi:10.1108/ijshe-10-2015-0169

Devellis, R. F., 2003. Scale Development: Theory and Applications. 2nd ed. Thousand Oaks, CA: Sage.

Elkington, J., 1997. Cannibals with Forks: The Triple Bottom Line of 21st Century Business. Capstone, Oxford.

Geissdoerfer, M., Savaget, P., Bocken, N. M. P., Hultink, E. J., 2017. The Circular Economy – A new sustainability paradigm? Journal of Cleaner Production, 143, 757–768. doi:10.1016/j.jclepro.2016.12.048

Gupta, S., Agrawal, R., 2017. Environmentally Responsible Consumption: Construct Definition, Scale Development, and Validation. Corporate Social Responsibility and Environmental Management, 25(4), 523–536. doi:10.1002/csr.1476

Haan, M., Konijn, E. A., Burgers, C., Eden, A., Brugman, B. C., Verheggen, P. P., 2018. Identifying Sustainable Population Segments Using a Multi-Domain Questionnaire. Social Marketing Quarterly, 152450041879401. doi:10.1177/1524500418794019

Hair, J.F., Black, W.C., Babin, B.J., Anderson, R.E., 2009. Multivariate Data Analysis, Pearson- Prentice Hall, Englewood Cliffs, NJ.

Haynes, S. N., Richard, D. C. S., Kubany, E. S., 1995. Content validity in psychological assessment: A functional approach to concepts and methods. Psychological Assessment, 7(3). 238-247.

Hays, J., Reinders, H., 2020. Sustainable learning and education: A curriculum for the future. International Review of Education. doi:10.1007/s11159-020-09820-7

Hinkin, T. R., 1998. A Brief Tutorial on the Development of Measures for Use in Survey Questionnaires. Organizational Research Methods, 1(1), 104–121. doi:10.1177/109442819800100106

Kannampuzha, M., Hockerts, K., 2019. Organizational social entrepreneurship: scale development and validation. Social Enterprise Journal. doi:10.1108/sej-06-2018-0047

Kapitan, S., Kennedy, A.-M., Berth, N., 2018. Sustainably superior versus greenwasher: A scale measure of B2B sustainability positioning. Industrial Marketing Management. doi:10.1016/j.indmarman.2018.08.003

Khan, E. A., Quaddus, M., 2015. Development and Validation of a Scale for Measuring Sustainability Factors of Informal Microenterprises – A Qualitative and Quantitative Approach. Entrepreneurship Research Journal, 5(4). doi:10.1515/erj-2014-0017

Kristensen, H. S., Mosgaard, M. A., 2019. A review of micro level indicators for a circular economy – moving away from the three dimensions of sustainability? Journal of Cleaner Production, 118531. doi:10.1016/j.jclepro.2019.118531

Larimian, T., Sadeghi, A., 2019. Measuring urban social sustainability: Scale development and validation. Environment and Planning B: Urban Analytics and City Science, 239980831988295. doi:10.1177/2399808319882950

Likert, R., 1932. A technique for the measurement of attitudes. Archives of Psychology, 22

, 55.

Linder, M., Boyer, R. H. W., Dahllöf, L., Vanacore, E., Hunka, A., 2020. Product-level inherent circularity and its relationship to environmental impact. Journal of Cleaner Production, 121096. doi:10.1016/j.jclepro.2020.121096

Mani, V., Agarwal, R., Gunasekaran, A., Papadopoulos, T., Dubey, R., Childe, S. J., 2016. Social sustainability in the supply chain: Construct development and measurement validation. Ecological Indicators, 71, 270–279. doi:10.1016/j.ecolind.2016.07.007

Maroco, J., Maroco, A., Campos, J., 2014. Student’s Academic Efficacy or Inefficacy? An Example on How to Evaluate the Psychometric Properties of a Measuring Instrument and Evaluate the Effects of Item Wording. Open Journal of Statistics, 4, 484-493. doi: 10.4236/ojs.2014.46046.

Meadows, D. H., Meadows, D. L., Randers, J., & Behrens, W. W. 1972. The limits to growth. New York, 102, 27.

Meiboudi, H., Lahijanian, A., Shobeiri, S. M., Jozi, S. A., Azizinezhad, R., 2017. Development and validation of sustainability criteria of administrative green schools in Iran. Journal of Environmental Management, 197, 605–609. doi:10.1016/j.jenvman.2017.04.045

Moher, D., Shamseer, L., Clarke, M., Ghersi, D., Liberati, A., … Stewart, L. A., 2015. Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015 statement. Systematic Reviews, 4(1). doi:10.1186/2046-4053-4-1

Netemeyer, R. G., Bearden, W. O., Sharma, S., 2003. Scaling procedures: Issues and applications. Sage Publications.

Nilashi, M., Rupani, P. F., Rupani, M. M., Kamyab, H., Shao, W., Ahmdi, H., … Aljojo, N., 2019. Measuring sustainability through ecological sustainability and human sustainability: A machine learning approach. Journal of Cleaner Production, 118162. doi:10.1016/j.jclepro.2019.118162

Papadas, K.-K., Avlonitis, G. J., Carrigan, M., 2017. Green marketing orientation: Conceptualization, scale development and validation. Journal of Business Research, 80, 236–246. doi:10.1016/j.jbusres.2017.05.024

Pizzi, S., Caputo, A., Corvino, A., Venturelli, A., 2020. Management research and the UN sustainable development goals (SDGs): A bibliometric investigation and systematic review. Journal of Cleaner Production, 276(), 124033–. doi:10.1016/j.jclepro.2020.124033

Pooja, S., Sagar, M., 2012. High impact scales in marketing: a mathematical equation for evaluating the impact of popular scales. Advances in Management, 5(4), 31-48.

Robertson, J. L., Barling, J., 2017. Toward a new measure of organizational environmental citizenship behavior. Journal of Business Research, 75, 57–66. doi:10.1016/j.jbusres.2017.02.007

Roca, L. C., Searcy, C., 2012. An analysis of indicators disclosed in corporate sustainability reports. Journal of cleaner production, 20(1), 103-118. doi: 10.1016/j.jclepro.2011.08.002

Secco, C., Mendes da Luz, L., Pinheiro, E., Puglieri, F. N., Piekarski, C. M., Carlos de Francisco, A., Cereja Seixas Freire, F. M., 2020. Circular economy in the pig farming chain: Proposing a model for measurement. Journal of Cleaner Production, 121003. doi:10.1016/j.jclepro.2020.121003

Sehnem, S., Vazquez-Brust, D., Pereira, S. C. F., Campos, L. M., 2019. Circular economy: benefits, impacts and overlapping. Supply Chain Management: An International Journal. doi: 10.1108/SCM-06-2018-0213

Silvestri, F., Spigarelli, F., Tassinari, M., 2020. Regional development of Circular Economy in the European Union: a multidimensional analysis. Journal of Cleaner Production, 120218. doi:10.1016/j.jclepro.2020.120218

Soo Wee, Y., Quazi, H. A., 2005. Development and validation of critical factors of environmental management. Industrial Management & Data Systems, 105(1), 96–114. doi:10.1108/02635570510575216

Stevens, S., 1946. On the Theory of Scales of Measurement. Science, 103(2684), 677-680.

Straub, D., 1989. Validating Instruments in MIS Research. MIS Quarterly, 13(2), 147. doi:10.2307/248922

Straub, D., Gefen, D., 2004. Validation Guidelines for IS Positivist Research. Communications of the Association for Information Systems, 13. doi:10.17705/1cais.01324

Taecharungroj, V., Tachapattaworakul Suksaroj, T., Rattanapan, C., 2018. The place sustainability scale: measuring residents’ perceptions of the sustainability of a town. Journal of Place Management and Development. doi:10.1108/jpmd-04-2017-0037

Tranfield, D., Denyer, D., Smart, P., 2003. Towards a Methodology for Developing Evidence-Informed Management Knowledge by Means of Systematic Review. British Journal of Management, 14(3), 207–222. doi:10.1111/1467-8551.00375

Trompenaars, F., Hampden-Turner, C., 1998. Riding the Waves of Culture. New York: McGraw-Hill. UNDP. 2001. “Human Development Reports.”

Turner, R., Zolin, R., 2012. Forecasting Success on Large Projects: Developing Reliable Scales to Predict Multiple Perspectives by Multiple Stakeholders over Multiple Time Frames. Project Management Journal, 43(5), 87–99. doi:10.1002/pmj.21289

Waltner, E.-M., Riess, W., Mischo, C., 2019. Development and Validation of an Instrument for Measuring Student Sustainability Competencies. Sustainability, 11(6), 1717. doi:10.3390/su11061717

Wang, Y.-F., 2015. Development and Validation of the Green Food and Beverage Literacy Scale. Asia Pacific Journal of Tourism Research, 21(1), 20–56. doi:10.1080/10941665.2015.1016050

Wanous, J. P., Reichers, A. E., Hudy, M. J., 1997. Overall job satisfaction: How good are single-item measures? Journal of Applied Psychology, 82(2), 247–252. doi:10.1037/0021-9010.82.2.247

WCED, 1987. World Commission on Environment and Development- Our Common Future. United Nations.

Worthington, R. L., Whittaker, T. A., 2006. Scale Development Research. The Counseling Psychologist, 34(6), 806–838. doi:10.1177/0011000006288127

Yan, J., She, Q., 2011. Developing a Trichotomy Model to Measure Socially Responsible Behaviour in China. International Journal of Market Research, 53(2), 253–274. doi:10.2501/ijmr-53-2-253-274


Refbacks

  • There are currently no refbacks.