Students’feedback literacy in higher education: an initial scale validation study

Oct 18, 2023·
Svenja Woitt
,
Joshua Weidlich
,
Ioana Jivet
,
Derya Orhan Göksun
,
Hendrik Drachsler
Marco Kalz
Marco Kalz
· 1 min read
Abstract
Given the crucial role of feedback in supporting learning in higher education, understanding the factors influencing feedback effectiveness is imperative. Student feedback literacy, that is, the set of attitudes and abilities to make sense of and utilize feedback is therefore considered a key concept. Rigorous investigations of feedback literacy require psychometrically sound measurement. To this end, the present paper reports on the development and initial validation (N= 221) of a self-report instrument. Grounded in the conceptual literature and building on previous scale validation efforts, an initial overinclusive itempool is generated. Exploratory factor analysis and the Rasch measurement model yield adequate psychometric properties of an initial scale measuring two dimensions: feedback attitudes and feedback practices with a total of 21 items. We further provide evidence for criterion-related validity. Findings are discussed in light of the emerging feedback literacy literature and avenues for further improvement of the scale are reported.
Type
Publication
Teaching in Higher Education, 0(0), 1-20. Routledge
publications publications

Woitt,S., Weidlich, J., Jivet, I., Göksün, D.O., Drachsler, H. & Kalz, M. (2023) Students’ feedback literacy in higher education: an initial scale validation study, Teaching in Higher Education, doi: https://doi.org/10.1080/13562517.2023.2263838

Feedback Literacy; Scaledevelopment; Exploratory Factor Analysis; Rasch Analysis; Higher Education
Marco Kalz
Authors
Marco Kalz
Professor of Educational Technology

I am a researcher in educational technology whose work explores how digital technologies reshape learning, teaching, and educational institutions. My research combines educational technology, learning sciences, feedback research, and critical perspectives on digital transformation.Current areas of interest include peer feedback and feedback literacy, open and networked learning, AI and misinformation in education, digital learning ecologies, and the societal implications of data-driven and platform-based education. Methodologically, my work spans empirical learning research, psychometric scale development, design-oriented research, and conceptual analyses of digital transformation in education.

I am working as a full professor of educational technology and Chief Information/Chief Digital Officer (CIO/CDO) at the Heidelberg University of Education. I serve as associate editor of the International Journal of Artificial Intelligence in Education and editorial board member of the Journal of Computing in Higher Education. I am a senior-fellow of the Interuniversity Center for Educational Sciences (ICO) and the Dutch research school on information and knowledge systems (SIKS). I work as director of the study program E-Learning and Media Education and director of the Heidelberg Centre for Digital Transformation in Education. Over the years I could secure approx. 4 Mio EUR of research funding for my institutions from competitive projects with a total budget of 36 Mio EUR. I have been an invited keynote speaker on more than 60 conferences and events. Besides European projects I am regularly involved in educational innovation and consulting projects with partners inside and outside of my institutions including clients like the International Labour Organisation, United Nations Environment Program, the European Commission, UNESCO, OECD or other international and national organizations.