METHODS OF MEASUREMENT AND INTERVENTION IN SELF-REGULATED LEARNING. EVOLUTION AND CURRENT

Authors

  • Marcos Antonio Requena Arellano Universidad Católica Andrés Bello (Venezuela) Universidad Siglo 21 (Argentina

Abstract

Self-regulated learning (hereinafter SRL) is a growing and fruitful field of research in educational psychology. A variety of theoretical-methodological models have been validated on it, which show the complexity of the construct and the difficulty of comprehensively addressing it. This complexity and difficulty are transferred to the methods of measuring and promoting AAR in an educational context. The objective of the research was to analyze -based on the specialized literature- the methodological dimensions of the construct, that is, those referring to how it is investigated and promoted in an educational context. A qualitative documentary analysis of accredited documents on AAR research and promotion methods was carried out. It was found: a) evolution of the AAR methodological approach from decontextualized methods to methods that measure and promote the processes of the AAR in the context of its application (such as the structured diary); b) a pre-eminence of curricular methods of promoting AAR over extracurricular methods; c) rapid progress in promoting AAR through digital techniques and tools. It is concluded that the measurement and promotion of the AAR have had a shared evolution, promoted by three factors: the substitution of a static conception of the AAR for a dynamic and integral one, the triangulated integration of measurement methods with intervention methods, and the integration of technologies in learning environments and experiences.

References

Araka, E., Maina, E., Gitonga, R., & Oboko, R. (2020). Research trends in measurement and intervention tools for self-regulated learning for e-learning environments—systematic review (2008–2018). Research and Practice in Technology Enhanced Learning, 15(6), 1–21. https://doi.org/10.1186/s41039-020-00129-5

Azevedo, R., & Gaševi?, D. (2019). Analyzing Multimodal Multichannel Data about Self-Regulated Learning with Advanced Learning Technologies: Issues and Challenges. Computers in Human Behavior, 96, 207–210. https://doi.org/10.1016/j.chb.2019.03.025

Bellhäuser, H., Lösch, T., Winter, C., & Schmitz, B. (2016). Applying a web-based training to foster self-regulated learning — Effects of an intervention for large numbers of participants. Internet and Higher Education, 31, 87–100. https://doi.org/10.1016/j.iheduc.2016.07.002

Benz, B. F. (2011). Improving the Quality of Learning on the WWW: Seamless and Disruptive Metacognitive Support. In M. Mühlhäuser, W. Sesink, A. Kaminski, & A. Steimle (Eds.), IATEL - Interdisciplinary Approaches to Technology-enhanced Learning (pp. 353–368). Waxmann Velag GmbH. https://bit.ly/ImprovingQualityLearningWWW

Broadbent, J., Panadero, E., & Fuller-Tyszkiewicz, M. (2020). Effects of mobile-app learning diaries vs online training on specific self-regulated learning components. Educational Technology Research and Development, 0123456789. https://doi.org/10.1007/s11423-020-09781-6

Cáceres, P. (2003). Análisis de contenido: una alternativa metodológica alcanzable. Psicoperspectivas. Psicoperspectivas, 2(1), 53–82. https://doi.org/10.5027/psicoperspectivas-vol2-issue1-fulltext-3

Calderon-Vriesema, C., & McCaslin, M. (2020). Experience and meaning in small-group contexts: Fusing observational and self-report data to capture self and other dynamics. Frontline Learning Research, 8(3), 126–139. https://doi.org/10.14786/flr.v8i3.493

Callan, G. L., Rubenstein, L. D., Ridgley, L. M., & McCall, J. R. (2021). Measuring self-regulated learning during creative problem-solving with SRL microanalysis. Psychology of Aesthetics, Creativity, and the Arts, 15(1), 136–148. https://doi.org/10.1037/aca0000238

Chaves-Barboza, E., Trujillo-Torres, J. M., López-Núñez, J. A., & Sola-Martínez, T. (2017). Actions and achievements of self-regulated learning in personal environments. Research on students participating in the Graduate Program in Preschool Education at the University of Granada. Journal of New Approaches in Educational Research, 6(2), 135–143. https://doi.org/10.7821/naer.2017.7.236

Cho, M. H. (2012). Online student orientation in higher education: A developmental study. Educational Technology Research and Development, 60(6), 1051–1069. https://doi.org/10.1007/s11423-012-9271-4

Cho, M. H., & Cho, Y. J. (2017). Self-regulation in three types of online interaction: a scale development. Distance Education, 38(1), 70–83. https://doi.org/10.1080/01587919.2017.1299563

Cleary, T. J., & Zimmerman, B. J. (2012). A cyclical self-regulatory account of student engagement: Theoretical foundations and applications. In Handbook of Research on Student Engagement (pp. 237–257). Springer US. https://doi.org/10.1007/978-1-4614-2018-7_11

Cleary, T. J, Slemp, J., Reddy, L. A., Alperin, A., Lui, A., Austin, A., & Cedar, T. (2020). Characteristics and Uses of SRL Microanalysis across Diverse Contexts, Tasks, and Populations: A Systematic Review. School Psychology Review, 1–21. https://doi.org/10.1080/2372966X.2020.1862627

de Bruijn-Smolders, M., Timmers, C. F., Gawke, J. C. L., Schoonman, W., & Born, M. P. (2016). Effective self-regulatory processes in higher education: research findings and future directions. A systematic review. Studies in Higher Education, 41(1), 139–158. https://doi.org/10.1080/03075079.2014.915302

De Silva, D. (2020). Developing self-regulated learning skills in university students studying in the open and distance learning environment using the KWL method. Journal of Learning for Development, 7(2), 204–217. http://oasis.col.org/handle/11599/3643

Dignath, C., & Veenman, M. V. J. (2020). The Role of Direct Strategy Instruction and Indirect Activation of Self-Regulated Learning—Evidence from Classroom Observation Studies. Educational Psychology Review, 33, 1–45. https://doi.org/10.1007/s10648-020-09534-0

Dindar, M., Malmberg, J., Järvelä, S., Haataja, E., & Kirschner, P. A. (2020). Matching self-reports with electrodermal activity data: Investigating temporal changes in self-regulated learning. Education and Information Technologies, 25(3), 1785–1802. https://doi.org/10.1007/s10639-019-10059-5

Dinsmore, D. L. (2017). Examining the ontological and epistemic assumptions of research on metacognition, self-regulation and self-regulated learning. Educational Psychology, 37(9), 1125–1153. https://doi.org/10.1080/01443410.2017.1333575

Dörrenbächer-Ulrich, L., Weißenfels, M., Russer, L., & Perels, F. (2021). Multimethod assessment of self-regulated learning in college students: different methods for different components? Instructional Science, 49(1), 137–163. https://doi.org/10.1007/s11251-020-09533-2

Egan, R., Chaplin, T., Szulewski, A., Braund, H., Cofie, N., McColl, T., Hall, A. K., Dagnone, D., Kelley, L., & Thoma, B. (2020). A case for feedback and monitoring assessment in competency-based medical education. Journal of Evaluation in Clinical Practice, 26(4), 1105–1113. https://doi.org/10.1111/jep.13338

Eitel, A., Endres, T., & Renkl, A. (2020). Self-management as a Bridge Between Cognitive Load and Self-regulated Learning: the Illustrative Case of Seductive Details. Educational Psychology Review, 32(4), 1073–1087. https://doi.org/10.1007/s10648-020-09559-5

Ericsson, K., & Simon, H. (1993). Protocol Analysis. The MIT Press.

Heirweg, S., De Smul, M., Devos, G., & Van Keer, H. (2019). Profiling upper primary school students’ self-regulated learning through self-report questionnaires and think-aloud protocol analysis. Learning and Individual Differences, 70(January), 155–168. https://doi.org/10.1016/j.lindif.2019.02.001

Hendriks, R. A., De Jong, P. G. M., Admiraal, W. F., & Reinders, M. E. J. (2020). Uncovering motivation and self-regulated learning skills in integrated medical MOOC learning: A mixed methods research protocol. BMJ Open, 10(10), 1–10. https://doi.org/10.1136/bmjopen-2020-038235

Jansen, R. S., van Leeuwen, A., Janssen, J., Conijn, R., & Kester, L. (2020). Supporting learners’ self-regulated learning in Massive Open Online Courses. Computers and Education, 146, 103771. https://doi.org/10.1016/j.compedu.2019.103771

Jansen, R. S., van Leeuwen, A., Janssen, J., Jak, S., & Kester, L. (2019). Self-regulated learning partially mediates the effect of self-regulated learning interventions on achievement in higher education: A meta-analysis. Educational Research Review, 28. https://doi.org/10.1016/j.edurev.2019.100292

Järvelä, S., Kirschner, P. A., Panadero, E., Malmberg, J., Phielix, C., Jaspers, J., Koivuniemi, M., & Järvenoja, H. (2015). Enhancing socially shared regulation in collaborative learning groups: designing for CSCL regulation tools. Educational Technology Research and Development, 63(1), 125–142. https://doi.org/10.1007/s11423-014-9358-1

Järvenoja, H., Malmberg, J., Järvelä, S., Näykki, P., & Kontturi, H. (2019). Investigating students’ situation-specific emotional state and motivational goals during a learning project within one primary school classroom. Learning: Research and Practice, 5(1), 4–23. https://doi.org/10.1080/23735082.2018.1554821

Kim, K., & Moon, N. (2019). Activity index model for self-regulated learning with learning analysis in a TEL environment. Journal of Supercomputing, 75(4), 1971–1989. https://doi.org/10.1007/s11227-018-2446-y

Kittel, A., Kuns, R., & Seufert, T. (2021). Self-Regulation in Informal Workplace Learning. Influence of Organizational Learning Culture and Job Characteristics.pdf. Frontiers in Psychology, 12, 1–17. https://doi.org/10.3389/fpsyg.2021.643748

Klug, J., Ogrin, S., Keller, S., Ihringer, A., & Shsmith, B. (2011). A plea for self-regulated learning as a process: Modelling, measuring and intervening | Julia Klug - Academia.edu. Psychological Test and Assesment Modeling, 53(1), 51–72. http://www.psychologie-aktuell.com/fileadmin/download/ptam/1-2011_20110328/04_Klug.pdf

Lindgren, B. M., Lundman, B., & Graneheim, U. H. (2020). Abstraction and interpretation during the qualitative content analysis process. International Journal of Nursing Studies, 108. https://doi.org/10.1016/j.ijnurstu.2020.103632

Medina-Ramírez, R. I., Álamo-Arce, D., Rodriguez-Castro, F., Cecilio-Fernandes, D., Sandars, J., & Costa, M. J. (2020). Self-regulated learning microanalysis for the study of the performance of clinical examinations by physiotherapy students. BMC Medical Education, 20(1), 1–8. https://doi.org/10.1186/s12909-020-02149-7

Overton, W. F. (2015). Processes, relations and Relational-Developmental-Systems. In W. F. Overton & P. C. Molenaar (Eds.), Handbook of child psychology and developmental science. (7th ed., Vol. 1, Issue March 2015, pp. 9–62). https://doi.org/10.1002/9781118963418.childpsy102

Paans, C., Molenaar, I., Segers, E., & Verhoeven, L. (2019). Temporal variation in children’s self-regulated hypermedia learning. Computers in Human Behavior, 96, 246–258. https://doi.org/10.1016/j.chb.2018.04.002

Panadero, E. (2017). A review of self-regulated learning: Six models and four directions for research. Frontiers in Psychology, 8(APR), 1–28. https://doi.org/10.3389/fpsyg.2017.00422

Panadero, E., Klug, J., & Järvelä, S. (2015). Third wave of measurement in the self-regulated learning field: when measurement and intervention come hand in hand. Scandinavian Journal of Educational Research, 60(6), 723–735. https://doi.org/10.1080/00313831.2015.1066436

Perry, N. E., & Winne, P. H. (2006). Learning from learning kits: gStudy traces of students’ self-regulated engagements with computerized content. Educational Psychology Review, 18(3), 211–228. https://doi.org/10.1007/s10648-006-9014-3

Pintrich, P., Smith, D. A. F., Garcia, T., & Mckeachie, W. J. (1993). Reliability and Predictive Validity of the Motivated Strategies for Learning Questionnaire (Mslq). Educational and Psychological Measurement, 53(3), 801–813. https://doi.org/10.1177/0013164493053003024

Pionera, M., Degeng, I. N. S., Widiati, U., & Setyosari, P. (2020). Instructional methods and self-regulated learning in writing. International Journal of Instruction, 13(3), 43–60. https://doi.org/10.29333/iji.2020.1334a

Prinz, A., Golke, S., & Wittwer, J. (2020). To What Extent Do Situation-Model-Approach Interventions Improve Relative Metacomprehension Accuracy? Meta-Analytic Insights. Educational Psychology Review, 32(4), 917–949. https://doi.org/10.1007/s10648-020-09558-6

Requena, M. A. (2022). Caracterización y diferenciación del aprendizaje autorreguladdo. Visión compleja desde la cartografía conceptual. Parte II. Paradigma. Revista de Investigación Educativa, 43(2), 671–697. https://doi.org/10.37618/PARADIGMA.1011-2251.2022.p671-697.id1187

Rodriguez Groba, A., Vázquez Barreiros, B., Lama, M., Gewerc, A., & Mucientes, M. (2014). Using a learning analytics tool for evaluation in self-regulated learning. 2014 IEEE Frontiers in Education Conference (FIE) Proceedings, 2015-Febru(February), 2484–2491. https://doi.org/10.1109/FIE.2014.7044400

Roth, A., Ogrin, S., & Schmitz, B. (2016). Assessing self-regulated learning in higher education: a systematic literature review of self-report instruments. Educational Assessment, Evaluation and Accountability, 28(3), 225–250. https://doi.org/10.1007/s11092-015-9229-2

Sáez, F. M., Díaz, A. E., Panadero, E., & Bruna, D. V. (2018). Revisión Sistemática sobre Competencias de Autorregulación del Aprendizaje en Estudiantes Universitarios y Programas Intracurriculares para su Promoción. Formación Universitaria, 11(6), 83–98. https://doi.org/10.4067/s0718-50062018000600083

Sandars, J. (2020). Self-regulated learning: The essential factor for understanding and improving academic and clinical performance. Scientia Medica, 30(1), 1–6. https://doi.org/10.1037/aca0000238

Schmitz, B., & Wiese, B. S. (2006). New perspectives for the evaluation of training sessions in self-regulated learning: Time-series analyses of diary data. Contemporary Educational Psychology, 31(1), 64–96. https://doi.org/10.1016/j.cedpsych.2005.02.002

Schumacher, C., & Ifenthaler, D. (2021). Investigating prompts for supporting students’ self-regulation – A remaining challenge for learning analytics approaches? Internet and Higher Education, 49, 100791. https://doi.org/10.1016/j.iheduc.2020.100791

Shing, L. S., & Rameli, M. R. M. (2020). The influence of self-regulation towards academic achievement in English among Malaysian upper primary students. Universal Journal of Educational Research, 8(5 A), 1–11. https://doi.org/10.13189/ujer.2020.081901

Suhandoko, A. D. J., & Hsu, C. S. (2020). Applying self-regulated learning intervention to enhance students’ learning: A quasi-experimental approach. International Journal of Instruction, 13(3), 649–664. https://doi.org/10.29333/iji.2020.13344a

Thomas, A. O., Voils, S. A., & Childs-Kean, L. (2020). Modification of the self-regulated strategy inventory-self report for blended and team-based learning. Currents in Pharmacy Teaching and Learning, 12(9), 1093–1100. https://doi.org/10.1016/j.cptl.2020.04.021

Tosuncuoglu, I. (2019). The Interconnection of Motivation and Self Regulated Learning Among University Level EFL Students. English Language Teaching, 12(4), 105. https://doi.org/10.5539/elt.v12n4p105

van Gog, T., Hoogerheide, V., & van Harsel, M. (2020). The Role of Mental Effort in Fostering Self-Regulated Learning with Problem-Solving Tasks. Educational Psychology Review, 32, 1055–1072. https://doi.org/10.1007/s10648-020-09544-y

van Metera, P. N. (2020). Commentary: Measurement and the study of motivation and strategy use: Determining if and when self-report measures are appropriate. Frontline Learning Research, 8(3), 174–184. https://doi.org/10.14786/flr.v8i3.631

Vandevelde, S., Van Keer, H., Schellings, G., & Van Hout-Wolters, B. (2015). Using think-aloud protocol analysis to gain in-depth insights into upper primary school children’s self-regulated learning. Learning and Individual Differences, 43, 11–30. https://doi.org/10.1016/j.lindif.2015.08.027

Veenman, M. V. J., & van Cleef, D. (2019). Measuring metacognitive skills for mathematics: students’ self-reports versus on-line assessment methods. ZDM - Mathematics Education, 51(4), 691–701. https://doi.org/10.1007/s11858-018-1006-5

Wallin, P., & Adawi, T. (2018). The reflective diary as a method for the formative assessment of self-regulated learning. European Journal of Engineering Education, 43(4), 507–521. https://doi.org/10.1080/03043797.2017.1290585

Wang, Y., & Sperling, R. A. (2020). Characteristics of Effective Self-Regulated Learning Interventions in Mathematics Classrooms: A Systematic Review. Frontiers in Education, 5(May). https://doi.org/10.3389/feduc.2020.00058

Weinstein, C., Schulte, A., & Palmer, D. (1987). Learning and study strategies inventory. H & H Publishing.

Winne, P. H. (2010). Improving measurements of self-regulated learning. Educational Psychologist, 45(4), 267–276. https://doi.org/10.1080/00461520.2010.517150

Winne, P. H. (2019). Paradigmatic Dimensions of Instrumentation and Analytic Methods in Research on Self-Regulated Learning. Computers in Human Behavior, 96, 285–289. https://doi.org/10.1016/j.chb.2019.03.026

Winne, P. H., & Hadwin, A. F. (2013). nStudy: Tracing and Supporting Self-Regulated Learning in the Internet. 293–308. https://doi.org/10.1007/978-1-4419-5546-3_20

Winne, P. H., Teng, K., Chang, D., Lin, M. P. C., Marzouk, Z., Nesbit, J. C., Patzak, A., Rakovic, M., Samadi, D., & Vytasek, J. (2019). NStudy: Software for learning analytics about learning processes and self-regulated learning. Journal of Learning Analytics, 6(2), 95–106. https://doi.org/10.18608/jla.2019.62.7

Xiao, Y., & Yang, M. (2019). Formative assessment and self-regulated learning: How formative assessment supports students’ self-regulation in English language learning. System, 81, 39–49. https://doi.org/10.1016/j.system.2019.01.004

Zheng, B., Ward, A., & Stanulis, R. (2020). Self-regulated learning in a competency-based and flipped learning environment: learning strategies across achievement levels and years. Medical Education Online, 25(1). https://doi.org/10.1080/10872981.2019.1686949

Zimmerman, B. J. (2015). Self-Regulated Learning: Theories, Measures, and Outcomes. In International Encyclopedia of the Social & Behavioral Sciences: Second Edition (pp. 541–546). Elsevier Inc. https://doi.org/10.1016/B978-0-08-097086-8.26060-1

Zimmerman, B. J., & Martinez-Pons, M. (1986). Development of a Structured Interview for Assessing Student Use of Self-Regulated Learning Strategies. American Educational Research Journal, 23(4), 614–628. https://doi.org/10.3102/00028312023004614

Published

2023-07-24

Issue

Section

Artículos de Investigación