Marcelo F. Maina, Lourdes Guàrdia, Federica Mancini, Carolina García
pp. 47 – 64, download
(https://doi.org/10.55612/s-5002-057-003)
Abstract
While competence-based education is gaining momentum in K-12, integration into the curriculum is still challenging. We present a Competence Assessment Model that supports creating scenarios that use several active methods for gathering learning evidence and implementing assessment rules. The study adopts a design and development research approach that spans three phases of conceptual development and model internal validation. The usability documentation method was applied to digital competence as a test case involving teachers, learning designers, and researchers across six European countries. Results confirm the model’s effectiveness for supporting competence assessment design and identify key organisational issues and teacher challenges for its adoption.
Keywords: competence assessment, assessment model, active pedagogies, pedagogy of integration, transversal competence, K-12, internal validation, digital competence.
References
1. Lüftenegger M., Finsterwald, M., Klug J., Bergsmann E., van de Schoot R., Schober B., Wagner P.: Fostering pupils’ lifelong learning competences in the classroom: evaluation of a training programme using a multivariate multilevel growth curve approach, European Journal of Developmental Psychology, 13(6), pp. 719–736 (2016). https://doi.org/10.1080/17405629.2015.1077113
2. Zadra C.: Schooling and lifelong learning. The Role of Transversal Key Competences, Procedia-Social and Behavioral Sciences, 116, pp. 4727–4731 (2014). https://doi.org/10.1016/j.sbspro.2014.01.1016
3. Organisation for Economic Co-operation and Development: Curriculum (re)design. A series of thematic reports from the OECD Education 2030 project, (2020). https://www.oecd.org/education/2030-project/contact/brochure-thematic-reports-on-curriculum-redesign.pdf
4. Organisation for Economic Co-operation and Development: Future of education and skills 2030: OECD learning compass 2030, (2019). https://www.oecd.org/education/2030-project/contact/OECD_Learning_Compass_2030_Concept_Note_Series.pdf
5. Council of the European Union: Recommendation of 22 May 2018 on key competences for lifelong learning (2018/C 189/01), Official Journal of the European Union, (2018). https://eur-lex.europa.eu/legal-content/EN/TXT/?uri=uriserv%3AOJ.C_.2018.189.01.0001.01.ENG
6. Lopez N., Patrick S., Sturgis C.: Quality and Equity by Design: Charting the Course for the Next Phase of Competency-Based Education, CompetencyWorks and iNACOL, (2017). https://tinyurl.com/53r7v2jh
7. Anderson-Levitt K.: Global flows of competence-based approaches in primary and secondary education. Cahiers de la Recherche sur L’éducation et les Savoirs, 16, pp. 47–72, (2017). https://journals.openedition.org/cres/3010
8. Evans C.M., Landl E., Thompson, J.: Making sense of K‐12 competency‐based education: A systematic literature review of implementation and outcomes research from 2000 to 2019. The Journal of Competency‐Based Education, 5(4), e01228, (2020) https://doi.org/10.1002/cbe2.1228
9. Colby R.L.: Competency-based education: A new architecture for K-12 schooling, Harvard Education Press, (2017).
10. Maina M.F., Santos-Hermosa G., Mancini F., Guàrdia Ortiz L.: Open educational practices (OEP) in the design of digital competence assessment, Distance Education, 41(2), pp. 261–278, (2020). https://doi.org/10.1080/01587919.2020.1757407
11. Richey R.C., Klein J.D.: Design and Development Research, in Handbook of Research on Educational Communications and Technology, pp. 141–150, Springer, New York, (2014). https://doi.org/10.1007/978-1-4614-3185-5_12
12. Richey R.C.: Validating Instructional Design and Development Models, in Innovations in Instructional Technology: Essays in Honor of M. David Merrill, pp. 171–185, Routledge, (2005). https://doi.org/10.4324/9781410613684
13. Laurillard D., Kennedy E., Charlton P., Wild J., Dimakopoulos, D.: Using technology to develop teachers as designers of TEL: Evaluating the learning designer, British Journal of Educational Technology, 49(6), 1044–1058, (2018). https://doi.org/10.1111/bjet.12697
14. Guitert M., Romeu T., Baztán P.: The digital competence framework for primary and secondary schools in Europe, European Journal of Education, 56(1), pp. 133–149, (2021). https://doi.org/10.1111/ejed.12430
15. Clements M.D., Cord B.A.: Assessment guiding learning: developing graduate qualities in an experiential learning programme, Assessment and Evaluation in Higher Education, 38(1), pp. 114–124, (2013). https://doi.org/10.1080/02602938.2011.609314
16. Gulikers, J., Runhaar, P, Mulder, M.: An assessment innovation as flywheel for changing teaching and learning, Journal of Vocational Education & training, 70(2), pp. 212–231, (2018). https://doi.org/10.1080/13636820.2017.1394353
17. European Commision, EU Science Hub, DigComp. https://joint-research-centre.ec.europa.eu/digcomp_en
18. Balaban, I., Sobodic, A.: From Teachers’ Perspective: Can an Online Digital Competence Certification System Be Successfully Implemented in Schools?, Applied Sciences, 12(8), 3785, (2022). https://doi.org/10.3390/app12083785
19. Torraco R.J: Writing Integrative Literature Reviews: Guidelines and Examples, Human Resource Development Review, 4(3), pp. 356–367, (2005). https://doi.org/10.1177/1534484305278283
20. Baartman L.K.J., Bastiaens T.J., Kirschner P.A., Van der Vleuten C.P.M.: Evaluating assessment quality in competence-based education: A qualitative comparison of two frameworks, Educational Research Review, 2(2), pp. 114–129, (2007). https://doi.org/10.1016/j.edurev.2007.06.001
21. Lai E.R., Viering M. Assessing 21st Century Skills: Integrating research findings, Pearson, (2012).
22. Pepper D.: KeyCoNet 2013 Literature Review: Assessment for key competences, (2013). https://tinyurl.com/2y5a5uev
23. Peyser A., Gerard F-M., Roegiers X.: Implementing pedagogy of integration: Some thoughts based on a textbook elaboration experience in Vietnam, Planning and Changing, 37(1-2), pp. 37–55, (2006). https://search.proquest.com/docview/218752253
24. Roegiers X.: La pédagogie de l’intégration: des systèmes d’éducation et de formation au cœur de nos sociétés [Pedagogy of Integration: Education and training systems at the heart of our societies], De Boeck, (2010).
25. Boukhentache S.: Operationalization of competency-based approach: From competency-based education to integration pedagogy, Arab World English Journal, 7(4), pp. 459–452, (2016). https://dx.doi.org/10.24093/awej/vol7no4.27
26. Booth A.: Searching for qualitative research for inclusion in systematic reviews: a structured methodological review, Systematic Reviews, 5, 74, (2016). https://doi.org/10.1186/s13643-016-0249-x
27. Dresch A., Lacerda D.P., Antunes, J.A.V.: Design science research: A method for science and technology advancement, Springer, (2015), https://doi.org/10.1007/978-3-319-07374-3
28. Scheopner Torres A., Brett J., Cox J.: Competency-based learning: Definitions, policies, and implementation, Education Development Center Inc., ERIC (ED573929), (2015). https://eric.ed.gov/?id=ED558117
29. Haynes E., Zeiser K., Surr W., Hauser A., Clymer L., Walston J., Yang, R.: Looking under the hood of competency-based education: The relationship between competency-based education practices and students’ learning skills, behaviors, and dispositions, American Institutes for Research, (2016). https://tinyurl.com/4rhf8y38
30. Ryan S., Cox, J.D.: Investigating student exposure to competency-based education, Education Policy Analysis Archives, 25(24), (2017). http://dx.doi.org/10.14507/epaa.25.2792
31. Scheopner Torres A., Brett J., Cox J., Geller S.: Competency Education Implementation: Examining the Influence of Contextual Forces in Three New Hampshire Secondary Schools, AERA Open, 4(2), pp. 1–13, (2018). https://doi.org/10.1177/2332858418782883
32. Stump E., Silvernail D.: Proficiency-based diploma system in Maine: Implementing district-level high school graduation policies (Phase III Report), Maine Education Policy Research Institute, University of Southern Maine, Center for Education Policy, (2015). https://digitalcommons.usm.maine.edu/cepare_proficiency/5
33. Levine E., Patrick S.: What is competency-based education? An updated definition, Aurora Institute, (2019). https://aurora-institute.org/resource/what-is-competency-based-education-an-updated-definition/
34. Sturgis C., Patrick S., Pittenger L.: It is not a Matter of Time: Highlights from the 2011 Competency-Based Learning Summit, iNACOL, ERIC (ED537332), (2011). https://eric.ed.gov/?id=ED537332
35. Patrick S., Sturgis C.: An introduction to the national Summit on K-12 Competency-Based Education, iNACOL, (2017). https://tinyurl.com/53r7v2jh
36. Brodersen R.M., Randel B.: Measuring student progress and teacher’s assessment of students’ knowledge in a competency-based education system (REL 2017-238), NCES, (2017). https://nces.ed.gov/pubsearch/pubsinfo.asp?pubid=REL2017238
37. Care E., Kim H., Vista A., Anderson K.: Education System Alignment for 21st Century Skills: Focus on Assessment, Center for Universal Education at the Brookings Institution, (2018). https://tinyurl.com/36s2p3pc
38. Evans C.M., DeMitchell T.A.: Mapping out the terrain: Northeast principals’ perceptions of the barriers and facilitators to implementing K-12 competency-based education (Policy Brief #18-02), University of New Hampshire, Education Department, (2018). https://tinyurl.com/3425f3ah
39. Evans C. M., Graham S.E., Lefebvre M.L.: Exploring K-12 Competency-Based Education Implementation in the Northeast States, NASSP Bulletin, 103(4), pp. 300–329, (2019). https://doi.org/10.1177/0192636519877456
40. Stump E., Doykos B., Fallona C.: Proficiency-based High School Diploma Systems in Maine: Local Implementation of State Standards-based Policy Phase IV Policy Report, Proficiency-Based Education, 4, (2016). https://digitalcommons.usm.maine.edu/cepare_proficiency/4
41. Pane J.F., Steiner E.D., Baird M.D., Hamilton, L.S.: Continued Progress: Promising Evidence on Personalized Learning: Executive Summary, RAND Corporation, (2015). http://www.jstor.org/stable/10.7249/j.ctt19w724m
42. Reigeluth C.M., Keller J.B.: Understanding Instruction. In Instructional-Design Theories and Models, Volume III: Building a Common Knowledge Base, pp. 27–39, Routledge, (2009). https://doi.org/10.4324/9780203872130
43. Richey R.C., Klein J.D.: Design and Development Research Methods, Strategies and Issues, Routledge, (2007). https://doi.org/10.4324/9780203826034
44. Vincenti W.G.: What Engineers Know and How They Know it (vol. 141), Johns Hopkins University Press, (1990).
45.Universitat Oberta de Catalunya, Institutional Repository O2, Project Documentation, (2020). https://openaccess.uoc.edu/handle/10609/131229
46. Digital Economy and Society Index (DESI) 2019, Human Capital Digital Inclusion and Skills, European Commission, (2019). https://digital-strategy.ec.europa.eu/en/library/digital-economy-and-society-index-desi-2019
47. Saldaña J.: The Coding Manual for Qualitative Researchers, Sage, (2013).
48. Hsieh H.F., Shannon S.E.: Three approaches to qualitative content analysis, Qualitative Health Research, 15(9), pp. 1277–1288, (2005). https://doi.org/10.1177/1049732305276687
49. De Muth J.E.: Descriptive statistics and univariate analysis. In Practical Statistics for Pharmaceutical Analysis, pp. 37–53, Springer, (2019). https://doi.org/10.1007/978-3-030-33989-0_2
50. Universitat Oberta de Catalunya, Institutional Repository O2, Acquisition, assessment and certification of students’ digital competence in primary and secondary schools, (2020). http://hdl.handle.net/10609/123446
51. Guàrdia L., Maina M., Mancini F., Martinez Melo M.: Key Quality Factors in Digital Competence Assessment: A Validation Study from Teachers’ Perspective, Applied Sciences, 13(4), 2450, (2023). https://doi.org/10.3390/app13042450