(https://doi.org/10.55612/s-5002-057-010)
Abstract
The article describes how a series of adaptions enabled us to carry out a controlled intervention study in 15 preschools, with 420 children and about 40 preschool teachers, during the Covid‑19 pandemic restrictions. The original overarching aim of the study was to develop and evaluate an early math intervention supporting children from low-SES environments to develop basic mathematical skills. The two main research questions addressed preschool children’s early math development using a digital play-&-learn game (anonymized), and the pedagogical impact of an integrated teacher resources package. Four guiding principles complemented the research questions: accumulation of new knowledge, collaboration & participatory design, experimental control & ecological validity, and real-world applicability. The focus of this article is on how data collections methods and analyses were adapted to handle the constraints induced by Covid‑19 without deviating from the original research questions and the four guiding principles. The adaptions clearly entailed methodological limitations. Yet the study demonstrates the possibility to conduct a remotely controlled effect study encompassing both ecological validity and real-world applicability
Keywords: early math, low-SES, educational software, preschool, collaboration and participatory design, experimental control and ecological validity, Covid‑19 and methodological adaptations.
References
1. Gulz, A., & Haake, M.: No child left behind, nor singled out: Is it possible to combine adaptive instruction and inclusive pedagogy in early math software? SN Social Sciences, 1, Article 203. (2021) https://doi.org/10.1007/s43545-021-00205-7
2. Gulz, A., Londos, L., & Haake, M.: Preschoolers’ understanding of a teachable agent-based game in early mathematics as reflected in their gaze behaviors – an experimental study. International Journal of Artificial Intelligence in Education, 30, pp. 38–73 (2020). https://doi.org/10.1007/s40593-020-00193-4
3. Husain, L., Gulz, A., & Haake, M.: Supporting early math-rationales and requirements for high quality software. Journal of Computers in Mathematics and Science Teaching, 34(4), pp. 409–429. (2015) https://www.learntechlib.org/primary/p/149820/
4. Clements, D. H., Sarama, J., & Germeroth, C.: Learning executive function and early mathematics: Directions of causal relations. Early Childhood Research Quarterly, 36, pp. 79 — 90 (2016) https://doi.org/10.1016/j.ecresq.2015.12.009
5. ten Braak, D., Lenes, R., Purpura, D. J., Schmitt, S. A., & Størksen, I.: Why do early mathematics skills predict later mathematics and reading achievement? The role of executive function. Journal of Experimental Child Psychology, 214, Article 105306 (2022) https://doi.org/10.1016/j.jecp.2021.105306
6. Clements, D. H., & Sarama, J.: Myths of early math. Education Sciences, 8(2), Article 71 (2018) https://doi.org/10.3390/educsci8020071
7. Tymms, P., Jones, P., Albone, S., & Henderson, B.: The first seven years at school. Educational Assessment, Evaluation and Accountability, 21, pp. 67–80 (2009) https://doi.org/10.1007/s11092-008-9066-7
8. Palmer, H.: Hur blir man matematisk? Att skapa nya relationer till matematik och genus i arbetet med yngre barn. Liber. (2011)
9. Schacter, J., & Jo, B.: Improving preschoolers’ mathematics achievement with tablets: A randomized controlled trial. Mathematics Education Research Journal, 29(3), pp. 313–327 (2017). https://doi.org/10.1007/s13394-017-0203-9
10. Jordan, N. C., Glutting, J., Dyson, N., Hassinger-Das, B., & Irwin, C.: Building kindergartners’ number sense: A randomized controlled study. Journal of Educational Psychology, 104(3), pp. 647– 660 (2012b) https://doi.org/10.1037/a0029018
11. Desoete, A., Ceulemans, A., De Weerdt, F., & Pieters, S.: Can we predict mathematical learning disabilities from symbolic and non‐symbolic comparison tasks in kindergarten? Findings from a longitudinal study. British Journal of Educational Psychology, 82(1), pp. 64 — 81 (2012) https://doi.org/10.1348/2044-8279.002002
12. Jordan, N. C., Kaplan, D., Ramineni, C., & Locuniak, M. N.: Early math matters: kindergarten number competence and later mathematics outcomes. Developmental psychology, 45(3), pp. 850–867 (2009) https://doi.org/10.1037/a0014939
13. Hannula, M. M., Lepola, J., & Lehtinen, E.: Spontaneous focusing on numerosity as a domain-specific predictor of arithmetical skills. Journal of Experimental Child Psychology, 107(4), pp. 394–406 (2010) https://doi.org/10.1016/j.jecp.2010.06.004
14. Bullough, R. V., Jr., Hall-Kenyon, K. M., MacKay, K. L., & Marshall, E. E.: Head start and the intensification of teaching in early childhood education. Teaching and Teacher Education, 37, pp. 55–63 (2014) https://doi.org/10.1016/j.tate.2013.09.006
15. Clements, D. H., Sarama, J., Spitler, M. E., Lange, A. A., & Wolfe, C. B.: Mathematics learned by young children in an intervention based on learning trajectories: A large-scale cluster randomized trial. Journal for Research in Mathematics Education, 42(2), pp. 127–166 (2011). https://doi.org/10.5951/jresematheduc.42.2.0127
16. Greenes, C., Ginsburg, H. P., & Balfanz, R.: Big math for little kids. Early Childhood Research Quarterly, 19(1), pp. 159–166 (2004). https://doi.org/10.1016/j.ecresq.2004.01.010
17. Ramani, G. B., & Siegler, R. S.: Reducing the gap in numerical knowledge between low-and middle-income preschoolers. Journal of Applied Developmental Psychology, 32(3), pp. 146–159 (2011). https://doi.org/10.1016/j.appdev.2011.02.005
18. Ramey, C. T., & Ramey, S. L.: Early intervention and early experience. American psychologist, 53(2), pp. 109–120 (1998). https://doi.org/10.1037/0003-066X.53.2.109
19. Mononen, R., Aunio, P., Koponen, T., & Aro, M.: A review of early numeracy interventions for children at risk in mathematics. International Journal of Early Childhood Special Education, 6(1), pp. 25–54 (2014). https://doi.org/10.20489/intjecse.14355
20. Haake, M., Husain, L., Anderberg, E., & Gulz, A.: No child behind nor singled out? Adaptive instruction combined with inclusive pedagogy in early math software. In C. Conati, N. Heffernan, A. Mitrovic, & M.F. Verdejo (Eds.), Lecture notes in computer science: Vol. 9112. Artificial intelligence in education, Vol. 9122, pp. 612—615 (2015). Springer. https://doi.org/10.1007/978-3-319-19773-9_74
21. Bødker, K., Kensing, F., & Simonsen, J.: Participatory IT design: Designing for business and workplace realities. The MIT Press. (2009)
22 Simonsen, J., & Robertson, T. (Eds.): Routledge international handbook of participatory design. Routledge. (2013)
23. Spinuzzi, C.:The methodology of participatory design. Technical communication, 52(2), pp. 163–174 (2005)
24. Ginsburg, H. P., & Baroody, A. J. (2003). Test of early mathematics ability (3rd ed.). Pro-Ed. (2003)
25. Jordan, N. C., Glutting, J. J., & Dyson, N.: Number Sense Screener (NSS) user’s guide, K–1 (research edition). Brookes. (2012a) https://brookespublishing.com/product/nss/
26. ten Braak, D., & Størksen, I.: Psychometric properties of the Ani Banani Math test. European Journal of Developmental Psychology, 18(4), pp. 610–628 (2021) https://doi.org/10.1080/17405629.2021.1879046
27. Cameron Ponitz, C. E., McClelland, M. M., Jewkes, A. M., Connor, C. M., Farris, C. L., & Morrison, F. J.: Touch your toes! Developing a direct measure of behavioral regulation in early childhood. Early Childhood Research Quarterly, 23(2), pp. 141–158 (2008) https://doi.org/10.1016/j.ecresq.2007.01.00
28. McClelland, M. M., Cameron, C. E., Duncan, R., Bowles, R. P., Acock, A. C., Miao, A., & Pratt, M. E.: Predictors of early growth in academic achievement: The head-toes-knees-shoulders task. Frontiers in psychology, 5, Article 599 (2014) https://doi.org/10.3389/fpsyg.2014.00599
29. Zelazo, P. D., & Bauer, P. J. (Eds.): National Institutes of Health Toolbox cognition battery (NIH Toolbox CB): Validation for children between 3 and 15 years. Wiley-Blackwell (2013)
30. Dunn, L.M., & Dunn, D.M. PPVT-4: The Peabody Picture Vocabulary Test (4th ed.). Pearson Assessments (2007) https://www.pearsonassessments.com
31. Haake, M., Axelsson, A., Clausen-Bruun, M., & Gulz, A.: Scaffolding mentalizing via a play-&-learn game for preschoolers. Computers & Education, 90, pp. 13–23 (2015). https://doi.org/10.1016/j.compedu.2015.09.003
32. Axelsson, A., Andersson, R., & Gulz, A.: Scaffolding executive function capabilities via play-&-learn software for preschoolers. Journal of Educational Psychology, 108(7), pp. 969–981 (2016). https://doi.org/10.1037/edu0000099
33. Schwartz, D. L., Cheng, K. M., Salehi, S., & Wieman, C.: The half empty question for socio-cognitive interventions. Journal of Educational Psychology, 108(3), pp. 397–404 (2016) https://doi.org/10.1037/edu0000122
34. Gulz, A., Kjällander, S., Frankenberg, S., & Haake, M. Early math in a preschool context: Spontaneous extension of the digital into the physical. IxD&A: Interaction Design and Architecture(s), 44, pp. 129–154. (2020) https://doi.org/10.55612/s-5002-044-007