Andrea Benedetti and Tommaso Elli
pp. 66 – 84, download
(https://doi.org/10.55612/s-5002-066-003)
Abstract
Digital technologies assist us in performing tasks in our daily lives thanks to interfaces and devices that are efficient and user-friendly, but conceal background operations that can jeopardise users’ agency and digital well-being. This paper introduces a critical and educational setting to foster designers to make hidden technology features tangible and visible through the development of speculative creative coding projects. Design research provides critical approaches to the socio-technical implications of digital technologies in relation to users’ cultures, backgrounds, and digital literacies. By discussing the results of a university course, the contribution identifies seven design strategies to de-emphasise digital efficiency and critically reflect on digital products. While the discovered techniques can support the work of educators and artists, the realisation of speculative projects supports students’ critical thinking development. It is especially valuable as similar opportunities are often rare in professional environments.
Keywords: Design education, Creative coding, Critical computing, Digital design.
References
1. Nielsen, J.: Enhancing the explanatory power of usability heuristics. In: Proceedings of the SIGCHI conference on Human factors in computing systems celebrating interdependence – CHI ’94. pp. 152–158. ACM Press, Boston, Massachusetts, United States (1994). https://doi.org/10.1145/191666.191729.
2. Nott, D.: Hidden systems: water, electricity, the internet, and the secrets we use every day. Random House Graphic, New York (2023).
3. Tubaro, P., Casilli, A.A., Coville, M.: The trainer, the verifier, the imitator: Three ways in which human platform workers support artificial intelligence. Big Data & Society. 7, 205395172091977 (2020). https://doi.org/10.1177/2053951720919776.
4. Newlands, G.: Lifting the curtain: Strategic visibility of human labour in AI-as-a-Service. Big Data & Society. 8, (2021). https://doi.org/10.1177/20539517211016026.
5. Crawford, K.: Atlas of AI: power, politics, and the planetary costs of artificial intelligence. Yale University Press, New Haven (2021).
6. Kröger, J.L., Raschke, P.: Is My Phone Listening in? On the Feasibility and Detectability of Mobile Eavesdropping. In: Foley, S.N. (ed.) Data and Applications Security and Privacy XXXIII. pp. 102–120. Springer International Publishing, Cham (2019). https://doi.org/10.1007/978-3-030-22479-0_6.
7. Agre, P.E.: Toward a Critical Technical Practice: Lessons Learned in Trying to Reform AI. In: Social Science, Technical Systems, and Cooperative Work. Psychology Press (1998).
8. Bardzell, J., Bardzell, S.: What is “critical” about critical design? In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. pp. 3297–3306. ACM, Paris France (2013). https://doi.org/10.1145/2470654.2466451.
9. Cox, A.L., Gould, S.J.J., Cecchinato, M.E., Iacovides, I., Renfree, I.: Design Frictions for Mindful Interactions: The Case for Microboundaries. In: Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems. pp. 1389–1397. ACM, San Jose California USA (2016). https://doi.org/10.1145/2851581.2892410.
10. Maeda, J.: Creative code. Thames & Hudson, New York, N.Y (2004).
11. Benedetti, A., Elli, T., Mauri, M.: “Drawing With Code”: the Experience of Teaching Creative Coding as a Skill for Communication Designers. In: 12th International Conference on Education and New Learning Technologies. pp. 3478–3488, Online Conference (2020). https://doi.org/10.21125/edulearn.2020.0982.
12. Shiffman, D.: The nature of code. Selbstverl., s.l. (2012).
13. Bohnacker, H., Gross, B., Laub, J., Lazzeroni, C., Frohling, M.: Generative design: visualize, program, and create with JavaScript in p5.js. Princeton Architectural Press, New York (2018).
14. Offenhuber, D., Mountford, J.: Reconsidering Representation in College Design Curricula. She Ji: The Journal of Design, Economics, and Innovation. 9, 264–282 (2023). https://doi.org/10.1016/j.sheji.2023.04.005.
15. Ko, A.J., Beitlers, A., Wortzman, B., Davidson, M., Oleson, A., Kirdani-Ryan, M., Druga, S., Eversone, J.: Critically Conscious Computing: Methods for Secondary Education. (2024).
16. Freire, P.: Pedagogy of Freedom: Ethics, Democracy, and Civic Courage. Rowman & Littlefield (1998).
17. Guzdial, M.: Designing Computing Education Courses for Liberal Arts and Science Students. In: Proceedings of the 27th ACM Conference on on Innovation and Technology in Computer Science Education Vol. 2. p. 614. Association for Computing Machinery, New York, NY, USA (2022). https://doi.org/10.1145/3502717.3532129.
18. Kafai, Y., Jayathirtha, G., Shaw, M., Morales-Navarro, L.: CodeQuilt: Designing an Hour of Code Activity for Creative and Critical Engagement with Computing. In: Proceedings of the 20th Annual ACM Interaction Design and Children Conference. pp. 573–576. Association for Computing Machinery, New York, NY, USA (2021). https://doi.org/10.1145/3459990.3465187.
19. Kafai, Y., Proctor, C., Lui, D.: From Theory Bias to Theory Dialogue: Embracing Cognitive, Situated, and Critical Framings of Computational Thinking in K-12 CS Education. In: Proceedings of the 2019 ACM Conference on International Computing Education Research. pp. 101–109. Association for Computing Machinery, New York, NY, USA (2019). https://doi.org/10.1145/3291279.3339400.
20. Lee, C., Soep, E.: Beyond Coding: Using Critical Computational Literacy to Transform Tech. (2018). https://doi.org/10.15781/T24J0BF37.
21. Lee, C., Soep, E.: None But Ourselves Can Free Our Minds: Critical Computational Literacy as a Pedagogy of Resistance. Equity & Excellence in Education. 49, 480–492 (2016). https://doi.org/10.1080/10665684.2016.1227157.
22. Morales-Navarro, L., Kafai, Y.B., Gregory, K.T.: Is Computational Empowerment Promoted in the Hour of Code? Analyzing Opportunities for Conceptual, Creative, and Critical Engagement in the Design of Introductory Computing Activities. Presented at the ACM International Conference Proceeding Series (2022). https://doi.org/10.1145/3564721.3565949.
23. Wang, N., Wang, X., Su, Y.-S.: Critical analysis of the technological affordances, challenges and future directions of Generative AI in education: a systematic review. Asia Pacific Journal of Education. (2024). https://doi.org/10.1080/02188791.2024.2305156.
24. Vogel, S.: “Los Programadores Debieron Pensarse Como Dos Veces”: Exploring the Intersections of Language, Power, and Technology with Bi/Multilingual Students. ACM Trans. Comput. Educ. 21, 28:1-28:25 (2021). https://doi.org/10.1145/3447379.
25. MacDowell, P., Ralph, R., Ng, D.: App Making for Pro-Social and Environmental Change at an Equity-Oriented Makeathon. In: Proceedings of the 7th Annual Conference on Creativity and Fabrication in Education. pp. 1–8. ACM, Stanford CA USA (2017). https://doi.org/10.1145/3141798.3141806.
26. Papavlasopoulou, S., Sharma, K., Giannakos, M.N.: Coding activities for children: Coupling eye-tracking with qualitative data to investigate gender differences. Computers in Human Behavior. 105, 105939 (2020). https://doi.org/10.1016/j.chb.2019.03.003.
27. Sáez-López, J.-M., Miyata, Y., Domínguez-Garrido, M.-C.: Creative Coding and Intercultural Projects in Higher Education: a Case Study in Three Universities / Codificación creativa y proyectos interculturales en Educación Superior: Un estudio de caso en tres universidades. RIED. 19, 145 (2016). https://doi.org/10.5944/ried.19.2.15796.
28. Dufva, T.: Creative Coding at the arts and crafts school Robotti (Käsityökoulu Robotti). Presented at the CEUR Workshop Proceedings (2018).
29. McCarthy, L., Reas, C., Fry, B.: Getting started with p5.js: making interactive graphics in JavaScript and Processing. Maker Media, Inc., San Francisco, CA (2015).
30. Shor, I.: Education is Politics: Paulo Freire’s critical pedagogy. In: Paulo Freire. Routledge (1992).
31. Hallnäs, L., Redström, J.: From use to presence: on the expressions and aesthetics of everyday computational things. ACM Trans. Comput.-Hum. Interact. 9, 106–124 (2002). https://doi.org/10.1145/513665.513668.
32. Bijker, W.E., Hughes, T.P., Pinch, T.J. eds: The social construction of technological systems: new directions in the sociology and history of technology. MIT Press, Cambridge, Mass. (2012).
33. Hallnäs, L., Redström, J.: Slow Technology – Designing for Reflection. Personal Ub Comp. 5, 201–212 (2001). https://doi.org/10.1007/PL00000019.
34. Pierce, J., Paulos, E.: Counterfunctional things: exploring possibilities in designing digital limitations. In: Proceedings of the 2014 conference on Designing interactive systems. pp. 375–384. ACM, Vancouver BC Canada (2014). https://doi.org/10.1145/2598510.2598522.
35. Benford, S., Greenhalgh, C., Giannachi, G., Walker, B., Marshall, J., Rodden, T.: Uncomfortable interactions. In: Proceedings of the 2012 ACM annual conference on Human Factors in Computing Systems – CHI ’12. p. 2005. ACM Press, Austin, Texas, USA (2012). https://doi.org/10.1145/2207676.2208347.
36. Gray, C.M., Chivukula, S.S., Lee, A.: What Kind of Work Do “Asshole Designers” Create? Describing Properties of Ethical Concern on Reddit. In: Proceedings of the 2020 ACM Designing Interactive Systems Conference. pp. 61–73. ACM, Eindhoven Netherlands (2020). https://doi.org/10.1145/3357236.3395486.
37. Gray, C.M., Kou, Y., Battles, B., Hoggatt, J., Toombs, A.L.: The Dark (Patterns) Side of UX Design. In: Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. pp. 1–14. ACM, Montreal QC Canada (2018). https://doi.org/10.1145/3173574.3174108.
38. Mathur, A., Kshirsagar, M., Mayer, J.: What Makes a Dark Pattern… Dark?: Design Attributes, Normative Considerations, and Measurement Methods. In: Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. pp. 1–18. ACM, Yokohama Japan (2021). https://doi.org/10.1145/3411764.3445610.
39. Gould, S.J.J., Chuang, L.L., Iacovides, I., Garaialde, D., Cecchinato, M.E., Cowan, B.R., Cox, A.L.: A Special Interest Group on Designed and Engineered Friction in Interaction. In: Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems. pp. 1–4. ACM, Yokohama Japan (2021). https://doi.org/10.1145/3411763.3450404.
40. Özkar, M.: Learning by Doing in the Age of Design Computation. In: Dong, A., Moere, A.V., and Gero, J.S. (eds.) Computer-Aided Architectural Design Futures (CAADFutures) 2007. pp. 99–112. Springer Netherlands, Dordrecht (2007). https://doi.org/10.1007/978-1-4020-6528-6_8.
41. Lodato, T.J., DiSalvo, C.: Issue-oriented hackathons as material participation. New Media & Society. 18, 539–557 (2016). https://doi.org/10.1177/1461444816629467.
42. Pater, R.: Caps Lock: how capitalism took hold of graphic design and how to escape from it. Valiz, Amsterdam (2021).
43. Sculley, D., Holt, G., Golovin, D., Davydov, E., Phillips, T., Ebner, D., Chaudhary, V., Young, M., Crespo, J.-F., Dennison, D.: Hidden Technical Debt in Machine Learning Systems. In: Proceedings of the 28th International Conference on Neural Information Processing Systems (2015). https://doi.org/10.5555/2969442.2969519.