Giorgia Burzio and Venere Ferraro
pp. 222 – 260, download
(https://doi.org/10.55612/s-5002-068-008)
Abstract
In recent years significant contributions have been made to expand the research area of data physicalization. The present study presents the results of a systematic literature review and an annotated portfolio analysis that frame the current state of the field, with particular attention to its implications for interaction design discipline. It outlines key outputs, methods, and domains that support tangible engagement with data, while also identifying critical challenges such as data mapping, interaction temporality, and contextual application. The study concludes by drafting promising research trajectories and by challenging dominant paradigms of data encoding, highlighting opportunities for designing more situated, embodied, and meaningful artefacts encompassing data physicalization.
Keywords: data physicalization; interaction design; literature review; data mapping.
References
1. A. “. Pentland, «THE DATA-DRIVEN SOCIETY,» in Gravity Waves, Scientific American, a division of Nature America, Inc., October 2013, pp. 78-83. DOI: https://www.jstor.org/stable/26018109
2. J. Van Dijck, «Datafication, dataism and dataveillance: Big Data between scientific paradigm and ideology,» Surveillance & Society, vol. 12, n. 2, pp. 197-208, 2014. DOI: https://doi.org/10.24908/ss.v12i2.4776
3. N. Elmqvist, «Embodied Human-Data Interaction,» in ACM CHI 2011, 2011.
4. F. Cafaro, «Using embodied allegories to design gesture suites for human-data interaction,» in Proceedings of the 2012 ACM Conference on Ubiquitous Computing, 2012. DOI: https://doi.org/10.1145/2370216.2370309
5. H. H. T. H. D. M. J. C. Richard Mortier, «Human-Data Interaction: The Human Face of the Data-Driven Society,» arXiv preprint arXiv:1412.6159, 2014. DOI: https://doi.org/10.48550/arXiv.1412.6159
6. D. Lupton, «Feeling your data: Touch and making sense of personal digital data,» New Media & Society, vol. 19, n. 10, pp. 1599-1614, 2017. DOI: https://doi.org/10.1177/1461444817717515
7. D. Lupton, «How do data come to matter? Living and becoming with personal data,» Big Data & Society, vol. 5, n. 2, 2018. DOI: https://doi.org/10.1177/2053951718786314
8. H. Ishii e B. Ullmer, «Tangible bits: towards seamless interfaces between people, bits and atoms,» in Proceedings of the ACM SIGCHI Conference on Human factors in computing systems, 1997. DOI: https://doi.org/10.1145/258549.258715
9. P. Dourish, Where the action is: the foundations of embodied interaction, MIT press, 2001.
10. E. Hornecker e J. Buur, «Getting a grip on tangible interaction: a framework on physical space and social interaction,» in Proceedings of the SIGCHI conference on Human Factors in computing systems, 2006. DOI: https://doi.org/10.1145/1124772.1124838
11. S. Bakker, A. N. Antle e E. Van Den Hove, «Embodied metaphors in tangible interaction design,» Personal and Ubiquitous Computing, vol. 16, p. 433–449, 2011. DOI: https://doi.org/10.1007/s00779-011-0410-4
12. J. Zhao e A. Vande Moere, «Embodiment in data sculpture: a model of the physical visualization of information,» in Proceedings of the 3rd international conference on Digital Interactive Media in Entertainment and Arts, 2008. DOI: https://doi.org/10.1145/1413634.1413696
13. T. Djajadiningrat, K. Overbeeke e S. Wensveen, «But how, Donald, tell us how? On the creation of meaning in interaction design through feedforward and inherent feedback,» in Proceedings of the 4th conference on Designing interactive systems: processes, practices, methods, and techniques, 2002. DOI: https://doi.org/10.1145/778712.778752
14. J. Vermeulen, K. Luyten, E. van der Hoven e K. Coninx, «Crossing the bridge over Norman’s Gulf of Execution: revealing feedforward’s true identity,» in CHI ’13: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, DOI: 2013. https://doi.org/10.1145/2470654.2466255
15. F. Daneshzand, C. Perin, G. N. Singh, T. Losev e S. Carpendale, «Designing with Data: Supporting Design Processes in Physicalization Construction,» in TEI ’25: Proceedings of the Nineteenth International Conference on Tangible, Embedded, and Embodied Interaction, 2025. DOI: https://doi.org/10.1145/3689050.3704943
16. J. Koponen e J. Hildén, Data visualization handbook, Aalto korkeakoulusäätiö, 2019.
17. A. Kirk, Data Visualisation : A Handbook for Data Driven Design, Sage Publications, 2019, p. 31.
18. R. Kosara, «Visualization criticism-the missing link between information visualization and art,» in 11th International Conference Information Visualization (IV’07), 2007. DOI: 10.1109/IV.2007.130
19. F. Papini, F. Valsecchi e M. Mauri, «From the Cloud to the Ground. A Data-Driven Research to Build Informative Heritage about Data Centres Energy Footprint,» PAD, vol. 17, pp. 307-328, 2024. DOI: https://dx.doi.org/10.5281/zenodo.13762745
20. U. Hahn e P. Berkers, «Visualizing Climate Change: An Exploratory Study of the Effectiveness of Artistic Information Visualizations,» World Art, vol. 11, n. 1, pp. 95-119, 2021. DOI: https://doi.org/10.1080/21500894.2020.1769718
21. R. E. Roth, «Visual variables,» International encyclopedia of geography: People, the earth, environment and technology, pp. 1-11, 2017. DOI: 10.1002/9781118786352.wbieg0761
22. W. Willett, Y. Jansen e P. Dragicevic, «Embedded data representations,» IEEE Transactions on Visualization and Computer Graphics, vol. 23, n. 1, pp. 461 – 470, 2017. DOI: 10.1109/TVCG.2016.2598608
23. D. Offenhuber, «What we talk about when we talk about data physicality,» IEEE Computer Graphics and Applications, vol. 40, n. 6, pp. 25-37, 2020. DOI: 10.1109/MCG.2020.3024146
24. R. Sosa, V. Gerrard, A. Esparza, R. Torres e R. Napper, «Data objects: Design principles for data physicalisation,» in 15th International Design Conference, DESIGN 2018 , 2018. DOI: https://doi.org/10.21278/idc.2018.0125
25. M. Karyda, E. D. Mekler e A. Lucero, «Data agents: Promoting reflection through meaningful representations of personal data in everyday life,» in Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems, 2021. DOI: https://doi.org/10.1145/3411764.3445112
26. G. Burzio e V. Ferraro, «CLARIFYING DEFINITIONS: A SCOPING REVIEW OF DATA PHYSICALIZATION IN HUMAN-COMPUTER INTERACTION,» in 18th Multi Conference on Computer Science and Information Systems, 2024.
27. D. Moher, A. Liberati, J. Tetzlaff e A. D. G., «Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement,» BMJ, 2009. DOI: https://doi.org/10.1136/bmj.b2535
28. Y. Jansen, P. Dragicevic, P. Isenberg, J. Alexander, K. Abhijit, J. Kindal, S. Subramanian e K. Hornbaek, «Opportunities and Challenges for Data Physicalization,» in CHI ’15: Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, 2015. DOI: https://doi.org/10.1145/2702123.2702180
29. S. S. Bae, C. Zheng, M. E. West, E. Y.-L. Do, S. Huron e D. Albers Szafir, «Making Data Tangible: A Cross-disciplinary Design Space for Data Physicalization,» in CHI ’22: Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems, 2022. DOI: https://doi.org/10.1145/3491102.3501939
30. B. Gaver e J. Bowers, «Annotated portfolios,» interactions, vol. 19, n. 4, pp. 40-49, 2012. DOI: 10.1145/2212877.2212889
31. Y. Wang, M. Xiaojuan, L. Qiong e Q. Huamin, «Data Edibilization: Representing Data with Food,» in Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems, 2016. DOI: https://doi.org/10.1145/2851581.2892570
32. H. G. Kaper, E. Wiebel e S. Tipei, «Data sonification and sound visualization,» Computing in science & engineering, vol. 1, n. 4, pp. 48-58, 1999. DOI: 10.1109/5992.774840
33. Paneels, Sabrina e J. C. Roberts, «Review of designs for haptic data visualization,» IEEE Transactions on Haptics, vol. 3, n. 2, pp. 119-137, 2009. DOI: 10.1109/TOH.2009.44
34. N. Bressa, H. Korsgaard, A. Tabard, S. Houben e J. Vermeulen, «What’s the Situation with Situated Visualization? A Survey and Perspectives on Situatedness,» IEEE Transactions on Visualization and Computer Graphics, vol. 28, n. 1, pp. 107-117, 2021. DOI: 10.1109/TVCG.2021.3114835
35. D. Offenhuber, «Data by proxy—material traces as autographic visualizations,» IEEE transactions on visualization and computer graphics, vol. 26, n. 1, pp. 98-108, 2019. DOI: 10.1109/TVCG.2019.2934788
36. K. Barad, Meeting the universe halfway: Quantum physics and the entanglement of matter and meaning, duke university Press, 2007.
37. P. Sanches, N. Howell, V. Tsaknaki, T. Jenkins e K. Helms, «Diffraction-in-action: Designerly Explorations of Agential Realism Through Lived Data,» in CHI ’22: Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems, 2022. DOI: https://doi.org/10.1145/3491102.3502029
38. W. Gaver e A. Boucher, «Designing with data: an annotated portfolio,» ACM Transactions on Computer-Human Interaction, vol. 31, n. 6, pp. 1-25, 2024. DOI: https://doi.org/10.1145/3685272
39. P. Dragicevic, Y. Jansen e A. Vande Moere, «Data physicalization,» Handbook of human computer interaction, pp. 1-51, 2021. DOI: https://doi.org/10.1007/978-3-319-27648-9_94-1
40. M. Karyda, D. Wilde e M. G. Kjærsgaard, «Narrative physicalization: Supporting interactive engagement with personal data,» IEEE Computer Graphics and Applications, vol. 41, n. 1, pp. 74-86, 2020. DOI: 10.1109/MCG.2020.3025078
41. L. Derry, «Data embodiment: approaching the body as a choreographic medium for performing abstract data,» International Journal of Performance Arts and Digital Media, vol. 19, n. 1, pp. 60-82, 2023. DOI: https://doi.org/10.1080/14794713.2023.2175105
42. K. von Ompteda, «Data manifestation: merging the human world & global climate change,» IEEE VIS Arts Program (VISAP), pp. 1-8, 2019. DOI: 10.1109/VISAP.2019.8900829
43. C. Starrett, S. Reiser e T. Pacio, «Data materialization: a hybrid process of crafting a teapot,» ACM SIGGRAPH 2018 Art Gallery, pp. 381-385, 2018. DOI: https://doi.org/10.1145/3202918.3203087
44. A. Desjardins e T. Tihanyi, «ListeningCups: A case of data tactility and data stories,» in Proceedings of the 2019 on designing interactive systems conference, 2019. DOI: https://doi.org/10.1145/3322276.3323694
45. T. Hogan e E. Hornecker, «How does representation modality affect user-experience of data artefacts?,» in Haptic and Audio Interaction Design: 7th International Conference, HAID, 2012. DOI: https://doi.org/10.1007/978-3-642-32796-4_15
46. B. Signer, P. Ebrahimi, T. J. Curtin e A. K. Abdullah, «Towards a Framework for Dynamic Data Physicalisation,» in Proceedings of the International Workshop Toward a Design Language for Data Physicalization, 2018.
47. V. F. Queiroz, D. H. Dos Santos, T. A. Soares De Sousa, W. C. Monteiro, T. D. Oliveira De Araújo e B. S. Meiguins, «Adding Visual Data and Interactions for Dynamic Data Physicalization with Augmented Reality,» in 2023 27th International Conference Information Visualisation (IV), 2023. DOI: 10.1109/IV60283.2023.00022
48. K. Sauvé, M. Sturdee e S. Houben, «Physecology: a conceptual framework to describe data physicalizations in their real-world context,» ACM Transactions on Computer-Human Interaction, vol. 29, n. 3, pp. 1-33, 2022. DOI: https://doi.org/10.1145/3505590
49. A. Veldhuis, R.-H. Liang e T. Bekker, «CoDa: Collaborative data interpretation through an interactive tangible scatterplot,» in Proceedings of the Fourteenth International Conference on Tangible, Embedded, and Embodied Interaction, 2020. DOI: https://doi.org/10.1145/3374920.3374934
50. C. Perin, «What students learn with personal data physicalization,» IEEE Computer Graphics and Applications, vol. 41, n. 6, pp. 48-58, 2021. DOI: 10.1109/MCG.2021.3115417
51. L. Jones, G. Grip, B. Kourtoukov, V. Guljajeva, M. C. Sola e S. Nabil, «Knitting Interactive Spaces: Fabricating Data Physicalizations of Local Community Visitors with Circular Knitting Machines,» in TEI ’24: Proceedings of the Eighteenth International Conference on Tangible, Embedded, and Embodied Interaction, 2024. DOI: https://doi.org/10.1145/3623509.3633359
52. M. Moretti e A. Mattozzi, «Participatory data physicalization: A new space to inform,» in Proceedings of the 2nd International and Interdisciplinary Conference on Image and Imagination: IMG 2019, 2020. DOI: https://doi.org/10.1007/978-3-030-41018-6_86
53. M. Guo, J. Hu e S. Vos, «TIDAL: exploring the potential of data physicalization-based interactive environment on runners’ motivation,» Journal of Ambient Intelligence and Humanised Computing , vol. 15, n. 4, pp. 2425-2438, 2024. DOI: https://doi.org/10.1007/s12652-024-04762-6
54. D. Peeters, C. Ranasinghe, A. Degbelo e F. Ahmed, «EmoClock: Communicating Real-Time Emotional States Through Data Physicalizations,» in Human-Computer Interaction – INTERACT 2023, 2023. DOI: https://doi.org/10.1007/978-3-031-42280-5_26
55. J. Pepping, S. Scholte, M. van Wijland, M. de Meij, G. Wallner e R. Bernhaupt, «Motiis: Fostering Parents’ Awareness of their Adolescents Emotional Experiences during Gaming,» in NordiCHI ’20: Proceedings of the 11th Nordic Conference on Human-Computer Interaction: Shaping Experiences, Shaping Society, 2020. DOI: https://doi.org/10.1145/3419249.3420173
56. E. Kaziunas, S. Lindtner, M. S. Ackerman e J. M. Lee, «Lived Data: Tinkering With Bodies, Code, and Care Work,» Human–Computer Interaction , vol. 33, n. 1, pp. 49-92, 2017. DOI: https://doi.org/10.1080/07370024.2017.1307749
57. L. J. Perovich, S. A. Wylie e R. Bongiovanni, «Chemicals in the Creek: designing a situated data physicalization of open government data with the community,» IEEE Transactions on Visualization and Computer Graphics, vol. 27, n. 2, pp. 913-923, 2020. DOI: 10.1109/TVCG.2020.3030472
58. J. Ebermann e M. Keck, «From Sight to Touch: Designing Tactile Data Physicalizations for Non-sighted Users,» in 2024 1st Workshop on Accessible Data Visualization (AccessViz), 2024. DOI: 10.1109/AccessViz64636.2024.00007
59. A. Everitt e J. Alexander, «PolySurface: a design approach for rapid prototyping of shape-changing displays using semi-solid surfaces,» in Proceedings of the 2017 Conference on Designing Interactive Systems, 2017. DOI: https://doi.org/10.1145/3064663.3064677
60. H. Waldschütz, E. Hornecker, L. Fischer, P. Temme, A. Alnayef, S. Shalawadi e H. Ren, «Drum Roll: A Data Physicalization of Real-Time Radiation Sensor Readings,» in DIS’ 20 Companion: Companion Publication of the 2020 ACM Designing Interactive Systems Conference, 2020. DOI: https://doi.org/10.1145/3393914.3395848
61. F. Daneshzand, C. Perin e S. Carpendale, «KiriPhys: Exploring New Data Physicalization Opportunities,» IEEE Transactions on Visualization and Computer Graphics, vol. 29, n. 1, pp. 225-235, 2023. DOI: 10.1109/TVCG.2022.3209365
62. I. Gwilt e A. Davis, «Revealing the hidden: Using a co-design approach to explore on campus energy use through the representation of consumption data,» in Proceedings of the Sixth International Conference on Design Creativity (ICDC 2020), 2020. DOI: https://doi.org/10.35199/ICDC.2020.17
63. A. Boem e H. Iwata, «It’s like holding a human heart”: the design of Vital+ Morph, a shape-changing interface for remote monitoring,» AI & SOCIETY , vol. 33, n. 4, pp. 599-619, 2018. DOI: https://doi.org/10.1007/s00146-017-0752-1
64. H. Waldschütz, R. Van Koningsbruggen e E. Hornecker, «pneuCNTRL: a Pneumatic Control System for User Studies on Dynamic, Haptic Inflatables,» in Proceedings of the Eighteenth International Conference on Tangible, Embedded, and Embodied Interaction, 2024. DOI: https://doi.org/10.1145/3623509.3635263
65. K. Den Teuling, A. Winters e M. Bruns, «Chitosan Biofilm Actuators: Humidity Responsive Materials for Sustainable Interaction Design,» in Proceedings of the Eighteenth International Conference on Tangible, Embedded, and Embodied Interaction., 2024. DOI: https://doi.org/10.1145/3623509.3635262
66. R. Kim, «DNA as Digital Data Storage: Opportunities and Challenges for HCI,» in International Conference on Human-Computer Interaction., 2020. DOI: https://doi.org/10.1007/978-3-030-60700-5_29
67. J. Wijers, H. Brombacher e S. Houben, «DataChest: a Constructive Data Physicalization Toolkit,» in Proceedings of the Eighteenth International Conference on Tangible, Embedded, and Embodied Interaction., 2024. DOI: https://doi.org/10.1145/3623509.3635252
68. Y. Jansen e P. Dragicevic, «An interaction model for visualizations beyond the desktop,» IEEE Transactions on Visualization and Computer Graphics , vol. 19, n. 12, pp. 2396-2405, 2013. DOI: 10.1109/TVCG.2013.134
69. A. L. Griffin, «Feeling it out: the use of haptic visualization for exploratory geographic analysis,» Cartographic Perspectives, pp. 12-29, 2001. DOI: https://doi.org/10.14714/CP39.636
70. C. Ranasinghe e A. Degbelo, «Encoding variables, evaluation criteria, and evaluation methods for data physicalisations: A review,» Multimodal Technologies and Interaction, vol. 7, n. 7, 2023. DOI: https://doi.org/10.3390/mti7070073
71. S. Dullaert, C. Ranasinghe, A. Degbelo e N. Bouali, «Data Physicalization with Haptic Variables: Exploring Resistance and Friction,» in CHI EA ’24: Extended Abstracts of the CHI Conference on Human Factors in Computing Systems, 2024. DOI: https://doi.org/10.1145/3613905.3651011
72. C. Baur, C. Wienrich, S. Huber e J. Hurtienne, «Image Schemas as Tools for Exploring the Design Space of Data Physicalisations,» ISD, 2023.
73. E. Hornecker, T. Hogan, U. Hinrichs e R. Van Koningsbruggen, «A Design Vocabulary for Data Physicalization,» ACM Transactions on Computer-Human Interaction, vol. 31, n. 1, pp. 1-62, 2023. DOI: https://doi.org/10.1145/3617366
74. A. Vallgårda, M. T. Winther, N. Mørch e E. E. Vizer, «Temporal form in interaction design,» International Journal of Design , vol. 9, n. 3, pp. 1-15, 2015.
75. R. Mortier, H. Haddadi, T. Henderson, D. McAuley e J. Crowcroft, «Human-Data Interaction: The Human Face of the Data-Driven Society,» arXiv preprint arXiv:1412.6159, 2014. DOI: https://doi.org/10.48550/arXiv.1412.6159
76. E. D. Mekler e K. Hornbæk, «A framework for the experience of meaning in human-computer interaction,» in Proceedings of the 2019 CHI conference on human factors in computing systems, 2019. DOI: https://doi.org/10.1145/3290605.3300455
77. P. Biedermann, J. Coenen, D. De Roeck e A. Vande Moere, «PosterTalk: Expanding Participatory Agency in Public Survey Platforms via Middle-Out Gatekeeping,» in DIS ’23: Proceedings of the 2023 ACM Designing Interactive Systems Conference, 2023. DOI: https://doi.org/10.1145/3563657.3595984