Mario Heinz-Jakobs and Carsten Röcker
pp.  144 – 169, download
(https://doi.org/10.55612/s-5002-065-005)

Abstract

The integration of digital worker assistance systems (WAS) into occupational environments holds significant promise for enhancing the workplace inclusion of people with cognitive disabilities (PwCD). However, existing systems often fail to dynamically adapt to individual user needs, limiting their effectiveness. This study investigates design opportunities for adaptive WAS through a comprehensive case study conducted in a German integrative company. The research explores the challenges faced by PwCD when using non-adaptive systems and identifies key preferences for adaptive features that cater to their unique abilities. Findings reveal a strong preference among PwCD for systems that personalize both instructional content and interaction modes. This work offers critical insights into developing inclusive adaptive technologies that foster meaningful workforce participation for PwCD, aligning with global goals of decent work for all.

Keywords: Adaptive Technology, Worker Assistance Systems, Cognitive Disabilities, Workplace Inclusion.

References

1. United Nations Office of the High Commissioner for Human Rights: Convention on the Rights of Persons with Disabilities (2006). https://www.un.org/development/desa/disabilities/convention-on-the-rights-of-persons-with-disabilities.html
2. United Nations Department of Economic and Social Affairs Sustainable Development: Transforming our world: the 2030 Agenda for Sustainable Development, pp. 1–16301 (2015). https://sdgs.un.org/2030agenda
3. Berg, M., Stratmann, A., Walter, J., Weber, M.: Jahresberichte der BAG WfbM 2023. In: Jahresberichte der Bundesarbeitsgemeinschaft Werkstätten für behinderte Menschen (2023).
4. Keller, S., Körtek, Y., Schulz, J.: Inclusion of people with intellectual disabilities into the labour market: Legal framework, sheltered workshop system, and good practice in Germany (2023).
5. Funk, M., Mayer, S., Schmidt, A.: Using In-Situ Projection to Support Cognitively Impaired Workers at the Workplace. In: Proceedings of ASSETS ’15, pp. 185–192, ACM, Lisbon (2015). https://doi.org/10.1145/2700648.2809853
6. Mark, B.G., Hofmayer, S., Rauch, E., Matt, D.T.: Inclusion of workers with disabilities in production 4.0: Legal foundations in Europe and potentials through worker assistance systems. Sustainability, 11(21), 5978 (2019). https://doi.org/10.3390/su11215978
7. Mark, B.G., Rauch, E., Matt, D.T.: The application of digital worker assistance systems to support workers with disabilities in assembly processes. Procedia CIRP, 103, pp. 243–249 (2021). https://doi.org/10.1016/j.procir.2021.10.039
8. Funk, M., Dingler, T., Cooper, J., Schmidt, A.: Stop helping me—I’m bored! Why assembly assistance needs to be adaptive. In: Proceedings of UbiComp ’15, pp. 1269–1273, ACM (2015). https://doi.org/10.1145/2800835.2807942
9. Kosch, T., Abdelrahman, Y., Funk, M., Schmidt, A.: One size does not fit all: challenges of providing interactive worker assistance in industrial settings. In: Proceedings of UbiComp ’17, pp. 1006–1011, ACM (2017). https://doi.org/10.1145/3123024.3124395
10. Baechler, A., Kurtz, P., Hoerz, T., et al.: About the development of an interactive assistance system for impaired employees in manual order picking. In: Proceedings of PETRA ’15, pp. 1–4, ACM (2015). https://doi.org/10.1145/2769493.2769528
11. Burggräf, P., Dannapfel, M., Adlon, T., Kasalo, M.: Adaptivity and adaptability as design parameters of cognitive worker assistance for enabling agile assembly systems. Procedia CIRP, 97, pp. 224–229 (2021). https://doi.org/10.1016/j.procir.2020.05.229
12. Manzoor, M., Vimarlund, V.: Digital Technologies for Social Inclusion of Individuals with Disabilities. Health and Technology, 8, pp. 377–390 (2018). https://doi.org/10.1007/s12553-018-0239-1
13. Vassilakopoulou, P., Hustad, E.: Bridging Digital Divides: A Literature Review and Research Agenda for Information Systems Research. Information Systems Frontiers, 25(3), pp. 955–969 (2023). https://doi.org/10.1007/s10796-020-10096-3
14. Story, M.F., Mueller, J.L., Mace, R.L.: The Universal Design File: Designing for People of All Ages and Abilities. The Center for Universal Design, Raleigh, NC (1998).
15. Eikhaug, W.F., et al.: Innovating with People: The Business of Inclusive Design. The Norwegian Design Council (2010).
16. Ladner, R.W.: Design for User Empowerment. Interactions, 15(6), pp. 18–22 (2008). https://doi.org/10.1145/2723869
17. Gregor, P., Newell, A.F.: Designing for Dynamic Diversity: Interfaces for Older People. In: Proceedings of ACM ASSETS ’01, pp. 151–156, ACM (2001). https://doi.org/10.1145/638249.638277
18. Boger, J., et al.: Principles for Fostering the Transdisciplinary Development of Assistive Technologies. Disability and Rehabilitation: Assistive Technology, 12(5), pp. 480–490 (2017). https://doi.org/10.3109/17483107.2016.1151953
19. Dawe, M.: Desperately Seeking Simplicity: How Young Adults with Cognitive Disabilities and Their Families Adopt Assistive Technologies. In: Proceedings of CHI ’06, pp. 1143–1152, ACM (2006). https://doi.org/10.1145/1124772.1124943
20. Bayor, A. A., Brereton, M., Sitbon, L., Ploderer, B., Bircanin, F., Favre, B., & Koplick, S. (2021). Toward a competency-based approach to co-designing technologies with people with intellectual disability. ACM Transactions on Accessible Computing (TACCESS), 14(2), 1-33. https://doi.org/10.1145/3450355
21. Pullin, G.: Design Meets Disability. MIT Press (2009).
22. Mark, B.G., Rauch, E., Matt, D.T.: Worker Assistance Systems in Manufacturing: A Review of the State of the Art and Future Directions. Journal of Manufacturing Systems, 59, pp. 228–250 (2021). https://doi.org/10.1016/j.jmsy.2021.02.017
23. Büttner, S., Mucha, H., Funk, M., et al.: The Design Space of Augmented and Virtual Reality Applications for Assistive Environments in Manufacturing: A Visual Approach. In: Proceedings of the 10th International Conference on Pervasive Technologies Related to Assistive Environments (PETRA ’17), pp. 433–440 (2017). https://doi.org/10.1145/3056540.3076193
24. Blattgerste, J., Renner, P., Pfeiffer, T.: Augmented Reality Action Assistance and Learning for Cognitively Impaired People: A Systematic Literature Review. In: Proceedings of the 12th ACM International Conference on Pervasive Technologies Related to Assistive Environments (PETRA ’19), pp. 270–279 (2019). https://doi.org/10.1145/3316782.3316789
25. Funk, M., Kosch, T., Schmidt, A.: Interactive Worker Assistance: Comparing the Effects of In-Situ Projection, Head-Mounted Displays, Tablet, and Paper Instructions. In: Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp ’16), pp. 934–939 (2016). https://doi.org/10.1145/2971648.2971706
26. Kosch, T., Kettner, R., Funk, M., Schmidt, A.: Comparing Tactile, Auditory, and Visual Assembly Error-Feedback for Workers with Cognitive Impairments. In: Proceedings of the 18th ACM SIGACCESS Conference on Computers and Accessibility (ASSETS ’16), pp. 53–60 (2016). https://doi.org/10.1145/2982142.2982157
27. Funk, M., Bächler, A., Kosch, T., et al.: Comparing Projected In-Situ Feedback at the Manual Assembly Workplace with Impaired Workers. In: Proceedings of the 8th ACM International Conference on Pervasive Technologies Related to Assistive Environments (PETRA ’15), pp. 1–8 (2015). https://doi.org/10.1145/2769493.2769496
28. Peltokorpi, J., Hoedt, S., Colman, T., et al.: Manual Assembly Learning, Disability, and Instructions: An Industrial Experiment. International Journal of Production Research, 61(22), pp. 7903–7921 (2023). https://doi.org/10.1080/00207543.2023.2195957
29. Korn, O., Funk, M., Schmidt, A.: Towards a Gamification of Industrial Production: A Comparative Study in Sheltered Work Environments. In: Proceedings of the 7th ACM SIGCHI Symposium on Engineering Interactive Computing Systems (EICS ’15), pp. 84–93 (2015). https://doi.org/10.1145/2774225.2774834
30. Heinz-Jakobs, M., Große-Coosmann, A., Röcker, C.: Promoting Inclusive Work with Digital Assistance Systems: Experiences of Cognitively Disabled Workers with In-Situ Assembly Support. In: 2022 IEEE Global Humanitarian Technology Conference (GHTC ’22), pp. 377–384, IEEE (2022). https://doi.org/10.1109/GHTC55712.2022.9910994
31. Sochor, R., Kraus, L., Merkel, L., et al.: Approach to Increase Worker Acceptance of Cognitive Assistance Systems in Manual Assembly. Procedia CIRP, 81, pp. 926–931 (2019). https://doi.org/10.1016/j.procir.2019.03.229
32. Funk, M., Bächler, A., Kosch, T., et al.: Working with Augmented Reality? A Long-Term Analysis of In-Situ Instructions at the Assembly Workplace. In: Proceedings of the 10th International Conference on Pervasive Technologies Related to Assistive Environments (PETRA ’17), pp. 222–229 (2017). https://doi.org/10.1145/3056540.3056548
33. Kraus, M., Wagner, N., & Minker, W. (2021). Modelling and predicting trust for developing proactive dialogue strategies in mixed-initiative interaction. Proceedings of the 2021 International Conference on Multimodal Interaction, 131-140. https://doi.org/10.1145/3462244.3479906
34. Yang, E. and Dorneich, M. (2018). Evaluating human–automation etiquette strategies to mitigate user frustration and improve learning in affect-aware tutoring. Applied Sciences, 8(6), 895. https://doi.org/10.3390/app8060895
35. Pushpakumar, R., Sanjaya, K., Rathika, S., Alawadi, A. H., Makhzuna, K., Venkatesh, S., & Rajalakshmi, B. (2023). Human-computer interaction: Enhancing user experience in interactive systems. In E3S Web of Conferences (Vol. 399, p. 04037). EDP Sciences.
36. Graus, M., & Ferwerda, B. (2019). Theory-grounded user modeling for personalized HCI. Personalized human-computer interaction. https://doi.org/10.1051/e3sconf/202339904037
37. Aliannejadi, M., Azzopardi, L., Zamani, H., Kanoulas, E., Thomas, P., & Craswell, N. (2021). Analysing mixed initiatives and search strategies during conversational search. Proceedings of the 30th ACM International Conference on Information & Knowledge Management, 16-26. https://doi.org/10.1145/3459637.3482231
38. Sun, X., May, A., & Wang, Q. (2016). The impact of user- and system-initiated personalization on the user experience at large sports events. Applied Ergonomics, 54, 1-9. https://doi.org/10.1016/j.apergo.2015.11.001
39. Jiang, S., & Arkin, R. C. (2015, October). Mixed-initiative human-robot interaction: definition, taxonomy, and survey. In 2015 IEEE International conference on systems, man, and cybernetics (pp. 954-961). IEEE. https://doi.org/10.1109/SMC.2015.174
40. Findlater, L. and McGrenere, J. (2004). A comparison of static, adaptive, and adaptable menus. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, 89-96. https://doi.org/10.1145/985692.985704
41. Yang, E. and Dorneich, M. (2018). Evaluating human–automation etiquette strategies to mitigate user frustration and improve learning in affect-aware tutoring. Applied Sciences, 8(6), 895. https://doi.org/10.3390/app8060895
42. Costa, S. D., Barcellos, M. P., & Falbo, R. d. A. (2021). Ontologies in human–computer interaction: a systematic literature review. Applied Ontology, 16(4), 421-452. https://doi.org/10.3233/ao-210255
43. Burgos, D., Tattersall, C., Koper, R.: How to Represent Adaptation in E-Learning with IMS Learning Design. Interactive Learning Environments, 15(2), pp. 161–170 (2007). https://doi.org/10.1080/10494820701343736
44. Hodaie, Z., Haladjian, J., Bruegge, B.: TUMA: Towards an Intelligent Tutoring System for Manual-Procedural Activities. In: Intelligent Tutoring Systems: 14th International Conference, ITS 2018, pp. 326–331, Springer (2018). ttps://doi.org/10.1007/978-3-319-91464-0_35
45. Oestreich, H., da Silva Bröker, Y., Wrede, S.: An Adaptive Workflow Architecture for Digital Assistance Systems. In: Proceedings of the 14th PErvasive Technologies Related to Assistive Environments Conference (PETRA ’21), pp. 177–184 (2021). https://doi.org/10.1145/3453892.3458046
46. Kölz, M., Jordon, D., Kurtz, P., Hörz, T.: Adaptive Assistance to Support and Promote Performance-Impaired People in Manual Assembly Processes. In: Proceedings of the 17th ACM SIGACCESS Conference on Computers & Accessibility (ASSETS ’15), pp. 337–338 (2015). http://dx.doi.org/10.1145/2700648.2811367
47. Heinz, M., Büttner, S., Jenderny, S., Röcker, C.: Dynamic Task Allocation Based on Individual Abilities – Experiences from Developing and Operating an Inclusive Assembly Line for Workers with and without Disabilities. Proceedings of the ACM on Human-Computer Interaction (EICS ’21), 5, pp. 1–19 (2021). https://doi.org/10.1145/3461728
48. Bannat, A., Wallhoff, F., Rigoll, G., et al.: Towards Optimal Worker Assistance: A Framework for Adaptive Selection and Presentation of Assembly Instructions. In: Proceedings of the 1st International Workshop on Cognition for Technical Systems (COTESYS), Springer (2008).
49. Haslgrübler, M., Gollan, B., Ferscha, A.: A Cognitive Assistance Framework for Supporting Human Workers in Industrial Tasks. IT Professional, 20(5), pp. 48–56 (2018). https://doi.org/10.1109/MITP.2018.053891337
50. Aehnelt, M., Bader, S.: Providing and Adapting Information Assistance for Smart Assembly Stations. In: Proceedings of SAI Intelligent Systems Conference (IntelliSys 2016), Volume 1, pp. 540–562, Springer (2018). https://doi.org/10.1007/978-3-319-56994-9_37
51. Oestreich, H., Heinz-Jakobs, M., Sehr, P., Wrede, S.: Human-Centered Adaptive Assistance Systems for the Shop Floor. In: Human-Technology Interaction: Shaping the Future of Industrial User Interfaces, pp. 83–125, Springer (2022). https://doi.org/10.1007/978-3-030-99235-4_4

back to Table of Contents