Ulisses da Silva Fernandes 
, Glívia Angélica Rodrigues Barbosa , Bruno Azevedo Chagas , Gabriel Diniz Junqueira Barbosa , Simone Diniz Junqueira Barbosa , Raquel Oliveira Prates
pp. 139 - 173, view paper, download
(https://doi.org/10.55612/s-5002-055-007), Google Scholar
Issue N. 55, Winter 2023
Intelligent conversational agents have become widespread. Inspired by conversations in natural language, they present different degrees of intelligence and autonomy, bringing challenges for Human-Computer Interaction (HCI). One such challenge concerns design languages for modeling user-agent interaction. We focus here on MoLIC, a design-phase dialogue model based on Semiotic Engineering theory devised to represent user-system interactions as conversations. We performed two case studies with MoLIC interaction diagrams representing two conversational agents – the ANA chatbot and Samsung Bixby. We examined how the interactive aspects of these agents could be expressed in MoLIC. Although it was possible to express the general interaction, our results showed limitations related to the language expressiveness or its inadequacy to represent these systems. We identified limitations in the applicability of MoLIC in modeling and pondered on how to extend or adapt it; directing the HCI community to issues and initiatives that can help design and model these technologies.
Keywords: Intelligent Conversational Agents, Modeling Chatbots, Virtual Assistants, MoLIC
Cite this article as:
da Silva Fernandes U., Rodrigues Barbosa G., Azevedo Chagas B., Junqueira Barbosa G., Junqueira Barbosa S., Oliveira Prates R.: Lessons Learned from Modeling the Interaction with Conversational Agents, Interaction Design & Architecture(s) – IxD&A Journal, N.55, 2022, pp. 139–173, DOI: https://doi.org/10.55612/s-5002-055-007
References:
1. Adamopoulou, E., Moussiades, L.: An Overview of Chatbot Technology. In: Maglogiannis, I., Iliadis, L., Pimenidis, E. (eds.) Artificial Intelligence Applications and Innovations, IFIP Advances in Information and Communication Technology, vol. 584, pp. 373–383, Springer International Publishing, Cham (2020), ISBN 978-3-030-49186-4, https://doi.org/10.1007/978-3-030-49186-4_31
2. Brandtzaeg, P.B., Følstad, A.: Chatbots: changing user needs and motivations. Interactions 25(5), 38–43 (Aug 2018), ISSN 1072-5520, https://doi.org/10.1145/3236669,
3. Cambre, J., Kulkarni, C.: Methods and Tools for Prototyping Voice Interfaces. In: Proceedings of the 2nd Conference on Conversational User Interfaces, pp. 1–4, CUI ’20, Association for Computing Machinery, New York, NY, USA (Jul 2020), ISBN 978-1-4503-
75443, https://doi.org/10.1145/3405755.3406148
4. Carlmeyer, B., Chromik, M., Wrede, B.: Interaction Model for Incremental Information Presentation. In: Proceedings of the 5th International Conference on Human Agent Interaction, pp. 335–339, HAI ’17, Association for Computing Machinery, New York, NY, USA (Oct 2017), ISBN 978-1-4503-5113-3, https://doi.org/10.1145/3125739.3132582
5. Castle-Green, T., Reeves, S., Fischer, J.E., Koleva, B.: Decision Trees as Sociotechnical Objects in Chatbot Design. In: Proceedings of the 2nd Conference on Conversational User Interfaces, pp. 1–3, CUI ’20, Association for Computing Machinery, New York, NY, USA (Jul 2020), ISBN 978-1-4503-7544-3, https://doi.org/10.1145/3405755.3406133
6. Chagas, B.A., Ferreguetti, K., Ferreira, T.C., Prates, R.O., Ribeiro, L.B., Pagano, A.S., Reis, Z.S.N., Jr, W.M., Ribeiro, A.L., Marcolino, M.S.: Chatbot as a Telehealth Intervention Strategy in the COVID-19 Pandemic: Lessons Learned from an Action Research Approach. CLEI Electronic Journal 24(3), 6:1–6:17 (Dec 2021), ISSN 07175000, https://doi.org/10.19153/cleiej.24.3.6, URL http://www.clei.org/ cleiej/index.php/cleiej/article/view/515
7. Da Silva, B.S., Barbosa, S.D.J.: Designing human-computer interaction with MoLIC diagrams–a practical guide. Tech. Rep. 12/07, PUC-Rio, Rio de Janeiro (2007), ISSN: 0103- 9741. Available online at: http://bib-di.inf.puc-rio.br/ftp/pub/docs/techreports/07_12_silva.pdf
8. de Carvalho, A.P., Pereira, F.H.S., Assunção, O.B., Pereira, A.F., Prates, R.O.: An analysis of MoLIC’s consolidation. In: Proceedings of the 18th Brazilian Symposium on Human Factors in Computing Systems, pp. 1–15, IHC ’19, Association for Computing Machinery, New Y ork, NY , USA (Oct 2019), ISBN 978-1-4503-6971-8, https://doi.org/10.1145/3357155.3358461
9. De Souza, C.S.: The semiotic engineering of human-computer interaction. MIT press, New York, NY, USA (2005) https://doi.org/10.7551/mitpress/6175.001.0001
10. Farooq, U., Grudin, J.: Human-computer integration. Interactions 23(6), 26–32 (oct 2016),MISSN 1072-5520, https://doi.org/10.1145/3001896, URL https://doi.org/10.1145/3001896
11.Ferreira, J.J., Fucs, A., Segura, V. (2019). Modeling People-AI Interaction: A Case Discussion with Using an Interaction Design Language. In: Marcus, A., Wang, W. (eds) Design, User Experience, and Usability. User Experience in Advanced Technological Environments. HCII 2019. Lecture Notes in Computer Science(), vol 11584. Springer, Cham. https://doi.org/10.1007/978-3-030-23541-3_27
12.Fernandes, U.d.S., Prates, R.O., Chagas, B.A., Barbosa, G.A.R.: Analyzing molic’s
applicability to model the interaction of conversational agents: A case study on ana chatbot. In: Proceedings of the XX Brazilian Symposium on Human Factors in Computing Systems, IHC ’21, Association for Computing Machinery, New York, NY, USA (2021), ISBN 9781450386173, https://doi.org/10.1145/3472301.3484367
13. Følstad, A., Araujo, T., Law, E.L.C., Brandtzaeg, P.B., Papadopoulos, S., Reis, L., Baez, M., Laban, G., McAllister, P., Ischen, C., Wald, R., Catania, F., Meyer von Wolff, R., Hobert, S., Luger, E.: Future directions for chatbot research: an interdisciplinary research agenda. Computing 103(12), 2915–2942 (Dec 2021), ISSN 1436-5057, https://doi.org/10.1007/s00607-021-01016-7
14. Følstad, A., Brandtzæg, P.B.: Chatbots and the new world of HCI. Interactions 24(4), 38–42 (Jun 2017), ISSN 1072-5520, https://doi.org/10.1145/3085558
15. Go, E., Sundar, S.S.: Humanizing chatbots: The effects of visual, identity and conversational cues on humanness perceptions. Computers in Human Behavior 97, 304–316 (Aug 2019), ISSN 0747-5632, https://doi.org/10.1016/j.chb.2019.01.020, URL https://www. sciencedirect.com/science/article/pii/S0747563219300329
16.Guzzoni, D., Baur, C., Cheyer, A.: Modeling Human-Agent Interaction with Active Ontologies. In: The Association for the Advancement of Artificial Intelligence Spring Symposium: Interaction Challenges for Intelligent Assistants, pp. 52–59, AAAI, Vancouver, British Columbia, Canada (2007). Available online at: http://www.aaai.org/Library/Symposia/Spring/2007/ss07-04-009.php
17.Laranjo, L., Dunn, A.G., Tong, H.L., Kocaballi, A.B., Chen, J., Bashir, R., Surian, D., Gallego, B., Magrabi, F., Lau, A.Y.S., Coiera, E.: Conversational agents in healthcare: a systematic review. Journal of the American Medical Informatics Association 25(9), 1248– 1258 (Sep 2018), ISSN 1527974X, https://doi.org/10.1093/jamia/ocy072
18. Li, C.H., Chen, K., Chang, Y.J.: When there is no progress with a task-oriented chatbot: A conversation analysis. In: Proceedings of the 21st International Conference on Human- Computer Interaction with Mobile Devices and Services, MobileHCI ’19, Association for Computing Machinery , New Y ork, NY , USA (2019), ISBN 9781450368254, https://doi.org/10.1145/3338286.3344407
19. Luger, E., Sellen, A.: ”like having a really bad pa”: The gulf between user expectation and experience of conversational agents. In: Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, p. 5286–5297, CHI ’16, Association for Computing Machinery , New Y ork, NY , USA (2016), ISBN 9781450333627, https://doi.org/10.1145/2858036.2858288
20. Marques, A.B., Barbosa, S.D.J., Conte, T.: A comparative evaluation of interaction models for the design of interactive systems. In: Proceedings of the 31st Annual ACM Symposium on Applied Computing, pp. 173–180, SAC ’16, Association for Computing Machinery, New Y ork, NY , USA (Apr 2016), ISBN 978-1-4503-3739-7, https://doi.org/10.1145/2851613.2851679
21. Montenegro, J.L.Z., da Costa, C.A., da Rosa Righi, R.: Survey of conversational agents in health. Expert Systems with Applications 129, 56–67 (Sep 2019), ISSN 0957-4174, https://doi.org/10.1016/j.eswa.2019.03.054, URL https://www.sciencedirect.com/science/article/pii/S0957417419302283
22. Moore, R.J.: A Natural Conversation Framework for Conversational UX Design. In: Moore, R.J., Szymanski, M.H., Arar, R., Ren, G.J. (eds.) Studies in Conversational UX Design, pp. 181–204, Human–Computer Interaction Series, Springer International Publishing, Cham (2018), ISBN 978-3-31995579-7, https://doi.org/10.1007/978-3-319-95579-7 9
23. Moore, R.J., Arar, R.: Conversational UX Design: An Introduction. In: Moore, R.J., Szymanski, M.H., Arar, R., Ren, G.J. (eds.) Studies in Conversational UX Design, pp. 1–16, Human–Computer Interaction Series, Springer International Publishing, Cham (2018), ISBN 978-3-319-95579-7, https://doi.org/10.1007/978-3-319-95579-7 1
24. Moore, R.J., Arar, R.: Conversational UX Design: A Practitioner’s Guide to the Natural Conversation Framework. Association for Computing Machinery, New York, NY, USA (2019), ISBN 978-1-4503-6301-3 https://doi.org/10.1145/3304087.3304096
25. Moore, R.J., Szymanski, M.H., Arar, R., Ren, G.J. (eds.): Studies in Conversational UX Design. Human–Computer Interaction Series, Springer International Publishing, Cham (2018), ISBN 978-3-319-95579-7
26. Oliveira, N., Costa, A., Araujo, D., Portela, C.: HelpCare: Um Protótipo de ChatBot para o Auxílio do Tratamento de Doenças Crônicas. In: Anais do Simpósio Brasileiro de Computação Aplicada à Saúde (SBCAS), pp. 282– 287, SBC, Niterói (Jun 2019), https://doi.org/10.5753/sbcas.2019.6263,
URL https://sol.sbc.org.br/index.php/sbcas/article/view/6263, iSSN: 2763-8952
27. Peirce, C.S.: The Essential Peirce: selected philosophical writings, vol. 2. Indiana University Press, Bloomington (1992). ISBN: 978-0-253-21190-3.
28. Piccolo, L.S.G., Mensio, M., Alani, H.: Chasing the Chatbots. In: Bodrunova, S.S., Koltsova, O., Følstad, A., Halpin, H., Kolozaridi, P., Yuldashev, L., Smoliarova, A., Niedermayer, H. (eds.) Internet Science, pp. 157– 169, Lecture Notes in Computer Science, Springer International Publishing, Cham (2019), ISBN 978-3-030-17705-8, https://doi.org/10.1007/978-3-03017705-8 14
29. Pérez-Soler, S., Guerra, E., de Lara, J.: Flexible Modelling using Conversational Agents. In: 2019 ACM/IEEE 22nd International Conference on Model Driven Engineering Languages and Systems Companion (MODELS-C), pp. 478–482, IEEE, Munich, Germany (Sep 2019), https://doi.org/10.1109/MODELS-C.2019.00076
30. Pérez-Soler, S., Guerra, E., de Lara, J.: Creating and Migrating Chatbots with CONGA. In: 2021 IEEE/ACM 43rd International Conference on Software Engineering: Companion Proceedings (ICSE-Companion), pp. 37–40, `IEEE, Madrid, Spain (May 2021), https://doi.org/10.1109/ICSECompanion52605.2021.00030, iSSN: 2574-1926
31. Rapp, A., Curti, L., Boldi, A.: The human side of human-chatbot interaction: A systematic literature review of ten years of research on text-based chatbots. International Journal of Human-Computer Studies 151, 102630 (Jul 2021), ISSN 1071-5819, https://doi.org/10.1016/j.ijhcs.2021.102630, https://www.sciencedirect.com/science/article/pii/ S1071581921000483
32. Rangel, M.C., de Castro Salgado, L.C., Bim, S.A.: Tradubem: Towards a text verification tool for an altruistic language. In: Proceedings of the 21st Brazilian Symposium on Human Factors in Computing Systems, IHC ’22, Association for Computing Machinery, New York, NY, USA (2022), ISBN 9781450395069, https://doi.org/10.1145/3554364.3559143
33. Sabharwal, N., Agrawal, A. (2020). Introduction to Google Dialogflow. In: Cognitive Virtual Assistants Using Google Dialogflow. Apress, Berkeley, CA. https://doi.org/10.1007/978-1- 4842-5741-8_2
34.Samsung Electronics: Samsung Bixby: Your Personal Voice Assistant (Apr 2017), URL https://www.samsung.com/us/explore/bixby/
35. Samsung Electronics: Getting to know bixby (Feb 2022), URL https:// www.samsung.com/uk/smartphones/galaxy-s9-need-to-knows/bixby/
36. Schön, D.A.: The reflective practitioner: How professionals think in action. Basic books, USA (1983). ISBN: 978-0465068784.
37. Shevat, A.: Designing Bots. O’Reilly Media, Inc., [s.l.] (May 2017), ISBN 978-1-4919-7482- 7, URL https://www.oreilly.com/library/view/ designing-bots/9781491974810/
38. da Silva, B.S., Barbosa, S.D.J.: Modelando a Interação do Nita: um estudo de caso e extensões ao MoLIC. In: Anais do VI Simpósio sobre Fatores Humanos em Sistemas Computacionais, pp. 181–184, Sociedade Brasileira de Computação – SBC, Curitiba, PR (2004), URL http://www2.sbc.org. br/ce-ihc/Anais2004/AnaisIHC2004-completos.pdf
39. de Souza, L.G., Barbosa, S.D.J.: Extending molic for collaborative systems design. In: Kurosu, M. (ed.) Human-Computer Interaction: Design and Evaluation, pp. 271–282, Springer International Publishing, Cham. (2015), ISBN 978-3-319-20901-2 https://doi.org/10.1007/978-3-319-20901-2_25
40. de Souza, L.G., Barbosa, S.D.J., Fuks, H.: Evaluating the expressiveness of molicc to model the hci of collaborative systems. In: International Conference of Design, User Experience, and Usability, LNCS ’16, vol. 9746, pp. 255–265, Springer International Publishing, Toronto, Canada— (Jun 2016) https://doi.org/10.1007/978-3-319-40409-7_25
41. Svenningsson, N., Faraon, M.: Artificial Intelligence in Conversational Agents: A Study of Factors Related to Perceived Humanness in Chatbots. In: Proceedings of the 2019 2nd Artificial Intelligence and Cloud Computing Conference, pp. 151–161, AICCC 2019, Association for Computing Machinery, New York, NY, USA (Dec 2019), ISBN 978-1-4503-
7263-3, https://doi.org/10.1145/3375959.3375973
42. Svikhnushina, E., Pu, P.: Key Qualities of Conversational Chatbots — the PEACE Model. In: 26th International Conference on Intelligent User Interfaces, pp. 520–530, Association for Computing Machinery, New York, NY, USA (Apr 2021), ISBN 978-1-4503-8017-1 https://doi.org/10.1145/3397481.3450643
43. Teixeira, B.R., Barbosa, S.D.J.: Investigating the integration of user values with design rationale and its effects on HCI design artifacts. In: Proceedings of the 19th Brazilian Symposium on Human Factors in Computing Systems, pp. 1–10, IHC ’20, Association for Computing Machinery, New York, NY, USA (Oct 2020), ISBN 978-1-4503-81727, https://doi.org/10.1145/3424953.3426488
44.Valtolina, S., Neri, L.: Visual design of dialogue flows for conversational interfaces. Behaviour & Information Technology 40(10), 1008–1023 (Jul 2021), ISSN 0144-929X, https://doi.org/10.1080/0144929X.2021.1918249
45.Valério, F.A.M., Guimarães, T.G., Prates, R.O., Candello, H.: Here’s What I Can Do: Chatbots’ Strategies to Convey Their Features to Users. In: Proceedings of the XVI Brazilian Symposium on Human Factors in Computing Systems, pp. 1–10, IHC 2017, Association for Computing Machinery, New York, NY, USA (Oct 2017), ISBN 978-1-4503-63778, https://doi.org/10.1145/3160504.3160544
46. Wachtel, A., Fuchß, D., Schulz, S., Tichy, W.F.: Approaching Natural Conversation Chatbots by Interactive Dialogue Modelling amp; Microsoft LUIS. In: 2019 IEEE International Conference on Conversational Data Knowledge Engineering (CDKE), pp. 39–42, IEEE, San Diego, CA, USA (Dec 2019), https://doi.org/10.1109/CDKE46621.2019.00013
47. Meyer von Wolff, R., Hobert, S., Schumann, M.: How May I Help You? – State of the Art and Open Research Questions for Chatbots at the Digital Workplace. In: Proceedings of the 52nd Hawaii international conference on system sciences, pp. 95–104, HICSS, Hawaii (Jan 2019), ISBN 978-0-9981331-2-6, https://doi.org/10.24251/HICSS.2019.013