Advancements in AI and ML which drive improvements in NLP are making Voice User Interfaces (VUI) increasingly user-friendly and accessible to users with little prior ICT training. This may prove exceptionally useful for some groups of older adults, as it can empower them to actively and comfortably use ICT-enabled solutions on their own. To this end, it is key to discover potential barriers and ways to build on the strengths of this mode of interaction. Such insights could further inform the design of commercial devices, such as SHT with VUIs, to take advantage of the Silver Economy.
To research the older adults’ interaction with Voice User Interfaces combined with Smart Home Technology we conducted two focus-group studies, following the same scenario, the results of which are presented in this abstract. First, we discuss the state of the art. Second, we describe the setup of the study, characteristics of our participants and the outline of our scenario. Third, we present the results of our study showcasing the functions our participants discovered and expected. This section is followed by our insights into the benefits and barriers of this technology. Finally, we present our conclusions and discuss the potential future work in this field.
2. Related work
Multiple studies on HCI and aging, instead of exploring the aging process and opportunities, focus on health, socialization and technology stereotypes (Vines et al., 2015). Positive studies, are still rare, and one shared feature is that they use older adults’ strengths, such as their insights from life experience (Kopeć2018) or language proficiency (Skorupska et al., 2018) which increase with age. Moreover, older adults realize the benefits that come with an increased ICT proficiency (Aula, 2004) especially if it helps them achieve personal goals (Djoub, 2013), such as communicating with their loved ones, managing finance, engaging in e-commerce or pursuing their interests (Boulton-Lewis et al., 2007; Naumanen and Tukiainen, 2008; von Helversen et al., 2018).
For this reason, some older adults are enthusiastic about joining LivingLab ICT initiatives (Kopeć et al., 2017) despite some barriers to their involvement in ICT (Sandhu et al., 2013; Kopeć et al., 2018). Although there are previous studies on VA usability (Pyae and Joelsson, 2018), also with older adults in the context of SH (Vacher et al., 2015) it is worth to further investigate this problem in multiple cultural contexts in order to suggest how to make Voice Interfaces more accessible (Corbett and Weber, 2016) in general to facilitate different groups of older adults’ interaction with ICT-enhanced solutions.
Voice interaction has been implemented in mobile phones and tablets for several years now, but only recently standalone devices like Google Home, Amazon Alexa or Apple HomePod, became available. With their help it is possible to ask queries, perform tasks and control a number of Smart Home devices - and all of these aspects we addressed in our study setup.
|Speaker with VA||Google Home|
|Smartphone||Xiaomi Mi Max 2 running Android 7.1.1|
|TV set||42” Samsung LCD|
|Lights||Three Phillips Hue lightbulbs mounted in a desk lamps, connected to a Phillips Hue bridge|
|WiFi Relay + Fan||Sonoff Basic WiFi smart switch connected to a 40 cm floor fan|
We used a system consisting of speaker with a voice assistant agent, smart phone, and additional peripherals such as a TV set, an Android TV Set-Top Box, light controllers, Wi-Fi relays and other. For the purpose of the study all the necessary online accounts were created and preconnected in the Google Home application. The used equipment is listed in Table 1, and the connections are depicted in Figure 1.
We invited seven older adults: three female participants and four male participants from our LivingLabs to take part in our study. They were all retired, but remained active in various aspects e.g. as citizens engaged in their local area. All of them lived in Warsaw, Poland, and they were native Polish speakers with different English language proficiency. There was a 25 year age span: the youngest participant was 64 years old and the oldest one was 89, with a mean age of 73.14 (SD=8.64). Based on previous activities in our Living Lab, i.e. introductory interviews and DigComp surveys we can describe this group as very active users, above basic ICT skills. We chose to divide the participants into two small affinity groups to give them time to discuss and test various functionalities freely; the scenario for both sessions is presented in Sidebar 3. The research was based on semi-structured mixed method scenario of group interviews with direct involvement of the participants, and we recorded and transcribed the sessions to create an affinity diagram of key themes and quotes.
e study scenario consisted of 6 parts:
discussing situations in which technology can help users at home,
presentation of the Google Home system and voice control capabilities of devices,
independent use of the Google Home system by participants,
collecting opinions about the system, with particular emphasis on advantages, disadvantages and insights on limitations and opportunities,
brainstorming to generate potential new, unaddressed system applications,
collecting opinions about potential threats.
Overall, we observed that our group of older adults was impressed by the range of possibilities of Voice Assistants and how convenient this technology could be for them. One of them said: ”This technology is for older adults, 60+, young people have no time to listen to such information: rush, work, they have a phone with everything in it” (P7). Another noted: ”it is much simpler, I don’t have to devise anything, I just sit there, bored or tired, and say things (…) I just say them and it (VA) does the job” (P5).
For our group of older adults four key needs emerged:
understanding technology and receiving feedback ((P3) ”technology should give us hints: you did something wrong, do this and that” and ”younger people already know how everything works and don’t understand that for us everything has to be coherent, while they can omit things, even in explaining them”);
accessible design with low barrier of entry, unlike regular computers (”using a mouse and searching for information is very difficult, as you need multiple repetitions to become a proficient user” and ”screens are cluttered, and such user can not focus on one piece of information” (P7));
Benefits Improvements Intuitive interaction (via natural language) with no/little prior training required. More feedback allowing to create a step-by-step guide. Voice control (no motor functions involved on the part of the user). Understanding more natural utterances, including context and metaphors, as well as tackling and explaining the problem of voice priority to prevent conflicts that may arise. Friendly manner (friendly voice and patience). Building up on the voice recognition functions to initiate friendly conversations with reminders. No handling of devices (so, no device that has to be found and turned on). Solving concerns about the range of effective voice interaction in their home. Granting independence (the VA can do some things which, especially for people with disabilities, may require assistance). Ensuring the existence of fail-safes to resolve concerns about the reliability of VIUs in executing commands. Table 2. List of observed benefits with some improvement suggestions
seamless incorporation into everyday life, as our participants liked the idea of being able to accomplish certain tasks using only speech not only because they might have ”difficulties moving” (P1) but also because it is does not disturb their process. They mentioned the advantages of being able to ask for something when they are ”just busy doing something else” (P1) or ”when my hands are dirty” (P4). They think this could ”save a lot of time, walking and searching” (P3). Hence, they think that voice commands ”are the future” (P2));
control and assurance of security (”the computer does not do what you want it to do, but what you ordered it to do and you never know if they are the same thing” (P2). Another participant expressed the fear that they ”are not in control of the autonomous device” (P5). He wondered whether asking technology to turn off the stove ”would really work”).
In light of the aforementioned needs conversational interaction seems like a very good solution for older adults. First, it allows the user to proceed at their own pace. Such conversational agent will not ”complain that it has no time” (P6). Second, it allows the users to renounce the reliance on screens and input devices and manages the information flow. Third, it is based on the use of natural language making it easy, as conversation is the default mode of interaction and it does not require a significant change of habits. Finally, a person can say a command with a specific task in mind without the fear of being distracted or sidetracked.
In connection with Smart Home devices our group of older adults saw Google Home as a ”central unit” (P1) that could make it easier to ”operate other devices” (P4), with the TV set being mentioned by several of them, manage various ”intelligent home” settings (P1) and even save energy (P6). They especially wanted IoT devices to assist them with tiring household chores, to free up their time for other activities. In terms of barriers, we could notice the concern about context awareness (”Will it tell me if I should take an umbrella with me, or do I have to ask about the weather first?” by P4) and the fear of losing diversity of devices, as not all of them would be compatible (P2). While the issue of privacy was mentioned (P5) it was not a prominent concern.
Moreover, we found that our group of older adults could naturally identify various already available applications of VA with SHT and accept them as generally useful and empowering. They expected VA to act as an assistant that enables searching for information hands-free or as a memory aid that does not require handling any devices. Other functions which were mentioned consistently were a translator or even a teacher. With little training and encouragement our participants could start using VA’s to their satisfaction and empowerment. As one of our participants put it: ”if there were training sessions (…) a lot of older people would warm up to it” (P6).
|Barriers||Solutions and comments|
|Time consuming.||Although this was mentioned, it was not a drawback for older adults as they say that they have the time.|
|Lacks sensors and cameras (which would allow it to better assist with some tasks).||Connecting a camera, to give the user hints (while cooking with a recipe, or to measure things) as well as sensors.|
|Lack of a screen to give feedback and context.||Introduction of companion screens to see context, status or key information searched for, as it is hard to store it all in memory.|
|Need to have compatible devices: fear of losing diversity and individuality).||Working towards compatibility between manufacturers.|
|Fear of malfunction (something may not turn off, even if the signal was sent).||Making clear what backup security measures are in place May go away with more exposure.|
|Fear of too much reliance (afraid of a possible loss of creativity, and lack of mental and physical exercise).||VA could also serve as an assistant, verifying their cognitive health and reminding them about some elements of a healthy lifestyle.|
|Danger of entering a ”search bubble” (without the text interaction with a lot of context sometimes it is hard to find exactly what we are looking for, or to remember what it was).||A companion screen could mitigate this effect, if the user could glance at it and request to be read a specific result.|
In our research we identified the main benefits our group of older adults saw in the Voice User Interface and Smart Home solutions, as well as the key barriers to their implementation and use. At the same time we would like to point out the limitations to our study, as the participants were technology-conscious older adults in Poland, however, as one of them (P6) put it ”there are some categories of older people who are interested in smartphones, but there are some who spend their time with a crochet, just as there are different categories among young people.” As such, some of our insights may extend to other groups, therefore to inform the design of VUI-based solutions, we present our preliminary findings regarding the benefits in Table 2 and barriers in Table 3.
Moreover, apart from identifying key barriers and benefits, we have analyzed our participants’ queries, comments and interaction with the VA in order to explore its nature and introduce some preliminary categories to take into account when designing VA functionalities, such as their role as everyday duties assistants, helping with setting alarms, shopping lists, weather and traffic information (P5), as well as leisure assistants including such specific applications as listening to audio books (P1), language learning (P6), telling a jokes (P7)) and posing SH safety assistants or caretakers able to turn off the light or the stove (P3).
6. Conclusions and future work
Our exploratory qualitative study allowed us to draw important preliminary conclusions relating to the needs of older adults, the benefits and barriers of using VA technology as well as the different possible applications of VA combined with SHT.
First, we identified a number of reasons for which VA interfaces combined with IoT are well adjusted to the needs of many older adults, both cognitive, including their need to understand the technology and take control of it, and physical, accounting for accessibility and convenience. We concluded that this technology is very promising as it has the potential to empower some groups of older adults.
Second, we enumerated the main benefits our group of older adults saw in the Voice User Interface and Smart Home solutions, as well as the key barriers to their implementation and use. These we then matched with relevant improvement suggestions and solutions or comments which ought to be further discussed and explored.
Third, we find that our group of older adults could naturally identify various already available applications of VA with SHT and accept them as generally useful, as well as list multiple additional applications that could spare them considerable effort and free up their time.
Therefore, we think that this study is an important voice in the debate on the various applications of voice-powered interaction to meet the needs of some older adults. At the same time we would like to point out the limitations to our study, as the participants were technology-conscious older adults in Poland. Thus, further research is required to verify the identified preliminary barriers and benefits as well as to explore the insights gathered and to investigate this solution with different potential user groups to verify which insights may be group specific and which are general.
e would like to thank older adults from our Living Lab, those affiliated with Kobo Association who participated in this study.
- Learning to use computers at a later age. In HCI and the Older Population, Cited by: §2.
- Ageing, learning, and computer technology in australia. Educational Gerontology 33 (3), pp. 253–270. Cited by: §2.
- What can i say?: addressing user experience challenges of a mobile voice user interface for accessibility. In Proceedings of the 18th International Conference on Human-Computer Interaction with Mobile Devices and Services, MobileHCI ’16, New York, NY, USA, pp. 72–82. External Links: Cited by: §2.
- ICT education and motivating elderly people. In Ariadna; cultura, educación y tecnología, Vol. 1, pp. 88–92. External Links: Cited by: §2.
- Guidelines towards better participation of older adults in software development processes using a new spiral method and participatory approach. In Proceedings of the CHASE’18: International Workshop on Cooperative and Human Aspects of Software, ICSE ’18, New York, NY, USA. External Links: Cited by: §2.
- LivingLab pjait: towards better urban participation of seniors. In Proceedings of the International Conference on Web Intelligence, WI ’17, New York, NY, USA, pp. 1085–1092. External Links: Cited by: §2.
- Practices in old age ICT education. In IADIS International Conference on Cognition and Exploratory Learning in Digital Age, pp. 261–269. Cited by: §2.
- Investigating the usability and user experiences of voice user interface: a case of google home smart speaker. In Proceedings of the 20th International Conference on Human-Computer Interaction with Mobile Devices and Services Adjunct, MobileHCI ’18, New York, NY, USA, pp. 127–131. External Links: Cited by: §2.
- ICT skills acquisition by older people: motivations for learning and barriers to progression. International Journal of Education and Ageing 3 (1), pp. 25–42. Cited by: §2.
- Older adults and crowdsourcing: android tv app for evaluating tedx subtitle quality. In Proceedings of the 2018 ACM Conference on Computer Supported Cooperative Work and Social Computing, pp. 286–296. Cited by: §2.
- Evaluation of a context-aware voice interface for ambient assisted living: qualitative user study vs. quantitative system evaluation. ACM Trans. Access. Comput. 7 (2), pp. 5:1–5:36. External Links: Cited by: §2.
- An age-old problem: examining the discourses of ageing in hci and strategies for future research. ACM Trans. Comput.-Hum. Interact. 22 (1), pp. 2:1–2:27. External Links: Cited by: §2.
- Influence of consumer reviews on online purchasing decisions in older and younger adults. Decision Support Systems. Cited by: §2.