share
1 Introduction
The Pew Research Center reported in 2014 on the ever-increasing number of senior citizens moving to use the Internet. Safety and security are primary objectives for the growing number of seniors using the Internet: currently, 59% of seniors over 65 use the Internet [smith2014older] and, given that seniors are the fastest growing demographic, this cohort should increase annually. But online seniors are vulnerable seniors. Researchers identify user concerns about areas such as website disclosure about purchasing history, browsing patterns or personally identifiable information, and scams, phishing and malware, and financial scams [deevy2012scams]. Seniors are apparently highly vulnerable as many have low computer literacy, low awareness of Internet pitfalls, and even less knowledge about where to find information about Internet security.
Existing HCI research mostly focuses on younger adults and university students, and rarely includes participants aged 60 and above [dickinson2007methods]. Many factors contribute towards this. First, older adults are an extremely diverse group. They have significantly different lifestyle characteristics from the younger adults since most of them live far from universities. In addition, aging causes sensory changes such as visual and auditory perception, and cognitive changes such as working memory. Thus, they are more likely to forget instructions and take longer to reach a level of proficiency. Various mobility issues and illnesses may exist in older people that make it difficult for them to participate in research studies. Secondly, due to these inherent characteristics of older adults, important considerations need to be incorporated in the experimental design in order to get high quality results from them. For example, the use of flexible timing, cognitive testing, and instructions for getting to the research study venue all need to be built into the design. Thirdly, appropriate recruitment methods need to be employed in order to ensure access to a useful sample of older people.
In order to develop interactive materials related to Internet security for seniors, it is important to first determine the seniors’ media preferences. However, to the best of our knowledge, there is no existing study that explores seniors’ media preference for receiving training involving computer and Internet security information, and their comprehension of each medium.
We conducted a pilot study on seniors’ media preference for receiving computer and Internet security information. We focused on two media types: print text and audio, and designed scripts to communicate information about email-based phishing, and tips they can use to protect themselves against such scams. We chose email-based phishing, since it is one of the main tools used for financial fraud. Accordingly, our study focused on answering the following research questions:
1. Which of the two media types results in better comprehension of email-based phishing?
2. Which of the two media types do seniors prefer?
2 Study Design
Our study, approved by the UNCC Institutional Review Board111Approved IRB Protocol#14-04-11, followed a between-subjects design. The two treatment conditions were:
Treatment 1 - Text: The participants read the text script on email-based phishing.
Treatment 2 - Audio: The participants listened to an audio script on email-based phishing. The audio script was a screencast/voice-over the text script and had essentially the same contents as the text script.
After reading/listening to the script, the participants completed a phishing comprehension survey. After completing the survey, the participants were required to listen to/read the other media script for the purpose of providing their media preference and rating of the provided scripts. The number of male and female participants in each treatment group was controlled for.
3 Surveys
3.1 Phishing comprehension
The phishing comprehension survey consisted of a total of 10 questions. The first five questions asked the participants to label each shown email message as a legitimate or a phishing email. The next five questions were designed to test other information provided in the text and audio scripts. Based on the responses, a score was computed out of 10.
3.2 Media preference and rating
The participants answered the following questions:
Q1. Rate the audio message (Likert scale: 1 - 5)
Q2. Rate the text message (Likert scale: 1 - 5)
3.3 Demographics
The demographics survey comprised of 10 questions to analyze the characteristics of our participant pool.
4 Participants
Initially, we planned on recruiting our participants from senior centers situated off-campus, by posting flyers on their websites [charlotte-mecklenburg, laurels]. 10 seniors contacted us and showed interest in participation. However, only two of them actually participated in the study.
The following factors impeded our recruitment process:
1. Reposting the flyers did not increase the number of seniors who responded to our flyers.
2. Most of the seniors who showed an initial interest in the study could not participate later on due to health issues or personal commitments.
3. A few senior centers did not give us direct permission to visit the seniors in the computer class at the senior center and interview them. Therefore, they kept us waiting for response from their senior managers.
Due to the difficulties we experienced while recruiting participants from the senior centers, we recruited our participants from Amazon Mechanical Turk (a crowdsourcing marketplace). We set up our study as a Human Intelligent Task (HIT), which included the tasks described in Section 2. Due to the fact that a small percentage of older adults uses Amazon Mechanical Turk, we reduced the minimum eligible from 65 to 55. To ensure that only the people aged 55 and above attempt the survey, we set up our demographic survey as an eligibility screening survey. Only the participants who selected 55 and older as their age group in the demographic survey were asked to proceed with the HIT. To better control the quality of the recruited participants, we mandated that each worker has a 90% HIT approval rating, or better. The HIT took approximately 30-40 minutes to complete, for which each worker was paid a fee of $1. A total of 34 participants (17 per group) successfully completed the pilot study.
5 Results
5.1 Phishing Comprehension (Text script vs Audio script)
An overall comprehension score was calculated based on the number of phishing related questions that were answered correctly (out of 10). We conducted the Wilcoxon-Mann Whitney test on the phishing comprehension scores of the two treatment groups. The test showed no significant difference between the phishing comprehension score of the text script (=7.3, =1.57) and the audio script (=8.29, =1.96) with p= 0.07.
5.2 Media Preference
Chi-squared test was conducted between the media preference for the two participant groups. The test showed that both groups have similar media preference since the p value was greater than 0.05. Both groups preferred the text media over the audio–70.5% participants in the first group, and 64.7% participants in the second group. We also conducted a Wilcoxon signed-rank test between the overall Likert scale ratings of both messages. The test showed no significant differences in the ratings for text (=3.9, =1.19) and audio (=3.7, =1.13) message with p=0.44.
6 Related Work
Garg et al. [garg2012risk] studied the effectiveness of narrative-driven videos vs text for communicating phishing and malware email-based online risk to older adults. Their pilot study on 12 participants showed that video helped the participants in verbalizing the risk of responding or not responding to the emails. However, both the video and text made the participants rate the risk of responding to emails higher than that of not responding to them.
7 Conclusion and Implications
Our pilot study on seniors’ media preferences for instructional material suggests that Dickinson’s findings regarding seniors’ recruitment still hold true. Dickinson states that issues such as illness and family responsibilities make it hard to recruit and schedule sessions with the seniors. Most of the seniors who initially showed interest in our study, could not participate later for similar reasons. We hoped to get a large turnout from the senior centers. In future, we plan to work with local charities and offer free computer classes (in exchange for participation) as suggested by Dickinson.
People use the Internet for interpersonal reasons, to pass time, seek information and be entertained; MAIN, a new model for technology affordances, suggests that the visual component of multimedia surpasses text in terms of informational content delivery; however, a visual can also be seen as a distractor [sundar2013uses]. New models of technology usability and gratification often lack focus on the newly emerging audience of seniors. We originally hypothesized that the empirical findings of our pilot would be able to support theoretical exploration of media acceptance by seniors and thereby enable us to tailor expanded interactive materials about security to their preferences. However, the barriers we encountered in recruiting seniors suggest that we need to develop alternative ways to recruit participants before seeking funding. Accordingly, we have revised our recruiting to include families with members placed into adult day care and caregivers for homebound cognitively impaired seniors, to develop materials and identify preferences for our VA-funded project, StoryCall, and are considering targeting churches which, particularly for minorities, often present health and computer education for its parishioners.
References
8 Appendix
Participant Demographics
| Demographics | No. of | |
| Participants | ||
| Education | High School | 3 |
| 2 years of college | 8 | |
| 4 years of college | 11 | |
| 4 years of college | 12 | |
| Social media use | 24 | |
| 5 | ||
| 1 | ||
| None | 4 | |
| Are you concerned | Yes | 29 |
| about security and | No | 5 |
| privacy when using | ||
| the Internet | ||
| Which device are you | Laptop | 19 |
| using to complete this | PC | 14 |
| survey | Smartphone | 1 |
| How long have you been | Less than 5 years | 6 |
| using the Internet | More than 5 years | 28 |
| Number of times you | 0 | 12 |
| have been a victim of | 1 | 9 |
| Internet attack/scam | More than 1 | 13 |
Scripts for Education on Email-Based Phishing
Text script link: https://goo.gl/noeybq
Audio script link: https://goo.gl/6oj86n
Surveys
Phishing Comprehension: https://goo.gl/Y4Tdc3
Media Preference: https://goo.gl/GfSfkX
| Demographics | No. of participants | No. of participants | |
|---|---|---|---|
| (Text Script Group ) | (Audio Script Group ) | ||
| Gender | Female | 11 | 8 |
| Male | 6 | 9 | |
Comments
There are no comments yet.