Page 125 - THE DUTCH TALKING TOUCH SCREEN QUESTIONNAIRE

Evoluation of the Dutch and Turkish version
Analyses
Data were analyzed using a thematic content analysis approach [40]. Four types of data were analyzed: 1. Video recordings of the completion of the questionnaire, 2. field notes of the observed participant behavior 3. transcriptions of the audio recordings of the semi-structured interviews and 4. background information regarding the educational level, age, gender, and self-reported experience with using mobile technology.
To get more familiar with the data and to create an overview, researcher MW made a descriptive summary of each case on the basis of all four types of generated data. Each summary contained information on whether or not the questionnaire was fully completed, if, when and why the stop function was used, the kind of problems that occurred with the operation, the completion time and all emerging themes regarding satisfaction or dissatisfaction with the ease of use of the questionnaire. The summaries were supplemented with information regarding educational level, age, gender and experience in using mobile technology.
Subsequently, researcher MW derived the observed problems from the summaries. She clustered the problems. For every new problem a new category was made. MW analyzed the video recordings to see how many times each problem was made in total, per participant and per question/screen of the questionnaire. After a full overview of problems had emerged she scored the level of severity of each problem as described by Nielsen and Loranger [41]: low, medium, serious or critical. To score severity she used the method of Hattink et al. [42]: The severity was scored by answering the three questions of Nielsen and Loranger [41] with ‘yes’ (= one point) or ‘no’ (= 0 points):
1. Frequency: Does a substantial amount of users encounter the problem? Within the current study this question was answered with ‘yes’ if one third or more participants had encountered the problem.
2. Impact: Does the problem cause much trouble to those users who encounter it? Within the current study this question was answered with ‘yes’ if the problem had led at least one participant to stop completing the questionnaire.
3. Persistence: Does the problem cause trouble repeatedly? Within the current study this question was answered with ‘yes’ if the
119
4.2