What kinds of information and insights did it give you about the usability of the prototype?


By switching between three different roles, I think the role of observer inspired me a lot. I found out the expression sheet is a helpful tool while observing the user. Without the sheet, I discovered difficult to take down notes about user’s behavior, which includes both verbal and non-verbal behaviors. The expression sheet provides an extensive selection of user’s behaviors which helped me to save time on taking down notes and pick up more detail information.


What aspects of the technique worked well or were frustrating?


Like said above, the expression sheet is a great method to use because it saves observer time on taking down notes and focus the user on obtaining more information.  Additionally, I think observation overall is a great method because user’s non-verbal action is essential for evaluation.

Thinking aloud is the method which frustrating me a lot. Because it relies on user’s willingness to participant in the test. If the task is overall smooth and had no major issues, It might be difficult for the user to provide any meaningful ideas. This also depends on the personality of the test user, some user prefers to talk about more, and some don’t. When facing test user that speaks less, observation is a better technique to work with rather than thinking aloud.