Term
Characteristics of interviews and questionnaires |
|
Definition
Qualitative and quantitative, subjective, end users or other stakeholders |
|
|
Term
Characteristics of observation |
|
Definition
Qualitative and quantitative, objective, experimental or naturalistic |
|
|
Term
Characteristics of experiments |
|
Definition
Quantitative, objective, experimental, examine dependent variables against independent variables, often used to compare two designs or performance between groups |
|
|
Term
Characteristics of heuristic evaluation |
|
Definition
Mostly qualitative, use HCI experts instead of users, predictive |
|
|
Term
What are some different evaluation techniques? |
|
Definition
Interviews, questionnaires, observation, experiments, heuristic evaluation, cognitive walkthrough, predictive evaluation, diary studies, experience sampling |
|
|
Term
When do you use interviews? |
|
Definition
When you want to explore issues; when respondents need to be persuaded to answer the questions |
|
|
Term
When do you use questionnaires? |
|
Definition
When motivation is high enough to complete a questionnaire without anyone else present, when you need to involve people in remote locations or who can't attend an interview at a particular time; when you want to answer specific questions |
|
|
Term
When do you use focus groups? |
|
Definition
When you want to collect multiple viewpoints; when you want to answer specific questions |
|
|
Term
When do you use focus groups? |
|
Definition
When you want to collect multiple viewpoints; when you want to raise difficult issues |
|
|
Term
When do you use observation? |
|
Definition
When it is difficult for the participant to explain what they do |
|
|
Term
When do you use the Wizard of Oz technique? |
|
Definition
When you want to simulate a system that would be hard to build |
|
|
Term
What are some guidelines for the Wizard of Oz Technique? |
|
Definition
The interaction should be algorithmic; hide the wizard as much as possible; the goal is feedback |
|
|
Term
How do you analyze the data from an interview? |
|
Definition
Transcribe, expand, and summarize the data; label demographics, patterns, and unusual things; categorize; graph the categories, stories, and quotes |
|
|
Term
How do you analyze the data from a questionnaire? |
|
Definition
Find percentages and medians; look for trends and patterns and compile answers; create graphs, charts, and pie charts |
|
|
Term
How do you analyze the data from observation? |
|
Definition
Identify critical incidents, reorganize, transcribe audio, expand upon notes; categorize and tally, calculate timings, clicks, errors, etc.; figure out what the problems were, what participants did wrong, etc.; create stories, quotes, graphs, charts, etc. |
|
|
Term
|
Definition
Comparing the rates of an expected value to an observed value |
|
|
Term
In A/B testing, the A and B are what kind of variable? |
|
Definition
|
|
Term
A Likert-type scale is which kind of measurement? |
|
Definition
|
|
Term
Color is what kind of scale? (Nominal, ordinal, interval, or ratio) |
|
Definition
|
|
Term
Unsatisfied/Neutral/Satisfied is what kind of scale? (Nominal, ordinal, interval, or ratio) |
|
Definition
|
|
Term
Low/Medium/High is what kind of scale? (Nominal, ordinal, interval, or ratio) |
|
Definition
|
|
Term
Body temperature is which kind of measurement? |
|
Definition
|
|
Term
Age is which kind of measurement? |
|
Definition
|
|
Term
The evaluation team tells you that on average lions prowled 10% faster with the new periphery design than with the old one? What other information would you need in order to trust that result? |
|
Definition
|
|
Term
|
Definition
Asking users what they think about your prototype, design, or ideas in person |
|
|
Term
|
Definition
An interview involving a group (typically of 3-10 people) lead by a trained facilitator |
|
|
Term
|
Definition
A set of written questions asking users what they think about your prototype, design, or ideas |
|
|
Term
|
Definition
Watching user perform tasks with your interface |
|
|
Term
|
Definition
Testing a hypothesis about your interface |
|
|
Term
|
Definition
Informally describe human activities or tasks in a story that allows contexts, needs, and requirements to be explored and discussed |
|
|
Term
|
Definition
A series of sketches showing how a user might progress through a task using the product |
|
|
Term
|
Definition
A video showing what the design team imagines it would be like to use a system |
|
|
Term
|
Definition
A mock-up of a user interface made using a pen and paper rather than a computer |
|
|
Term
|
Definition
Technique in which someone simulates and controls a system from behind the scenes |
|
|
Term
|
Definition
How closely a prototype resembles the final product |
|
|
Term
|
Definition
A visual guide that represents an application's skeletal framework |
|
|
Term
|
Definition
|
|
Term
|
Definition
|
|
Term
|
Definition
When several experts examine the interface using heuristics |
|
|
Term
|
Definition
When several experts assess how easy the interface is for novices to learn |
|
|
Term
|
Definition
When users relate experiences on a regular basis |
|
|
Term
|
Definition
When users are periodically interrupted with a very short questionnaire |
|
|
Term
|
Definition
The probability your null hypothesis is wrong simply by chance |
|
|
Term
|
Definition
Statistical test that compares two means |
|
|
Term
|
Definition
Technique where participants vocalize what is in their head as they perform tasks |
|
|
Term
|
Definition
Has multiple categories and no intrinsic order |
|
|
Term
|
Definition
Has multiple categories and a clear ordering |
|
|
Term
|
Definition
Has multiple categories, an equally spaced interval between them, and no clear definition of zero |
|
|
Term
|
Definition
Has multiple categories, an equally spaced interval between them, and a clear definition of zero |
|
|
Term
|
Definition
A variable that stands alone and isn't changed by other variables |
|
|
Term
|
Definition
A variable that depends on other factors |
|
|
Term
|
Definition
A factor in an experiment that you try to prevent from impacting the outcomes |
|
|
Term
|
Definition
A randomized experiment with two variants, A and B, which are identical except for one variation that might affect a user's behavior |
|
|
Term
Semi-structured interview |
|
Definition
An interview that has a set of questions, but allows the interviewer to ask follow up or additional questions |
|
|
Term
Completely structured interview |
|
Definition
An interview with strictly defined questions that is similar to a survey but verbal |
|
|
Term
|
Definition
An interview that has a goal or topic but no set list of questions |
|
|
Term
|
Definition
Watching and asking people to learn about their goals and values to uncover user needs and opportunities for improvement |
|
|
Term
|
Definition
A numerical scale used for measuring options, attitudes, and beliefs |
|
|
Term
|
Definition
Visual representation of a set of steps, along with user thoughts and emotions |
|
|
Term
|
Definition
An informal, natural language description of one or more features of an application written from a user's perspective |
|
|
Term
|
Definition
A limited manifestation of a design that allows stakeholders to interact with it and explore how suitable it is |
|
|