Term
- Quasi-experimental design
|
|
Definition
A research design in which an experimental procedure is applied but all extraneous variables are not controlled
(always lack random assignment, does not meet all the requirements necessary for controlling the influence of extraneous variables) |
|
|
Term
Principles Used to Rule out Rival Explaations in Quasi Experiments
Number 1 |
|
Definition
1. Identification and study of plausible threats to internal validity: This principle involves identifying plausible rival explanations and then probing and investigating them to determine how likely it is that they can explain the covariation between the reatment and the outcome. |
|
|
Term
Principles Used to Rule out Rival Explaations in Quasi Experiments
Number 2 |
|
Definition
2. Control by design: This principle involves adding design elements such as additional pretest time points or additional control groups, to either elimnate a rival explanation or obtain evidence about the plausibility of the rival explanation. |
|
|
Term
Principles Used to Rule out Rival Explaations in Quasi Experiments
Number 3 |
|
Definition
3. Coherent pattern matching: This principle can be used when a coplex prediction can be made about a causal hypothesis, and there are few, if any, rival explanations that would make the same prediction. If the complex prediction is supported by the data, most rival explanations are eliminated. The more complex the prediction, the less likely it is that a rival explanation can explain the prediction and the more likely that the independent variable is producing the effect. |
|
|
Term
|
Definition
Structures and procedures used in constructing research designs
1) control or comparison groups (zero, one, or more than one)
2) pretest (zero, one, or more than one)
3) posttest (one or more than one)
4) within-participants and /or between participants independent variables
5) inclusion of one or more theoretically interesting IVs
6) measurement of one or more theoretically interesting DV's |
|
|
Term
Nonequivalent comparison group design |
|
Definition
A quasi-experimental design in which the results obtained from nonequivalent experimental and control groups are compared.
(most common of all quasi-experimental designs, will not be equivalent on all variables)
Consists of giving an experimental and control group first a pretest and then posttest. Tests are compared to determine if significant differences exist. |
|
|
Term
Possible Biases that exist in the Nonequivalent Comparison Group Design |
|
Definition
Selection bias--Because groups are nonequivalent, there will always be a potential selection bias. However, the pretest allows the exploration of the possible size and direction of the bias on any variables measured at pretesting.
Selection-attrition bias--The pretest allows examination of the nature of attrition to see if there is a difference between those that drop out or do not complete the experiment and those that do.
Selection-maturation bias--This might exist if one group of participants becomes more experienced, tired, or bored than those in the other group.
Selection-instrumentation bias--This might exist if the nonequivalent groups of participants start at different points on the pretest, particularly if the measuring instrument does not have equal intervals.
|
|
|
Term
Possible Biases that exist in the Nonequivalent Comparison Group Design (Continued) |
|
Definition
Selection-regression bias--This might exist if the groups are from different populations, such as the experimental treatment group from a population of individuals with a reading disability and the comparison group from a population of individuals without a reading disability.
Selection-history bias--This might exist if an event occurring between the pretest and posttest affects one group more than the other group. |
|
|
Term
Increasing treatment and control groups |
|
Definition
An outcome in which the experimental and the control groups differ at pretesting and both increase from pre- to posttesting, but the experimental group increases at a faster rate |
|
|
Term
Selection maturation effect |
|
Definition
Participants in one group experience a different rate of maturation than participants in another group. |
|
|
Term
|
Definition
An extraneous event occurring between pretest and posttest influences participants in one group differently than participants in another group. |
|
|
Term
Selection Instrumentation effect |
|
Definition
Participants' scores in one group are affected by the process of measurement, differently than participants in another group. |
|
|
Term
Selection-attrition effect |
|
Definition
Participants that drop out of one group are dissimilar to those in another group |
|
|
Term
Selection-regression effect |
|
Definition
Participants in one group display a different rate of regression to the mean than participants in another group |
|
|
Term
First increasing treatment effect |
|
Definition
An outcome in which the experimental and the control groups differ at pretesting, and only the experimental group's scores change from pre- to posttesting. |
|
|
Term
Second increasing treatment effect |
|
Definition
An outcome in which the control group performs better than the experimental group at pretesting, but only the experimental group improves from pre-to posttesting. |
|
|
Term
|
Definition
an outcome in which the control group performs better at pretesting but the experimental group performs better at posttesting. |
|
|
Term
Interrupted time-series design |
|
Definition
A quasi-experimental design in which a treatment effect is assessed by comparing the pattern of pre- and posttest scores for a single group of research partipants. |
|
|
Term
Regression discontinuity design |
|
Definition
A design that assigns participants t groups based on their scores on an assignment variable and assesses the effect of a treatment by looking for a discontinuity in the groups regression lines. |
|
|
Term
|
Definition
Measure used to assign participants to experimental and control groups. Those with scores below the cutoff score are assigned to one group, and those with scores above the cutoff are assigned to the other group. |
|
|
Term
Requirements of the Regression Discontinuity Design |
|
Definition
- Assignment to comparison groups must be based only on the cutoff score
- The assignment variable must be at least an ordinal variable, and it is best if it is a continuous variable. It cannot be a nominal variable such as sex, ethnicity, religious preference, or status as a drug user or nonuser.
- The cutoff score ideally should be located at the mean of the distribution of scores. The closer the cutoff score is to the extremes, the lower the statistical power of the design.
|
|
|
Term
Requirements of the Regression Discontinuity Design
(Continued) |
|
Definition
- Assignment to comparison groups must be under the control of the eperimenter to avoid a selection bias. This requirement rules out most retrospective uses of the design.
- The relationship between the assignment and outcome variables (whether it is linear, curvilinear, etc.) must be known to avoid a biased assessment of the treatment effect.
- All participants must be from the same population. With respect to the regression discontinuity design, this means that it must have been possible for all participants to receive the treatment conditon. This means that the design is not appropriate, for example, if the experimental participants are selected from one school and control participants from another.
|
|
|
Term
Single-case research designs |
|
Definition
Research design in which a single particpant or a single group of individuals is used to investigate the influence of a treatment conditon |
|
|
Term
|
Definition
A single-case design in which the response to the treatment conditon is compared to baseline responses recorded before and after treatment |
|
|
Term
|
Definition
The target behavior of the participant in its naturally occurring state or prior to presentation of the treatment condition |
|
|
Term
|
Definition
Change of behavior back to baseline level after withdrawal of treatment |
|
|
Term
|
Definition
Extension to ABA design to include reintroduction of the treatment condition |
|
|
Term
|
Definition
Removal of the treatment condition |
|
|
Term
|
Definition
A design in which the teatment condtion is applied to an alternative but incompatible behavior so that a reversal in behavior is produced. |
|
|
Term
|
Definition
Single-case design used to identify interacton effects |
|
|
Term
interaction effect in signel-case research |
|
Definition
The combined influence of two or more independent variables |
|
|
Term
|
Definition
A single-case design in which the treatment donditon is successively administed t several target participants, target outcomes, or target settings |
|
|
Term
|
Definition
Violation of design assumption in which changing one target (participant, outcome, or setting) produces changes in the remaining targets |
|
|
Term
Changing-criterion design |
|
Definition
A single-case design in which a participant's behavior is gradually shaped by changing the criterion for success during successive treatment periods. |
|
|
Term
|
Definition
A set of responses characterized by the absence of trend and little variability |
|
|
Term
|
Definition
In single-case research, repeated demonstration that a behavioral change occurs when the treatment is introduced |
|
|
Term
|
Definition
Demonstration that the treatment condition has eliminated a disorder or has improved everyday functioning. |
|
|
Term
|
Definition
Determination by others that the treatment condition has significantly changed the participant's functioning. |
|
|
Term
|
Definition
A social validation method in which the participant is compared with nondeviant peers |
|
|
Term
Subjective-evluation method |
|
Definition
A social balidation method in which others' views of the participants are assessed to see whether those others perceive a change in behavior |
|
|
Term
|
Definition
the type of research relying on qualitative research data |
|
|
Term
|
Definition
Type of research in which quantitative and qualitative data or approaches are combined in a single study |
|
|
Term
Twelve Major Characteristics of Qualitative Research
1st of 3 categories
Design Strategies |
|
Definition
1. Naturalistic inquiry--Studying real-world situations as they unfold naturally; nonmanipulative and noncontrolling; openess to whatever emerges (lack of predetermined constraints on findings).
2. Emergent design flexibility--Openness to adapting inquiry as understanding deepens and/or situations change; the researcher avoids getting locked into ridgid designs that eliminate responsiveness and pursues new paths of discovery as they emerge.
3. Purposeful sampling--Cases for study (e.g., people, organizations, communities, cultures, events, critical incidences) are selected because they are "information rich" and illuminative, that is, they offer useful manifestations, of the phenomenon of interest; sampling, then, is aimed at insight about the phenomenon, not empirical generalizations from a sample to a population |
|
|
Term
Twelve Major Characteristics of Qualitative Research
2nd of 3 categories
Data Collection and
Fieldwork Strategies |
|
Definition
4. Qualitative data--Observations that yield detailed, thick description; inquiry in depth; interviews that capture direct quotations, about people's personal perspectives and experiences; case studies; careful document review.
5. Personal experience and engagement--The researcher has direct contact with and gets close to the people situatuion, and phenomenon under study; the researcher's personal experiences and insights are an important part of the inquiry and critical to understanding the phenomenon.
6. Empathic neutrality and mindfulness--An empathic stance in interviewing seeks vicarious understanding without judgement (neutrality) by showing openness, sensitivity, respect, awareness, and responsiveness; in observation it means being fully present (mindfulness).
7. Dynamic systems--Attention to process; assumes changes as ongoing wheather focus is on an individual, an organization, a community, or an entire culture; therefore, mindful of and attentive to system and situation dynamics. |
|
|
Term
Twelve Major Characteristics of Qualitative Research
3rd of 3 categories
Analysis Strategies |
|
Definition
8. Unique case orientation--Assumes that each case is special and unique; the first level of analysis is being true to, respecting, and capturing the details of the individual cases being studied; cross-case analysis follows from and depends on the quality of individual case studies. (authentic perspective)
9. Inductive analysis and creative synthesis--Immersion in the details and specifics of the data to discover important patterns, themes, and interrelationships; begins by exploring then confirming, guided by analytical principles rather than rules, ends with a creative synthesis.
10. Holistic perspective--The whole phenomenon under study is understood as a complex system that is more than the sum of it's parts; focus on complex interdependencies and system dynamics that cannot meaningfully be reduced to a few discrete variables and linerar, casue-effect relationships. |
|
|
Term
Twelve Major Characteristics of Qualitative Research
3rd of 3 categories
Analysis Strategies (continued) |
|
Definition
11. Context sensitivity--Places findings in a social, historical, and temporal context; careful about, even dubious of, the possibility or meaningfulness of generalizations across time and space; emphasizes instead careful comparative case analyses and extrapolating patterns for possible transferability and adaptation in new settings.(in terms of time).
12. Voice, perspective, and relexivity--The qualitative analyst owns and is reflective about her or his own voice and perspective; a credible voice conveys authenticity and trustworthienss; complete objectivity being impossible and pure subjectivity undermining credibility, the researcher's focus becomes balance-understanding and depicting the world authentically in all its complexity while being self-anlytical, politically aware, and reflexive in consciouness. |
|
|
Term
|
Definition
Only noticing data that support one's prior expectations |
|
|
Term
|
Definition
Thinking critcally about one's interpretations and biases |
|
|
Term
|
Definition
Searching for cases that challenge one's expectations or one's current findings |
|
|
Term
|
Definition
The factual accuracy of the account reported by the researcher |
|
|
Term
Investigator triangulation |
|
Definition
Use of multiple investigators to collect and interpret the data |
|
|
Term
|
Definition
Accurately portraying the particpants' subjective viewpoints and meanings |
|
|
Term
|
Definition
Member checking to see if participants agree with researcher's statements, interpretations, and conclusions |
|
|
Term
Low-inference descriptors |
|
Definition
Descriptions that are very close to particpants' words or are direct verbatim quotes. |
|
|
Term
|
Definition
Degree to which the theory or explanaton fits the data |
|
|
Term
|
Definition
To provide for both discovery and validation researchers should collect data in the field over an extended time period |
|
|
Term
|
Definition
The use of multiple dat sources to help understand a phenomenon. |
|
|
Term
|
Definition
Using outside experts to assess the study quality |
|
|