Shared Flashcard Set

Details

Internal and External Validity
Fall 2011 Session 7
16
Education
Graduate
10/06/2011

Additional Education Flashcards

 


 

Cards

Term
Threats to Internal Validity: History
Definition
  • Threatens when events occure between the pretest and posttest of a research study that could affect participants in such a way as to impact the dependent variable
  • ex) stress, natural disasters, news events, illness
  • To control history effect researcher should use a control group
Term
Threats to Internal Validity: Maturation
Definition
  • Occurs when changes are seen in subjects because of the time that has elapsed since the study began and that may not be the result of any program effects
  • ex) over time the participant may have become older, wiser, stronger, or more experienced
  • most common when children are studied
Term
Threats to Internal Validity: Testing
Definition
  • Often necessary to pretest participants before beinning a study to establish a basline level, which is a measurement taken to obtain the status or level of variable prior to initating a study.
  • participants may learn how to do better on the test or be "test-wise" the next time they take the test
Term
Threats to Internal Validity: Instrumentation
Definition
  • Can cause threats to internal validity when measurements are not used accurate or procedures are not standardized
  • written instruments must accurately measure wheat they are supposed to measure or internal validity will be threatened.
  • physical equipment must be carefully calibrated to give consistent and accurate results
Term
Threats to Internal Validity: Selection Bias
Definition
  • introduces the possibility that participants in experimental and control groups may have differences before the start of the study that could account for any differences found between groups during the study, instead of such differences being due to the effects of the independent variable
  • occurs when individuals are selected in nonrandom manner
Term
Threats to Internal Validity: Selection Maturation Effect
Definition
  • occurs when using intact groups that vary in their maturation level
  • pretesting and/or prescreening groups on maturity levels is a way to avoid this threat to internal validity
Term
Threats to Internal Validity: Statistical Regression
Definition
  • occurs when participants are selected on the basis of their extremely high or low scores
  • essentially, those who scored the highest may have nowhere to move but down, and those what scored the lowest have nowehere to move but up
Term
Threats to Internal Validity: Mortality/Attriction
Definition
  • in longterm studies some participants may die or be in such poor state of health they cannot complete the study
  • participants may move and not provide updated contact info and will be lost to the study
  • participants may drop out of the study
  • Oversampling and using large group sizes is one way to overcome mortality. Using incentives to stay in the study can also help reduce mortality
Term
Threats to Internal Validity: Hawthorn Effect
Definition
  • Occurs when participants' attitudes toward being involved in a study affect the way they behave
  • To control Hawthorn effect, researcher may try to provide the control group with some type of special treatment that is comparable to the experimental groupo but would not have a direct impact on the dependent variable
Term
Threats to Internal Validity: Placebo Effect
Definition
  • Caused by participants' expectations rather than by any provided treatment
  • To control placebo effect, participants are unaware if they have the real treatment or a placebo it is ablind study. If researcher does not know who is taking the real treatment or placebo it is a double blind study
  • To avoid placebo effect, researchers make sure the control and experiemental groups receive the same information
Term
Threats to Internal Validity: Diffusion of Treatment
Definition
  • Occurs when the treatment being applied to one groupo spills over or contaminates another group
  • ex) when group A tells group B about what they are doing and causes the group B to do what group A was doing
Term
Threats to Internal Validity: Location
Definition
  • Occurs when there are differences in the locations where interventions take place
  • Best method to control for a location effect is to make the locations the same for all participants. Researcher should do everything possible to minimize location differences that could impact the dependent variable
Term
Threats to Internal Validity: Implementation
Definition
  • Involves the individual or individuals responsible for implementing the experimental treatment and the possibility that they may inadvertently introduce inequality or bias into the study
  • Can occur if there are multiple people providing the treatment program or intervention, they may not be equal in their knowledge levels, understanding of the program, personality traits, presentation skills, etc
  • Can be controlled by trying to make sure that all persons responsible for implementing the program are equally trained and competent, and by following a standardized protocol for implementation
  • can occur is an indicidual implementing the intervention inadvertently favors one group over another
  • can be controlled if someone other than the program developer presents the program
Term
Threats to External Validity: Selection Treatment Interaction
Definition
  • Concerns the ability of a researcher to generalize the results of a study beyond the groups involved in the study
  • ex) overgeneralizing to groups for whom the study results might not apply (assume results of experiment are valid then results for group being studied are valid for group being studied)
  • ex) a study uses a random sample of participants, results can legitimately be generalized to the group from which the random sample was selected
Term
Threats to External Validity: Setting Treatment Interaction
Definition
  • Concerns the extent to which the environmental conditions or setting under which an experimental study was conducted can be duplicated in other settings
Term
Threats to External Validity:History Treatment Interaction
Definition
  • Develops when the researcher tries to generalize findings to past and future situations.
  • Some experiments may be time-sensitive and may not produce similar results if conducted earlier or later
Supporting users have an ad free experience!