Term
| valid, accurate & reliable |
|
Definition
| To be most useful for science, measurement must be _____. |
|
|
Term
| Three Element of Valid Measurement in ABA |
|
Definition
- measuring directly a socially significant target behavior
- measuring a dimension of the target behavior relevant to the question or concern about the behavior
- Ensuring that the data are representative of the behavior under conditions and during times most relevant to the reason for measuring it. |
|
|
Term
|
Definition
| Measurement is _____ when observed values, the data produced by measuring an event, match the true state, or true values, of the event. |
|
|
Term
|
Definition
| Measurement is _____ when it yields the same values across repeated measurement of the same event. |
|
|
Term
|
Definition
| Indirect Measurement involves measuring behavior that is _____ from the behavior of interest. |
|
|
Term
|
Definition
| Indirect Measurement threatens validity because it requires the researcher or practitioner to _____ about the relationship between the measures obtained and the actual behavior of interest. |
|
|
Term
|
Definition
| A researcher who uses _____ must provide evidence that the behavior measured directly reflects, in some reliable and meaningful way, something about the behavior for which the researcher wishes to draw conclusions. |
|
|
Term
|
Definition
| Measuring a dimension of the behavior that is ill suited for, or irrelevant to, the reason for measuring the behavior compromises validity |
|
|
Term
| the way the measurement was conducted |
|
Definition
| Measurement artifacts are data that give an unwarranted or misleading picture of the behavior because of ______. |
|
|
Term
|
Definition
| Discontinuous measurement, poorly scheduled observations, and insensitive or limiting measurement scales are common causes of _____. |
|
|
Term
|
Definition
| Most investigations in applied behavior analysis use human observers to measure behavior, and _____ is the biggest threat to the accuracy and reliability of data. |
|
|
Term
|
Definition
| Factors that contribute to _____ include poorly designed measurement systems, inadequate observer training, and expectations about what the data should look like. |
|
|
Term
|
Definition
| Observers should receive systematic training and practice with the measurement system and meet predetermined accuracy and reliability criteria ____ collecting data. |
|
|
Term
|
Definition
| Observer Drift involves _____ in the way an observer uses a measurement system over the course of an investigation. |
|
|
Term
|
Definition
| ____ can be minimized by booster training sessions and feedback on the accuracy and reliability of measurement. |
|
|
Term
| expectations or knowledge |
|
Definition
| An observer's _____ about predicted or desired results can impair the accuracy and reliability of data. |
|
|
Term
|
Definition
| Observers ____ receive feedback about the extent to which their data confirm or run counter to hypothesized results or treatment goals. |
|
|
Term
|
Definition
| Measurement bias caused by observer expectations can be avoided by using ____ observers. |
|
|
Term
|
Definition
| Observer reactivity is measurement error caused by an observer's _____ that others are evaluating the data he reports. |
|
|
Term
| Benefits of assessing the accuracy of data |
|
Definition
- Determine early in an analysis whether the data are usable for making experimental or treatment decisions
- Discover and correct measurement error
- Detect consistent patterns of measurement error that can lead to the overall improvement or calibration of the measurement system
- Communicate to others the relative trustworthiness of the data. |
|
|
Term
|
Definition
| Assessing the accuracy of measurement is a straightforward process of calculating the _____ of each measure, or datum, assessed to its true value. |
|
|
Term
|
Definition
| Ture values for some behaviors (e.g., cooperative play) are difficult because the process for determining a true value must be different from the measurement procedures used to obtain the data one wishes to compare to the true value. |
|
|
Term
| evident and universally accepted |
|
Definition
| True values for many behaviors of interest are _____ or can be established conditionally by local context. |
|
|
Term
|
Definition
| Assessing the extent to which observers are reliably applying a valid and accurate measurement system provides a useful indicator of the overall _____ of the data |
|
|
Term
| natural or contrived permanent product |
|
Definition
| Assessing the reliability of measurement requires a _____ so the observer can re-meaure the same behavioral events. |
|
|
Term
|
Definition
| Although high reliability does not confirm _____, discovering a low level of reliability signals that the data are suspect enough to be disregarded until problems in the measurement system can be determined and repaired. |
|
|
Term
| interobserver agreement (IOA) |
|
Definition
| The most commonly used indicator of measurement quality in ABA is _____. |
|
|
Term
|
Definition
| IOA is the degree to which two or more _____ observers report the same observed values after measuring the same events. |
|
|
Term
| The use of IOA by researchers & practitioners |
|
Definition
- Determine the competence of new observers
- Detect observer drift
- judge whether the definition of the target behavior is clear and the system is not too difficult to use
- convince others of the relative believability of the data |
|
|
Term
|
Definition
- two or more observers
- use the same observation code and measurement system
- observe and measure the same participant and events
- observe and record the behavior independent of influence b other observers. |
|
|
Term
|
Definition
| There are ____ techniques for calculation IOA, each of which provides a somewhat different view of the extent and nature of agreement and disagreement between observers. |
|
|
Term
|
Definition
| ____ between observers is the most common convention for reporting IOA in ABA. |
|
|
Term
| Calculating IOA data from Event Recording |
|
Definition
- Total count recorded by each observer per measurement period
- the counts tallied by each observer during each of a series of smaller intervals of time within the measurement period
- each observer's count of 1 or 0 on a trial-by-trial basis. |
|
|
Term
|
Definition
| ____ is the simplest and crudest indicator of IOA for event recording data. |
|
|
Term
|
Definition
| ____ is the most stringent indicator for most dada sets obtained by event recorded. |
|
|
Term
| essentially The same ways |
|
Definition
| IOA for data obtained by timing duration, response latency, or inter response time (IRT) can be calculated in _____ as for event recording data. |
|
|
Term
|
Definition
| Computed by dividing the shorter of the two durations reported by the observers by the longer duration. |
|
|
Term
|
Definition
| A more conservative and usually more meaningful assessment of IOA for total duration data and it should always be calculated for duration-per-occurance data. |
|
|
Term
| Three Techniques to calculate IOA for Interval Data |
|
Definition
- Interval-by-Interval IOA
- Scored-Interval IOA
- Unscored-Interval IOA |
|
|
Term
|
Definition
| Because it is subject to random or accidental agreement between observers, Interval-by-Interval IOA is likely to ____ the degree of agreement between observers measuring behaviors at very low or very high rates. |
|
|
Term
|
Definition
| Scored-Interval IOA is recommended for behaviors that occur at relatively _____. |
|
|
Term
|
Definition
| Unscored-Interval IOA is recommended for behaviors that occur at relatively _____. |
|
|
Term
|
Definition
| IOA assessments should occur during _____ of a study and be distributed across days of the week, times of day, setting, observers. |
|
|
Term
|
Definition
| Researchers should obtain and report ___ at the same level at which they report and discuss the results of their study. |
|
|
Term
| stringent and conservative |
|
Definition
| More _____ IOA methods should be used over methods that may overestimate agreement as a result of change. |
|
|
Term
|
Definition
| The convention for acceptable IOA has been a minimum of ____, but there can be no set criterion. |
|
|
Term
|
Definition
| The nature of the behavior being measured and the degree of behavior change revealed by the data must be considered when determining an acceptable level of IOA. |
|
|
Term
|
Definition
| _____ can be reported in table, narrative and graphic form. |
|
|
Term
|
Definition
| Researchers can use _____ to asses the quality of their data (e.g., accuracy plus IOA, reliability plus IOA). |
|
|
