Term
| What are the 10 criteria that aid clinicians recognize pseudoscience treatment claims discussed by Finn, Bothe, and Bramlett (2005)? |
|
Definition
1. Untestable: Is the treatment unable to be tested or disproved
2. Unchanged: Does the treatment approach remain unchanged even in the face of contradictory evidence
3. Confirming Evidence: Is the rationale for the treatment approach based only on confirming evidence, with disconfirming evidence ignored or minimized
4. Anecdotal evidence: Does the evidence in support of the treatment rely on personal experience and anecdotal accounts
5. Inadequate Evidence: Are the treatment claims incommensurate with the level of evidence needed to support those claims
6. Avoiding Peer Review: Are treatment claims unsupported by evidence that has undergone critical scrutiny
7. Disconnected: Is the treatment approach disconnected from well established scientific models or paradigms
8. New Terms: Is the treatment described by terms that appear to be scientific but upon further examination are found not to be scientific at all
9. Grandiose Outcomes: Is the treatment approach based on grandiose claims or poorly specified outcomes
10. Holistic: Is the treatment claimed to make sense only within a vaguely described holistic framework |
|
|
Term
Open Access:
-Are funded by the ___
-Are ___ to the reader
-Are uploaded to ___ repositories upon publication
-Are correctly ___ to authors
-Make ___ part of the cost of doing research
-There might be a ___ turn-around time for submission and publication (review process)
-Publications appear in searchable ___
-Some of these are legitimate, while OTHERS are ___ |
|
Definition
| author; free; online; attributed; publication; quicker; databases; PREDATORY |
|
|
Term
Traditional Publications:
-There are typically ______ to the public for consumption
-They require a ___ fee to be able to access and are not free to the reader
-There is generally a ___ wait time between time of submission and time of publication (review process)
-These are usually ___ to the author to publish; the publication makes money through ___ |
|
Definition
| not free; subscription; longer; free; subscriptions |
|
|
Term
Predatory Publishers:
-“prey” on authors for ___ gain (fees charged for article publication) for open-access articles
-Do not meet scholarly publishing ___
-Lack ___ peer review
-Do not follow ___ ___ including archiving content, conflicts of interest, errata, copyright and licensing information, and transparency of processes and policies
-Focus on ___ over quality |
|
Definition
| financial; standards; external; standard policies; profit |
|
|
Term
What are the steps to EBP-From the Lecture:
-Asking a well built question (_____)
-Finding the ___ (selecting evidence sources, implementing a search strategy)
-___ and synthesizing the evidence
-Evaluate ___ and ___ factors
-Make a decision by ___ the evidence
-Evaluate the ___ of your decision |
|
Definition
| PICOT; evidence; Appraising; patient; clinician; integrating; outcomes |
|
|
Term
What are the steps to EBP-from the book:
What are the 3 goals of EBP? |
|
Definition
The integration of
(a) Clinical expertise
(b) Best current practice
(c) Client values |
|
|
Term
| What are the components of a good PICO(T) question |
|
Definition
P=Patient/population/problem
I=Intervention/Issue
C=Comparison/alternative
O=Outcome
T=Time frame |
|
|
Term
| What are the 6 levels of evidence? |
|
Definition
1. Meta-analysis/Systematic Review
2. Controlled randomized clinical trial
3. Non-randomized control study
4. Other quasi-experimental study
5. Nonexperimental study
6. Expert opinion |
|
|
Term
| What are a couple of well-known registries of meta-analyses/systematic reviews? |
|
Definition
| Educational Resources Information Center (ERIC), PubMed, Professional Association Websites, Google Scholar, EBSCOHost, Science direct. |
|
|
Term
PURPOSES OF AN INTRODUCTION:
-Introduce the ____ ___ under study
-Establish the theoretical and/or practical ___ of the research problem
-Provide an overview of the ___ literature
-Identify ___ and/or ___ in current knowledge
-Provide a rationale for how the proposed study will ___ knowledge in the area
-Describe specific research questions, ___ (usually at the last paragraph of the Introduction) |
|
Definition
| research problem/area; importance; relevant; gaps; deficiencies; advance; hypotheses |
|
|
Term
According to Sternberg (1993) the introduction to a research article should answer 4 basic questions:
1. What ___ ___ led to this research?
2. What does this research ___ to previous research?
3. Why is the addition made by this research ___ or ___?
4. ___ is the addition made? |
|
Definition
| previous research; add; important; interesting; How |
|
|
Term
| What are the three basic principles of protection of human research participants identified in the Belmont Report? |
|
Definition
| Respect for persons, beneficence, and justice |
|
|
Term
| recognize potential participants’ ability to make their own decisions |
|
Definition
|
|
Term
| protect the wellbeing of the persons who participate in research. Maximize possible benefits and minimize possible harms. |
|
Definition
|
|
Term
| make equitable decisions regarding who is invited to participate in research |
|
Definition
|
|
Term
| Which of the three basic principles of protection of human participants means persons make their own, informed decisions about participating in research? |
|
Definition
|
|
Term
| Given concerns about protecting the well-being of persons who participate in research, why do governmental agencies, professional organizations, and universities, among others, encourage research endeavors? |
|
Definition
| The reason is that the benefits of research usually outweigh the potential risks. When researchers have reasons to expect substantial benefits either for the individual participants or a societal group, then they have justification for conducting a study. |
|
|
Term
| Which of the principles of protection of human participants means researchers need to make equitable decisions regarding who is invited to participate in research? |
|
Definition
|
|
Term
| Identify two groups of research participants who receive special protections under federal law. |
|
Definition
| Persons in prison and children |
|
|
Term
| Provide an example of coercive or undue influence in recruiting participants for a research study. |
|
Definition
| Coercion through fear; offering extra credit in a class to participate in study; only offering therapy services if a person agrees to participate in research |
|
|
Term
| Provide an example of a violation of the principle of beneficence in the conduct of a research study. |
|
Definition
| The Tuskegee Syphilis Study (although it violated all 3 principles of ethics). The men were never told about or offered a treatment that was available, and when penicillin became available as an effective treatment, the researchers did not offer this new treatment nor inform the participants of it. |
|
|
Term
| What are two reasons why present day researchers feel that the Tudor (1939) study at the university of Iowa violated principles of human protection? |
|
Definition
| The children who stuttered who received positive verbal comments only stood to benefit from the research. The children with normal speech who received negative verbal comments were exposed to some degree of risk (psychological). Unintentional harm did occur due to the negative comments such as the reluctance and/or self-consciousness to speak. (beneficence). Historically, children who lived in an institution for orphans were exploited in research and were uniquely vulnerable populations in need of special protections (justice) |
|
|
Term
| What do the letters IRB mean? |
|
Definition
| Institutional review board: role is to evaluate proposed studies before the researchers begin collecting data, also to conduct a risk/benefit analysis of the proposed research to determine if risks to participants are minimal or justification based on potential benefits to the participants or society |
|
|
Term
-Credit for authorship = credit for ___ ___
-Citing a source = ___________
-More than one role = ____________ (ownership of interest, stock, stock options, or other economic interest related to research; compensation related to research; board, scientific officer or executive relationship related) |
|
Definition
| intellectual effort; attribution of ideas; conflict of interest |
|
|
Term
| Is it ever appropriate to use another author’s words in your writing? |
|
Definition
| No if not cited. Direct quotes are preferable to making small changes in the original statement and risking plagiarism or when the original sentence is particularly clear and any paraphrase weakens the line of reasoning. Direct quotes are also used when adding credibility to an argument or presenting an opposing opinion. “” for short quotes, and indented block style for longer quotes. |
|
|
Term
|
Definition
| Using another person’s findings as your own |
|
|
Term
| What kind of information is covered in the HIPPA “Privacy Rule?” |
|
Definition
| Provides regulations to protect the privacy of an individual’s protected health information. |
|
|
Term
| Do researchers have to follow the HIPPA “privacy Rule” when managing data for a research project? Explain. |
|
Definition
| Yes, “although HIPAA rules and regulations cover health information and not research specifically, clinician-investigators must comply with the privacy rule when they are affiliated with a covered organization and/or they are conducting research using protected health information obtained from a covered organization.” If researchers obtain health information in the course of their data gathering but don’t work for a covered organization, they still must protect the confidentiality and privacy of their participants’ information as specified in the common rule for protecting human research participants; they are not,, however, subject to additional regulations under the privacy rule. Confidentiality and Privacy – relates to handling research data and documents in a secure way. Protect the identity of participants and their information. |
|
|
Term
| “Formal, objective, systematic process in which numerical data are used as evidence to test hypotheses, refine theories, and advance knowledge”; type of research in which the researcher decides what to study; asks specific narrow questions; collects quantifiable data form participants; analyzes these numbers using statistics; and conducts the inquiry in an objective manner |
|
Definition
|
|
Term
Quantitative researchers…
-Present results as ___ or ___
-Use a ___ approach (read literature, deduce hypothesis, test)
-Select a ___ sample of subjects
-Spend ___ time with their subjects
-Test all subjects in the ___ way
-Summarize data across ___
-___ results to a population
-Usually researchers ___ from the process |
|
Definition
| quantities; numbers; deductive; large; limited; same; subjects; Generalize; removed |
|
|
Term
| A type of research in which the researcher relies on the views of participants; asks broad, general questions; collects data consisting of largely words (or text) from participants; describes and analyzes these words for themes; and conducts the inquiry in a subjective manner. |
|
Definition
|
|
Term
Qualitative researchers..
-Present results in ___
-Use an ___ approach (observe local situation, propose theory)
-Researcher ___ involved- spend a large amount of time with a subject
-___ approach as they proceed
-Cite responses from ___ subjects
-___ conclusions to persons actually observed
-___ data collection |
|
Definition
| words; inductive; heavily; Adjust; individual; Limit; Unstructured |
|
|
Term
| cause of the dependent variable; the condition that causes change |
|
Definition
|
|
Term
| the behavior that is changed |
|
Definition
|
|
Term
| mediate the relationship between the independent and dependent variable; May be responsible for changes in the dependent variable or they may negate, moderate, or even enhance the effect of the independent variable on the dependent variable |
|
Definition
|
|
Term
| when the extraneous factors are recognized and kept constant so as to minimize their effects on the outcome, they are referred to as the ___ variable. Ex: restricting a study to a certain age, or having a specific testing environment |
|
Definition
|
|
Term
| a variable that may be measured along some continuum or dimension that reflects at least the rank ordering of values of the variable and possibly reflects even more refined measurement of the actual numerical values of the variable; Ex: the intensity of a tone is measured along a numerical continuum from low to high values |
|
Definition
|
|
Term
| cannot be measured along a continuum; different values of the variable can only be categorized or named; Ex: Ex: subjects can be classified as “stutterers” or “non-stutterers” |
|
Definition
|
|
Term
-In ___ strategy, the experimenter MANIPULATES an independent variable while controlling for other potential extraneous variables to examine what effect the manipulation of the independent variable has on the dependent variable.
-In ___ research OBSERVES group differences, developmental trends, or relationships among variables that can be measured by the researcher. |
|
Definition
| EXPERIMENTAL; DESCRIPTIVE |
|
|
Term
| Is experimental or descriptive research strategy more superior? |
|
Definition
| Experimental research remains the strongest and most reliable technique available for determining cause-effect relationships among variables |
|
|
Term
| What kind of study is the best alternative for identifying potential cause and effect relationships when conducting a true experiment is not practical? |
|
Definition
|
|
Term
| used to measure changes in behavior or characteristics of people over time, usually to examine the influence of maturation or aging |
|
Definition
|
|
Term
Developmental Research:
-Tends to concentrate on very young and very old populations because it is concerned with the ___ ___ ___ as children grow and the changes in performance that accompany the normal aging process in the geriatric population
-The independent variable in developmental research is ___ and is usually indicated by general measurements of chronological or mental age
-___ ___: involves selection of subjects from various age groups and comparison of differences among the average behaviors or characteristics of the different groups
-___ ___: involves following the same group of subjects over time and measuring changes in their behavior |
|
Definition
| emergence of behavior; maturation; Cross sectional; Longitudinal plan |
|
|
Term
| used to study the relationships among two or more variables by examining the degree to which changes in one variable correspond with or can be predicted from variations in another |
|
Definition
|
|
Term
| used to measure the behavior of two or more types of subjects at one point in time to draw conclusions about the similarities or differences between them |
|
Definition
|
|
Term
| used to provide a detailed inspection of the prevalence of conditions, practices, or attitudes in a given environment by asking people about them rather than observing them directly |
|
Definition
|
|
Term
| when investigators examine data already on file before the formulation of the research questions, they are employing a ___ research strategy |
|
Definition
|
|
Term
| What is the primary difference between experimental and nonexperimental research designs? |
|
Definition
| Experimental: researchers identify one or more factors that they will manipulate or control during the experiment. Nonexperimental: researchers investigate existing conditions or differences without manipulating them. |
|
|
Term
Match the type of non-experimental study with its description:
-Obtain participants’ responses to questions =___ ___
-Compare persons with and without communication disorders = ___ ___ ___ (group comparison)
-Study a single person, situation, or organization = ___ study
-Determine the relationship between two variables = ___ study |
|
Definition
| survey research; case control study; case; correlation |
|
|
Term
| Do researchers conduct correlation studies to establish a cause and effect relationship between two variables? |
|
Definition
| No, they are studying the relationship between two variables to determine the strength of the relationship. The researchers are measuring levels of performance that the participants already achieved, NOT training or manipulating the participants in any way to improve their performance |
|
|
Term
| Explain how researchers test their participants when conducting a prediction study. |
|
Definition
| Researchers need to decide how long they will follow participants and how many measures they want to compare. Usually, researchers obtain several predictor measures and determine which variable or combo of variables produced the best results. (Type of correlation study). An example might be following a group of students to see how GRE scores and undergraduate GPA would predict graduate school GPA. |
|
|
Term
| What kind of study is the best alternative for identifying potential cause and effect relationships when not conducting a true experiment is not practical? |
|
Definition
| A causal-comparative study. It’s similar to a group comparison because researchers investigate existing differences, but researchers also try to obtain several pieces of information about each participant in an attempt to identify possible competing causal factors in the participants’ background and thus to strengthen the evidence for the causal variable under study. These can be retrospective or prospective studies. |
|
|
Term
Which of the following are non-experimental approaches? Select all that apply.
A. Randomly assigning participants to treatment and control groups
B. Correlation study comparing scores on two tests
C. Comparing children with communication disorders to age-matched peers
D. A-B-A-B single subject design
E. Survey of a random sample of speech-language pathologists |
|
Definition
|
|
Term
| The goal of randomized control trials is to allow for a ___ ___ of the influence of the IV by controlling of confounding variables. |
|
Definition
|
|
Term
Advantages of Randomized Controlled Trials:
-It eliminates selection ___ in assignment of subjects to treatment groups
-It can facilitate blinding of both the ___ and the ___
-It allows the use of probability statistics to determine the likelihood that the differences found between treatment groups are the consequence of ___ ___ opposed to chance variations |
|
Definition
| bias; investigators; subjects; experimental manipulations |
|
|
Term
| Most basic example of a true experimental design =___ only randomized control group design |
|
Definition
|
|
Term
| Here researchers randomly assign participants to different treatment groups, implement the different treatments, and then observe and measure their participants’ behavior. Participants are tested only after they complete the treatment step |
|
Definition
|
|
Term
| Most frequently used type of experimental design. Researchers observe and measure their participants’ behavior twice: at the beginning of the study before participants receive treatment and again at the end of the study after participants complete the treatment step |
|
Definition
|
|
Term
| Sequence = random assignment of participants to different groups, pretest observation and measurement of both groups, implementation of treatment for one of the groups, and posttest observation and measurement of both groups |
|
Definition
|
|
Term
| Participants are randomly assigned to treatment and control groups to start the study. After the first posttest, the participants switch roles: the treatment group becomes the control group and the control group becomes the treatment group for the second phase of the study. This addresses the issue of denying treatment to persons in the control group |
|
Definition
|
|
Term
| The researchers plan to manipulate two or more independent variables simultaneously. here , each of the independent variables is a factor, and each factor has two or more levels |
|
Definition
|
|
Term
-By using ___ designs, researchers can determine how more than one independent variable impacts a dependent variable, plus they can determine how the two independent variables work together or influence one another
-The effects associated with each of the independent variables are called ___ ___: ______ of intervention or ___ ___ of schedule
-____ effects: occur when the outcomes associated with one independent variable are different depending on the level of the other independent variable |
|
Definition
| factorial; main effects; main effects; main effects; Interaction |
|
|
Term
| ___ ___ refers to the extent to which researchers’ conclusions about cause and effect relationship are accurate. Threats to internal validity are a number of alternative explanations that could be the source of the changes in the ___ measure |
|
Definition
| Internal validity; dependent |
|
|
Term
| What are the 9 threats to internal validity? |
|
Definition
| History, maturation, pretest sensitization/ reactive effect of testing, Statistical regression, instrumentation, selection bias, mortality/ differential attrition, order/carryover effect, and observer expectancy |
|
|
Term
threats to internal validity:
-Outside influence occurring during the course of a study
Ex: if a classroom teacher started to implement some changes in methods that addressed skills the researchers were investigating |
|
Definition
|
|
Term
threats to internal validity:
-Increases in performance due to the participants’ growth and development and/or due to recovery over time. Important with KIDS |
|
Definition
|
|
Term
threats to internal validity:
-Knowledge gained from taking a pretest or changing one’s behavior due to taking a pretest |
|
Definition
| pretest sensitization/ reactive |
|
|
Term
threats to internal validity:
-Tendency for persons who received extreme scores when first tested to score closer to the mean when retested |
|
Definition
|
|
Term
Threats to internal validity:
Changes in either physical equipment or human observers between the pretest and posttest |
|
Definition
|
|
Term
Threats to internal validity:
Groups differ in a systematic way, rather than in a random way, prior to a study |
|
Definition
|
|
Term
Threats to Internal Validity:
Participants drop out before the end of a study
Loss of participants more significant when it is not random
Ex: participants with lowest scores or those making less progress in treatment dropout |
|
Definition
| mortality/ differential attrition |
|
|
Term
Threats to Internal Validity:
-doing treatment A first could affect treatment B results (order), or the effects of treatment A are still evident when performing treatment B |
|
Definition
|
|
Term
| The purpose of ___ research design is to explore cause and effect relationships. |
|
Definition
|
|
Term
| What are two important characteristics of a true experimental design? |
|
Definition
| researcher manipulation of a variable and random assignment of participants to different experimental groups |
|
|
Term
Explain the following design notation:
A. R O X O
B. R O __ O |
|
Definition
| This is a pretest-posttest randomized control group. Group A was randomized, pretested, given treatment, then post-tested. Group B was randomized, pretested, given no treatment, then post-tested. |
|
|
Term
| What is the primary distinction between a true experimental design and a quasi-experimental design? |
|
Definition
| only a true experimental design incorporates random assignment of participants into different experimental groups |
|
|
Term
| Why is switching replications design a good choice for intervention research? |
|
Definition
| It addresses an important issue in the pretest-posttest RCG designs--denying treatment to persons in the control group |
|
|
Term
| this refers to learning from a pretest or changing one’s behavior due to taking a pretest. This is a reason why researchers would choose a posttest only design. |
|
Definition
|
|
Term
Identify each of the following statements as most likely to apply to single-subject or group research designs:
A. Participants experience both the treatment and control conditions?
B. A good approach when participants respond in unique ways to the experimental intervention?
C. Provide the best level of evidence when researchers use random assignment of subjects to treatment and control conditions?
D. Data are usually presented in graphs or tables for individual subjects and often no statistical analysis is completed?
E. Researchers usually report the combined results for all participants? |
|
Definition
A. SSD
B. SSD
C. Group
D. SSD
E. Group |
|
|
Term
| Explain how maturation is a threat to the internal validity of a study and how including both randomized treatment and control groups addresses this threat |
|
Definition
| refers to increases in performance that are due to the participant's growth and development over time. Participants make improvement from pretest to posttest even without treatment. If the TX group improves more than the control group from pre to posttest, researchers have evidence that growth and maturation alone cannot account for results . |
|
|
Term
| Tendency for persons who received extreme scores when first tested to score closer to the mean when retested |
|
Definition
|
|
Term
| How could statistical regression affect the results of an intervention study? |
|
Definition
| If a person who scored close to the mean to begin with, then the scores can vary up and down. But with extreme scores, they have a strong probability of scoring closer to the mean because that is the only direction scores can move. Those who are extremely low will tend to score higher just based on statistical averages, so they would tend to score higher on a posttest even if they received no benefit from the TX. |
|
|
Term
| What is the best way to control for most threats to internal validity? |
|
Definition
| To have a treatment and control group |
|
|
Term
Explain the difference between a multiple baseline across behaviors SSD and a multiple baseline across subjects SSD:
-Multiple baseline across ___: a multiple baseline design in which the treatment variable is applied to two or more different behaviors of the same subject in the same setting.
-Multiple baseline across ___: a multiple baseline design in which the treatment variable is applied to the same behavior of two or more subjects in the same setting. |
|
Definition
|
|
Term
| How are a systematic review and meta-analysis different from the narrative review of literature that usually begins a research report? |
|
Definition
-A systematic review attempts to synthesize findings of several studies in a rigorous and transparent manner. These address a specific clinical question.
-Meta-analysis adds an additional component, a statistical analysis of the aggregated findings from several studies, and provides an estimate of the overall effectiveness of an intervention.
-A narrative review identifies articles that are relevant to a specific topic and offer an overview of relevant research for purposes of advocacy, policy, or to promote certain lines of research. |
|
|
Term
Why use SSD?
-___ design
-In some situations it is unethical to deny a control group treatment, so a ___-___ design is the alternative
-Study low ___ populations and behaviors.
-___ effective. It’s very expensive to conduct large-scale randomized control trials (RCTs).
-Evaluate intervention prior to large scale study. SSD is an “ideal tool for establishing the viability of treatments in ___-___ settings before attempts are made to implement them at the large scale needed for RCTs |
|
Definition
| Flexible; single-subject; incidence; Cost; real-life |
|
|
Term
| What are some limitations of SSD? |
|
Definition
| Low generalizability, unreliable interpretation, no established standards, and low agreement among observers |
|
|
Term
Variables considered in visual analysis of basic effect:
1. ___: The mean of the data within a phase. Also can be used to assess the level of the last 3-5 data points within a phase.
2. ___: The slope of the best-fit straight line describing data within a phase
3. ___: The level deviation of data around the slope of the best fit straight line (range, standard deviation)
4. ___: The percentage of data from one phase (typically the intervention phase) that overlaps with the range of data from the previous phase (typically the baseline phase) |
|
Definition
| Level; Trend; Variability; Overlap |
|
|
Term
Standards:
-___ manipulated by researcher
-Measured ___ over time
-Measured by more than ___ assessor
-Inter-assessor agreement meets ___ thresholds
-At least __ data points per phase |
|
Definition
| Actively; systematically; one; minimal; 5 |
|
|
Term
| Is AB a experimental design? |
|
Definition
| NO, it’s “pre-experimental” |
|
|
Term
This design has:
-Alternating phases of baseline (A) and treatment (B)
-Alternatives include the A-B-A-B design |
|
Definition
|
|
Term
| The systematic addition of behaviors, subjects, or settings for intervention. Used when baselines cannot be recovered after treatment has been received. |
|
Definition
|
|
Term
| Rapid alternation of treatments to a single subject to assess the effectiveness of two or more treatments |
|
Definition
|
|
Term
| Study table on study guide |
|
Definition
|
|
