Term
|
Definition
The entire set of individuals of interest |
|
|
Term
|
Definition
Set of individuals selected from a population Intended to represent the population |
|
|
Term
|
Definition
Actual list of units to be selected |
|
|
Term
|
Definition
Where the sample is selected from |
|
|
Term
|
Definition
Summary description of a given variable in a population |
|
|
Term
|
Definition
Summary description of a given variable in a sample Used to make estimates or inferences about population parameters |
|
|
Term
|
Definition
Difference between the characteristics of a sample and characteristics from which it was drawn |
|
|
Term
|
Definition
There is always some degree of sampling error. True or false? |
|
|
Term
|
Definition
Distribution is similar and not over- or under- represented Looks like the population from which it was selected in all respects that are potentially relevant to the study |
|
|
Term
|
Definition
The who or what being studied |
|
|
Term
relationship between sampling error and representativeness |
|
Definition
The larger the sampling error, the less representative of the population the sample is. |
|
|
Term
probability and non-probability |
|
Definition
|
|
Term
|
Definition
Method of selection in which each member of a population has a known chance or probability of being selected |
|
|
Term
|
Definition
Method of selection other than probability sample |
|
|
Term
|
Definition
The range of values within which a population parameter is estimated to lie (i.e. +/- reported in the news or on television) |
|
|
Term
|
Definition
Estimated probability that a population parameter lies within a given confidence interval Tells us the degree of certainty (i.e. 95% or 99%) |
|
|
Term
|
Definition
Every member of a population is listed and members are then randomly selected for questioning |
|
|
Term
|
Definition
Every member of a population is listed and then the (2nd, 4th, 21st, etc.) member is selected Cause for some concern on selection bias |
|
|
Term
|
Definition
The total population is divided into groups (or strata) and then members of each group are randomly selected (i.e. political survey, men vs. women) |
|
|
Term
disproportionate stratified sampling |
|
Definition
Deliberately drawing a sample that over- or under- represents some characteristics of a population May do this to ensure that we obtain a sufficient number of uncommon cases in our sample (i.e. violent crime in state, then in rural areas vs. large cities) |
|
|
Term
multi-stage cluster sampling |
|
Definition
Compile a stratified group (cluster), sample it, then sub-sample that set Useful when sampling frame is not available |
|
|
Term
non-probability sampling methods |
|
Definition
Snowball Purposive Availability Quota |
|
|
Term
|
Definition
Easy to find, convienent Conducting a preliminary study No systematic technique Sample not representative of any population |
|
|
Term
|
Definition
Quotas are set to ensure sample characteristics are proportionate to their prevalence in population Similar to stratified probability sampling (but less rigorous and precise in selection) More similar to availability |
|
|
Term
|
Definition
Each element selected for a purpose Use of judgment in whom to select (i.e. targeting knowledgeable people or targeting certain offenders) |
|
|
Term
|
Definition
Hard to reach/hard to find populations Interconnected populations Gaining elements through informants |
|
|
Term
|
Definition
Random sampling occurs in |
|
|
Term
|
Definition
Random assignment occurs in |
|
|
Term
|
Definition
Appropriate to topics that seem to defy quantification Verstehen Approach Grounded Theory |
|
|
Term
|
Definition
Researcher attempts to understand phenomena from the standpoint of the actors Comprehensive perspective Often no precisely defined hypothesis |
|
|
Term
|
Definition
Theory that is developed during the data gathering |
|
|
Term
characteristics of participant observations |
|
Definition
Demands on time and personal cost Observer must avoid over-socialization or “going native” Observer must attempt to operate mentally on two different levels (become an insider or remain an outsider) |
|
|
Term
|
Definition
Researcher not only joins in, but actually begins to manipulate the direction of, group activity |
|
|
Term
|
Definition
Researcher makes presence known and tries to objectively observe group activities Part of the group and participates |
|
|
Term
|
Definition
Researcher makes presence known but does not actively participate Not part of the group but may participate for the sake of undertanding |
|
|
Term
|
Definition
Researcher observes without becoming a participant Group is unaware that they are being studied |
|
|
Term
preparing for the field (field research) |
|
Definition
Access to formal organizations (i.e. sponsor, letter, phone call, meeting) Access to subcultures (i.e. informant, snowball sampling) |
|
|
Term
ways of recording observation |
|
Definition
Cameras and sound recorders Field notes Structured observations |
|
|
Term
cameras and sound recorders |
|
Definition
Capture actions and conversations |
|
|
Term
|
Definition
First, sketchy notes and then rewrite in detail Include "unimportant details" Mneumonics |
|
|
Term
examples of structured observations |
|
Definition
Close-ended questionnaire Environmental surveys |
|
|
Term
|
Definition
Structured observations in the field Records what an observer sees in the field (on specially designed forms) |
|
|
Term
advantages of field research |
|
Definition
Provides great depth of understanding Less prejudgement, more flexible High validity More appropriate (than surveys) for measuring behavior |
|
|
Term
disadvantages of field research |
|
Definition
Low reliability Low generalizability Time consuming Typically can't use probability sampling Ethical dilemmas Observer bias |
|
|
Term
examples of methods for data collection |
|
Definition
Counting crime Self-reports Perceptions and attitudes Policy proposals Targeted victim surveys Other evaluation uses |
|
|
Term
reasons for popularity of survey research |
|
Definition
Versatile, efficient and generalizable |
|
|
Term
conducting survey research |
|
Definition
Establish the goals of the project Determine the sample Choose survey methodology Create questionnaire Pre-test questionnaire Conduct interviews Enter data Analyze the data |
|
|
Term
examples of questionnaire construction |
|
Definition
Open-ended Restricted (close-ended, ranked scale) Partially open-ended Rating scale |
|
|
Term
|
Definition
Uses filter questions and a skip pattern Relevant only to some respondents (answers based on their previous responses) |
|
|
Term
|
Definition
Same set of answer categories used by multiple questions |
|
|
Term
maximizing validity in survey research |
|
Definition
Write clear, meaningful questions Response choices should be mutually exclusive Response categories should be exhaustive Respondents must be willing and able to answer Short items are best Avoid biased items and terms |
|
|
Term
potential issues with survey research questions |
|
Definition
Question-order effect Assumption of knowledge Leading questions Double-barreled questions Response sets |
|
|
Term
|
Definition
Use of specialized jargon in questions |
|
|
Term
double-barreled questions |
|
Definition
One question asks about two concepts |
|
|
Term
elements for gaining cooperation of survey research |
|
Definition
Cover letter Timing Interviewer |
|
|
Term
cover letter (for optimal research cooperation) |
|
Definition
Increase response rate and honesty Make it credible and personalized |
|
|
Term
timing (for optimal research cooperation) |
|
Definition
Avoid holiday seasons Household v. business surveys |
|
|
Term
interviewer (for optimal research cooperation) |
|
Definition
Confident/assertive Business-like People person |
|
|
Term
five aspects of interviewer behavior |
|
Definition
Presenting the study Asking the question Probing Recording answers Interpersonal relations |
|
|
Term
low validity of survey research |
|
Definition
Hard to get the real content you're after Not as accurate as observing directly |
|
|
Term
high reliability of survey research |
|
Definition
Same survey goes out to everyone Especially true for computer-assisted interviewing |
|
|
Term
approaches to data analysis |
|
Definition
Analyzing previously collected data Content analysis |
|
|
Term
previously collected data |
|
Definition
Data from agency records Data from other researchers (secondary data) |
|
|
Term
|
Definition
Learn about a society by analyzing it's social artifacts |
|
|
Term
|
Definition
Data collected first-hand |
|
|
Term
|
Definition
Data that has already been collected |
|
|
Term
|
Definition
The reanalysis of data that was originally gathered or compiled for other purposes |
|
|
Term
Freedom of Information Act |
|
Definition
Unless essential to national security, data should be available for legitimate research (concerning general access to secondary data) |
|
|
Term
advantages of secondary analysis |
|
Definition
Cheap and fast Benefit from work of skilled researchers Typically no IRB |
|
|
Term
disadvantages of secondary analysis |
|
Definition
Data might not be appropriate to your research question Least useful for evaluation studies CAN NOT make causal inferences |
|
|
Term
data that has been gathered for agency purposes, not research (as a limitation of agency records) |
|
Definition
Record keeping is a social process Incomplete data Misinterpretation of codes |
|
|
Term
reliability and validity issues (as a limitation of agency records) |
|
Definition
Changes in operational definitions of key terms over time Changes in procedures over time Data entry errors |
|
|
Term
unit of analysis (in agency records) |
|
Definition
Be aware of match or mismatch between units of analysis You can go from individual to aggregate BUT YOU CAN NOT go from aggregate to individual Otherwise, risk committing an ecological fallacy |
|
|
Term
|
Definition
Systematic study of messages Method for quantifying behavior must be defined Well suited to answer “who said what, to whom, why, how, and with what effect?” |
|
|
Term
performing a content analysis |
|
Definition
Determine your research question Determine your universe Determine your unit of analysis and sampling frame Determine your sample |
|
|
Term
things to remember when choosing research participants |
|
Definition
Not everyone can participate Interpretation of the data depends on how participants were selected |
|
|
Term
|
Definition
Collection of information from a sample of individuals through their responses to questions |
|
|
Term
examples of survey research |
|
Definition
Self-administered surveys In-person interview surveys Telephone Surveys |
|
|
Term
advantages of self-administered surveys |
|
Definition
Can get a large sample size Good for sensitive issues Low cost |
|
|
Term
disadvantages of self-administered surveys |
|
Definition
Inflexible Low response rate Electronic (acquiring a sampling frame) |
|
|
Term
advantages of in-person interview surveys |
|
Definition
High response rate Good if literacy is an issue High completion rate |
|
|
Term
disadvantages of in-person interview survey |
|
Definition
High cost Reliability issues (interviewer training is a must) |
|
|
Term
advantages of telephone surveys |
|
Definition
Interviewer convenience Ability to monitor interviewers Good if literacy is an issue Low cost |
|
|
Term
disadvantages of telephone surveys |
|
Definition
Ease of "hang up" for interviewee Reliability issues (interviewer training is a must) |
|
|
Term
quantitative data analysis |
|
Definition
Conducting experiments Evaluating policy innovations Data in the form of numbers, can be statistically analyzed |
|
|
Term
qualitative data analysis |
|
Definition
Theory- or hypothesis- generating activity Data is in the form of words, pictures or objects |
|
|
Term
|
Definition
Ratio of a) time working on field notes to b) actual time in the field |
|
|