"The goal is to write straightforward, unambigious, and unbiased questions that will elicit usable, reliable, and valid information"
(Schweigert, 2012, p.206).
Survey development
Sampling
1. Determine exactly what information is needed
2. Develop a first draft
3. Pilot the draft
4. Modify survey
5. Test-run again
6. Modify if needed and put to use!
Systematic sampling
Stratified sampling
Cluster sampling
Convenience sampling
Snowball sampling
Disadvantages:
- Mail & Internet- weak response rates
- Self-administerd, can't clarify questions
- Unsure who is responding
- Can't access certain populations
- Certain type of person who is willing to complete surveys
- Telephone - potential interviewer bias
Advantages:
- Reach large and wide potential respondents
- Complete on own time
- Inexpensive
- Reduces interviewer bias; sampling bias
- Mail - Sensitive information
- Internet - Reach specific population of interest
- Internet - Immediate return
- Telephone - Higher response rate
- Telephone - Establish rapport
Mail surveys
Telephone surveys
Internet surveys
Interviews
Purpose: to assess opinions or compare groups; to provide answers to applied research questions
Constructing the Survey
Advantages?
Disadvantages?
Scales and defining the scale
Wording:
- open-ended & closed questions
- leading questions
- loaded questions
- double barreled question
Closed questions:
On average, how many hours of television do you watch per day?
a. 0-1 hours
b. 1-2 hours
c. 2-3 hours
d. 3 hours or more
Open-ended:
On average, how many hours of television do you watch per day?
____hours
Affordable Care Act vs. Obamacare
Constructing the survey
-Layout - in what order do you ask the questions?
- Demographic questions - first or last
-Flow
-Wording!
Leading:
"Most people believe recyclng is an important way to help conserve resources. Do you agree?"
Loaded:
"Do you believe that radical extremists have the right to burn our country's beloved symbol of freedom, the flag?"
- https://www.donaldjtrump.com/landing/2020-trump-vs-dem-poll
Double-barreled:
"Do you find your job interesting and exciting?
The goal is for survey responses to lead to reliable and valid information.
Surveys