Steps of Survey Design
- Define Goal of Project
- Determine Sample
- Determine acceptable Margin of Error
- Choose method(s) of Collecting Data
- Create Script/Questionnaire
Checklist for drafting good questions
1. Do the answers to the questions help meet the objectives of the survey?
2. Do the questions address the most bothering issues of the target population?
3. Is the language simple and devoid of technical jargon?
4. Are key terms such as “regulation” clearly defined?
5. Do you avoid asking two questions in one, i.e. do all questions only ask one question at a time?
6. Are questions clear and precise enough that they will be consistently understood in the same way by all respondents?
7. Are the formulation of questions and answer choices and their order as neutral as possible, i.e. do they avoid suggesting answers?
8. Are the answer choices and scales clearly defined and consistently understood across respondents? Have both been chosen carefully?
9. Does the target population have the capacity and knowledge to answer all questions?
10. Have screening questions been included, that is, has the same question been asked in different ways to identify consistent respondents and meaningful responses?
11. Have tricky questions been included towards the end of the survey when respondents feel more comfortable answering them?
12. Is the questionnaire short enough to ensure that respondents will concentrate until the end?
source: OECD (2012), “Good Practices in Survey Design Step-by-Step”, in Measuring Regulatory Performance: A Practitioner’s Guide to Perception Surveys, OECD Publishing. For a more detailed checklist, see also Fowler, Floyd J., Jr. and Carol Cosenza (2008), “Writing effective survey questions”, in: De Leeuw, Edith D., Joop J. Hox and Don A. Dillman (eds.), The international handbook of survey methodology, Mahwah, NJ: Lawrence Erlbaum, p. 159.
- Duke University – Tip Sheet on Question wording
- Levy, Paul S. and Stanley Lemeshow. 2009. Sampling of Populations: Methods and Applications, 4th ed. New York: Wiley.
- Sample Size Calculator