A survey is an ordered series of questions or statements assessing attitudes, behaviors, or personal characteristics that is administered to individuals in a systematic manner. Surveys may be administered in a variety of mediums (e.g., paper, oral, electronic) using various delivery methods (e.g., face-to-face, telephone, mail, Internet).
Types of surveys
With the growth of the Internet and e-mail, electronic surveys are becoming more widely used. They can be distributed by paper (e.g., Course Instructor Survey), as e-mail messages, posted as forms on the Internet (e.g., Blackboard), or implemented electronically in classrooms (e.g., Classroom Performance System). Both paper and electronic surveys have strengths and weaknesses, and different electronic survey tools vary in their advantages and disadvantages.
Suggested uses of surveys:
- Assessing instructor performance.
- Gaining insight into student attitudes and outcomes about the course.
- Assessing changes in instructional practice, especially when used as part of a single-group experiment.
- Measuring the effects of an instructional activity or innovation when used as part of a single-group experiment.
Limitations of surveys:
- Not suitable for assessing individual student performance.
- Not suitable for collecting in-depth information.
- Requires some knowledge or understanding of relevant issues in order to write appropriate questions and properly organize a survey.
A moderate level of knowledge about survey design and question writing is required unless you are using previously validated questions or surveys. You should also understand how to use and interpret basic statistics (e.g. frequencies, means, weighting), and have experience or training in constructing and using spreadsheets databases (for very large classes or surveys). Data entry may be time consuming, requiring additional staff, although using scanable answer sheets or an electronic survey tool will greatly reduce the knowledge, training, and time required to enter and analyze survey responses. [more]
Plan your survey
STEP 1. Describe the context
Include the age, majors, educational background, motivation level, and skill levels of students. Also consider central goals of the course, your ability to implement changes, and how the instructional setting impacts your course. A worksheet is available to help you document your instructional context.
STEP 2. Identify stakeholder needs and develop central questions
Identify what is most essential for students, your needs, and any organizational priorities that impact your course. Central questions , informed by these needs, specify what you want to learn from an assessment. For example, "Are students effectively using online technology in my course?" A worksheet is available to help you identify stakeholder needs and develop central questions.
STEP 3. Determine the purpose of the survey
A survey should have a clear purpose and focus. Avoid the temptation of asking too many questions in a single survey or surveying students "just to see what's going on." Using your central questions as a guide, specify how your survey will help you gain insight, change course practices, or measure the effects of a change you have implemented. A worksheet is available to help you develop and refine your study’s purposes.
STEP 4. Determine how you will use the results
How you intend to use results should also guide the content of your survey. If you will not use responses to a survey question to guide course content or instruction, leave the question out. A worksheet is available to help exemplify how to use results after determining the purpose of a study.
STEP 5. Develop your assessment plan
Decide at what point in your course you will survey your students and schedule it into your course schedule. If you gather information using other assessment methods, be sure to include them in your plan and schedule them at different times. Refer to the teaching assessment planning process for additional help in developing your plan. Once your plan is made, begin creating your survey.
Create the survey
Write survey questions
Writing good survey questions is crucial to avoid compromising the validity of responses and limiting your ability to answer research questions. Rewrite questions until they are clear and succinct.
Determine question type
The information you want to obtain and how you plan to use it should dictate the question type or response scale you choose.
Organize and format the survey
The survey format is very important because a poorly organized survey may confuse respondents and lead them to skip questions or not complete the survey. [more]
Conduct pilot testing
Test the survey on a small sample of individuals that resembles your target sample (but does not include it) to check if the questions are answered as you intended and how long it takes to complete the survey. Revise questions as necessary before administering them to the study sample.
Babbie, E.R. (1973). Survey research methods. Belmont, CA: Wadsworth Publishing Company.
Bordens, K.S. and Abbott, B.B. (1996). Research Design and Methods: A Process Approach. 3rd ed. Mountain View, CA: Mayfield.
Punch, K. F. (2003). Survey research: The basics. London: Sage Publications Ltd.