Evaluate programs



Observation refers to the systematic examination of program processes or operations with the goal of identifying needs/challenges or improving program processes and practices. Observations typically incorporate a prescribed protocol containing specific measures of observable behavior and the narrative recording of the program activities and their context. Types of observational approaches include: check lists, scaled ratings, interval observations, and narrative comments. [more]

Suggested uses of observations:

Limitations of observations:

Resource requirements

Implementing this method requires moderate resources: developing an observational protocol, hiring an experienced assistant or finding a colleague to conduct multiple observations, taking the time to discuss each observation with the observer, and compiling and analyzing the data gathered. [more]

Plan your observation

STEP 1. Describe the context

Include the age, majors, educational background, motivation level, and skill levels of students/clients. Also consider central goals of the program, your ability to implement changes, and how the organizational context impacts your program. A worksheet is available to help you document your program context.

STEP 2. Identify stakeholder needs and develop central questions

Identify what is most essential for clients, program staff, and any organizational priorities that impact your program. Central questions, informed by these needs, specify what you want to learn from an evaluation. A worksheet is available to help you identify stakeholder needs and develop central questions.

STEP 3. Determine the purpose of the observation

Your observational study should have a clear purpose and focus. Using your central questions as a guide, specify how your observation will help you gain insight, change course practices, or measure the effects of a change you have implemented. A worksheet is available to help you develop and refine your study’s purposes.

STEP 4. Determine how you will use the results

How you intend to use results should also guide the focus of your observations. Focus observations on only those program components you are willing to adjust or change. A worksheet is available to help exemplify how to use results after determining the purpose of a study.

STEP 5. Develop an observation form

Create an observation form appropriate to context, purpose, and use that will answer your central questions. Once your form is complete, perform multiple observations of the program activity or setting. Vary the times and days you observe. Observe for at least a 30 minute interval. Meet with program staff prior to the observation to gather relevant program materials, information about the program activity or context, and the goals for the activity being observed.

Additional information

Lofland, J. & Lofland, L. H. (1995). Analyzing Social Settings: A Guide to Qualitative Observation and Analysis. Belmont, CA: Wadsworth.

Page last updated: Sep 21 2011
Copyright © 2007, The University of Texas at Austin