Skip Navigation
UT wordmark
College of Liberal Arts wordmark
psychology masthead
Jacqueline Woolley, Chair The University of Texas at Austin, SEA 4.212, Austin, TX 78712 • (512) 475-7596

Mary M Hayhoe

Professor Ph.D., University of California, San Diego

Mary M Hayhoe

Contact

Biography

Vision naturally occurs in the context of voluntary information gathering movements involving the eyes, head, and hand. However, much work in vision is dominated by trying to understand the events occurring within a single view of a scene, and we have only limited understanding of the consequences of eye and head movements for vision and visuo-motor coordination. The technology to look at performance in more natural circumstances now exists, and I am currently developing a human sensory-motor lab, in collaboration with Dana Ballard in Computer Science, for measuring unconstrained eye, head, and hand movements in the performance of natural tasks, and for developing a virtual reality display to allow controlled but visually complex stimulation. We also have the capability of providing force feedback for two finger grasping. The new instrumentation allows a large range of experiments not previously possible. My objective is to understand the demands placed on vision and motor systems by natural behavior and the nature of the representations that are required for visually guided tasks.

Center for Perceptual Systems

 

PSY 394U • Perception And Action

42945 • Spring 2015
Meets W 900am-1200pm SEA 4.242
show description

Seminars in Cognitive or Perceptual Systems. Three lecture hours a week for one semester. May be repeated for credit when the topics vary. Prerequisite: Graduate standing and consent of instructor.

PSY 394U • Perception And Action

44353 • Spring 2014
Meets W 900am-1200pm SEA 4.242
show description

Seminars in Cognitive or Perceptual Systems. Three lecture hours a week for one semester. May be repeated for credit when the topics vary. Prerequisite: Graduate standing and consent of instructor.

PSY 394U • Intro To Sensory-Motor Systems

43995 • Fall 2013
Meets F 100pm-400pm SEA 4.242
show description

Seminars in Cognitive or Perceptual Systems. Three lecture hours a week for one semester. May be repeated for credit when the topics vary. Prerequisite: Graduate standing and consent of instructor.

PSY 341K • Seeing/Acting In Virtual World

43435 • Spring 2013
Meets TTH 930am-1100am SEA 4.242
show description

Topics of contemporary interest that may vary from semester to semester. Three lecture hours a week for one semester. May be repeated for credit when the topics vary. Prerequisite: For psychology majors, upper-division standing and Psychology 301 and 418 with a grade of at least C in each; for nonmajors, upper-division standing, Psychology 301 with a grade of at least C, and one of the following with a grade of at least C: Biology 318M, Civil Engineering 311S, Economics 329, Educational Psychology 371, Electrical Engineering 351K, Government 350K, Mathematics 316, 362K, Mechanical Engineering 335, Psychology 317, Sociology 317L, Social Work 318, Statistics 309, Statistics and Scientific Computation 302, 303, 304, 305, 306, 318.

PSY 341K • Seeing/Acting In Virtual World

43280 • Spring 2012
Meets TTH 930am-1100am SEA 3.250
show description

The goal of this course is to teach you how to do experiments and make discoveries about your own perceptions and actions in ordinary life. There are many basic and important things to learn about this topic, that do not involve extensive background knowledge. We can do this because of new Virtual Reality technology that allows us to examine situations close to everyday life. The goal is to make new discoveries by doing several experiments in the Virtual Reality lab. In the course of doing this, you will learn a lot about how to ask scientific questions, do experiments, analyze the data, and make conclusions. You will learn how to write up experiments in a scientific manner and give oral presentations of your findings in class. This will involve learning technical skills that should be generally useful. The thing of greatest value, however, is learning how to form your own questions and to answer them.

PSY 394U • Intro To Sensory-Motor Systems

43425 • Fall 2011
Meets F 100pm-400pm SEA 4.242
show description

Seminars in Cognitive or Perceptual Systems. Three lecture hours a week for one semester. May be repeated for credit when the topics vary. Prerequisite: Graduate standing and consent of instructor.

PSY 394U • Intro To Sensory-Motor Systems

43385 • Fall 2010
Meets F 100pm-400pm SEA 4.242
show description

Seminars in Cognitive and Perceptual Systems. Three lecture hours a week for one semester. May be repeated for credit when the topics vary. Prerequisite: Graduate standing and consent of instructor.

PSY 341k • Seeing/Acting In Virtl World-W

43935 • Spring 2010
Meets TTH 930-1100 SEA 4.242
show description

PSY 341K        Seeing and Acting in a Virtual World        Spring, 2010   

               
COURSE OUTLINE


Class hours: Tues, Thurs 9.30-11.00                                          Room 4-242, SEAY

Instructor: Professor Mary Hayhoe
         SEAY Room 4-234  X5-9338                           mary@mail.cps.utexas.edu   
 Office hours: Anytime by appointment
         TA: Sucharit Katyal
         sucharit@mail.utexas.edu,  SEA 4.336
Web Site:  http://homepage.psy.utexas.edu/homepage/class/psy341K/hayhoe/2010/

The goal of this course is to teach you how to do experiments and make discoveries about your own perceptions and actions in ordinary life.  There are many basic and important things to learn about this topic, that do not involve extensive background knowledge. We can do this because of new Virtual Reality technology that allows us to examine situations close to everyday life. The goal is to make new discoveries by doing several experiments in the Virtual Reality lab. In the course of doing this, you will learn a lot about how to ask scientific questions, do experiments, analyze the data, and make conclusions. You will learn how to write up experiments in a scientific manner and give oral presentations of your findings in class. This will involve learning technical skills that should be generally useful. The thing of greatest value, however, is learning how to form your own questions and to answer them.

Text:
Because the course is very selective in the topics covered, there is no assigned text. Readings are available on the class web site.
Several chapters from the following book will be assigned. (The amount of material does not warrant buying the book.)
D.A. Rosenbaum  (1991)  Human Motor Control . Academic Press (Chapters 1, 2, 5, & 6)
Another useful reference is:
Gazzaniga, M., Ivry, R & Mangun, G  (2000) Cognitive Neuroscience Norton, 2nd ed.


Date        Topic

Jan 19     Overview of the course: understanding human actions     
        Introduction to Virtual Reality lab.
                       
Jan  21    Using our Eyes in Everyday Tasks:
Lecture: The nervous system, vision, and motor control.
The eye and eye movements
        Rosenbaum Ch 5, Land paper.


Jan 26    Lab: tracking the eyes while catching balls.
        
Jan 28    Lab: tracking the eyes.       
       
Feb  2     Lecture:  Interpreting the data

Feb   4    Discussion of Findings/ class presentations

Feb  9        Interdependence of Vision and Action: Lecture    Paper 1 due
        (Rosenbaum, Ch 1, p 1-25)

Feb  11     Vision and movement.
        (Rosenbaum Ch 2)                           
                                   
Feb  16     Lab: Reaching for virtual targets                                        Rosenbaum Ch 6                           

Feb  18    Lab: ctd

Feb 23    Understanding the data

Feb 25    Discussion of Findings / class presentations                                                               
Mar  2     Review                            Paper 2 due                               
Mar 4        Mid-term                               

Mar 9        Learning Visuo-Motor Relationships: lecture

Mar 11    Lecture                       
                           
Mar  16, 18   Spring Break    
       
Mar  23     Lab: Hitting virtual balls                       

Mar  25    Lab: ctd                   
               
Mar 30    Discussion of Outcome

Apr 1        Class Presentations

Apr 6         Attention & Vision: Lecture                Paper 3 due

Apr   8         Lecture: attention and eye movements in natural environments
       
Apr  13     Lab: Walking in a Virtual Apartment                           

Apr  15      Lab: Walking in a Virtual Apartment                       

Apr  20    Understanding the data           
                                           
Apr  22    Class presentations                           

Apr 27     Lecture: Uses of virtual environments               

Apr  29    Review
   
May 4        Review

May 6     Final Exam                    Paper 4 due
                               

Grading:  Grades will be based on the papers, plus the mid-term and final exams. In addition, grades will take into account class attendance, participation in class discussions, and class presentations. (Papers 1-4: 15% each. Midterm and Final: 15% each; Attendance: 5%; Presentations and class discussion: 5%)
Papers should be about 7-10 pages (typewritten, double spaced) reporting the results of the lab experiments.
The exams will consist of short answer questions on the material covered in the preceding half-semester. The final exam will cover only the second half of the course. The exams will cover material discussed in class and in the labs, as well as on the readings.

PSY 394U • Intro To Cognitive Science

44345 • Fall 2009
Meets F 100pm-400pm ENS 31NM
show description

Seminars in Cognitive and Perceptual Systems. Three lecture hours a week for one semester. May be repeated for credit when the topics vary. Prerequisite: Graduate standing and consent of instructor.

PSY 394U • Intro To Cognitive Science

44346 • Fall 2009
Meets F 900-1200 SEA 4.330
(also listed as C S 395T )
show description

Seminars in Cognitive and Perceptual Systems. Three lecture hours a week for one semester. May be repeated for credit when the topics vary. Prerequisite: Graduate standing and consent of instructor.

PSY 394U • Perception And Action

44360 • Fall 2009
Meets F 100pm-400pm SEA 5.106
(also listed as NEU 394P )
show description

Seminars in Cognitive and Perceptual Systems. Three lecture hours a week for one semester. May be repeated for credit when the topics vary. Prerequisite: Graduate standing and consent of instructor.

PSY 341K • Seeing/Acting In Virtl World-W

43195 • Spring 2009
Meets TTH 930-1100 SEA 4.242
show description

Topics of contemporary interest that may vary from semester to semester. Three lecture hours a week for one semester. May be repeated for credit when the topics vary. Prerequisite: For psychology majors, upper-division standing and Psychology 301 and 418 with a grade of at least C in each; for nonmajors, upper-division standing, Psychology 301 with a grade of at least C, and one of the following with a grade of at least C: Biology 318M, Civil Engineering 311S, Economics 329, Educational Psychology 371, Government 350K, Mathematics 316, Psychology 317, Sociology 317L, Social Work 318, Statistics 309.

Publications

Kit D, Katz L, Sullivan B, Snyder K, Ballard D, et al. (2014) Eye Movements, Visual Search and Scene Memory, in an Immersive Virtual Environment. PLoS ONE 9(4): e94362. doi:10.1371/journal.pone.0094362
download

Hayhoe, M. & Ballard, D. (2014) Modeling task control of eye movements. Current Biology, 24(13), 622-628.
download

Diaz, G., Cooper, J., Kit, D., & Hayhoe, M. (2013) Real-time recording and classification of eye movements in an immersive virtual environment. J Vis October 10, 2013 13(12): 5; doi:10.1167/13.12.5
download

Diaz, G., Cooper, J., & Hayhoe, M.  (2013) Memory and prediction in natural gaze control. Phil Trans Roy Soc B 368:20130064.
download

Johnson, L, Rothkopf, C, Ballard D & Hayhoe M. (2013) Predicting human visuo-motor behavior in a driving task. Phil Trans Roy Soc B 369:20130044.
download

Diaz, G, Cooper, J, Rothkopf, C, & Hayhoe, M. (2013) Saccades to future ball location reveal memory-based prediction in a natural interception task. Journal of Vision, 13(1)20, 1-14.
download

Delerue, C., Hayhoe, M,  & Boucart, M. (2013)  Eye movements during natural action in schizophrenia  J Psychiatry & Neuroscience, 2013 Apr 3;38(3):120143.
download

Sullivan, B.T., Johnson, L., Rothkopf, C., Ballard, D. & Hayhoe, M.H. (2012) The role of uncertainty and reward on eye movements in a virtual driving task.  Journal of Vision, 12(13):19, 1-17.
download

Hayhoe, M.H., McKinney, T., Chajka, K. & Pelz, J.B. (2011) Predictive eye movements in natural vision. Experimental Brain Research, 2011 Dec 20. [Epub ahead of print]
download

Hayhoe, M & Rothkopf, C. (2010) Vision in the natural world. Wiley Interdisciplinary Reviews: Cognitive Science, 2(2) 158-166.
download

Iorizzo, D.B., Riley, M.E., Hayhoe, M., & Huxlin, K.R. (2011). Differential impact of partial cortical blindness on gaze strategies when sitting and walking - An immersive virtual reality study. Vision Research, 51, pp. 1173-1184.
download

Tatler, B. W., Hayhoe, M., Land, M. F., & Ballard, D. (2011). Eye guidance in natural vision: Reinterpreting salience. Journal of Vision, 11(5), pp. 1-23.
download

McCann, B., Hayhoe, M. & Geisler, W.S. (2011) Decoding natural signals from peripheral retina. Journal of Vision, 11(10):19, 1-11.
download

Hamid, S. N., Stankiewicz, B., & Hayhoe, M. (2010). Gaze patterns in navigation: Encoding information in large-scale environments. Journal of Vision, 10(12), pp. 1-11.
download

Hayhoe, M. & Droll, J. (2009) Seeing what we can do: Insights into vision and action through observations of natural behaviors. In P. Calvo & G. Gomila (Eds.), Handbook of Embodied Cognitive Science. Elsevier.

Hayhoe, M. (2009) Visual Memory in Motor Planning and Action. In J. Brockmole (Ed.), Memory for the Visual World (pp.117-139). Psychology Press.
download

Huxlin, K., Martin, T., Kelly, K., Riley, M., Friedman, D. & Burgin, W. & Hayhoe, M. (2009, September) Perceptual re-learning of complex visual motion after V1 damage in humansJ Neurosci, 29(13) 3981-3991.
download

Hayhoe, M. & Ballard, D. (2009) Modeling the role of task in the control of gaze. Visual Cognition, 17(6-7), pp. 1185-1204.
download

Joyanceyic, J. & Hayhoe, M.(2009) Adaptive gaze control in natural environments. J Neurosci, 29(19), 6234-6238.
download

Hayhoe, M.H., Gillam, B., Chajka, K. & Vecellio, E. (2008) The role of binocular vision in walking. Visual Neuroscience 26(1):73-80.
download

Droll, J.A.,  Gigone, K. & Hayhoe, M. (2008) Learning where to direct gaze during change detection. Journal of Vision, 7(14):6, 1-12.
download

Sullivan, B., Jovancevic-Misic, J., Hayhoe, M. & Sterns, G. (2008) Use of multiple preferred retinal loci in Stargardt's disease during natural tasks: a case study*. Ophthalmic & Phys Optics, 28, 168-177.
download

Hayhoe, M., Droll, J. & Mennie, N. (2007) Learning where to look. In R. Van Gompel, M. Fischer, W. Murray & R. Hill (Eds.), Eye movements: A window on mind and brain (pp.641-660). Oxford: Elsevier.
download

Hayhoe, M. & Droll, J. (2007) Deciding when to remember and when to forget: Trade-offs between working memory and gaze. JEP-HPP, 33(6), 1352-1365.

Karacan, H. & Hayhoe, M. (2007) Is attention drawn to changes in familiar scences?. Visual Cognition, 16(2), 346-374.
download

Rothkopf, C., Ballard, D., & Hayhoe, M. (2007) Task and context determine where you look. J of Vision, 7(14):16, 1-20.
download

Martin, T., Riley, M., Kelly, K., Hayhoe, M. & Huxlin, K. (2007) Visually-guided behavior of homonymous hemianopes in a naturalistic task. Vision Research, 47, 3434-3446.
download

Droll, J. & Hayhoe, M. (2007) Trade-offs between gaze and working memory use. Journal of Experimental Psychology:Human Perception and Performance, 33(6), 1352-1365.
download

Hayhoe, M. (2006) Integrating information across saccadic eye movements. In M. Peterson, B. Gillam & H. Sedgwick (Eds.), In the Mind's Eye: Julian Hochberg on the Perception of Pictures, Film, and the World. NY: Oxford University Press, 448-453.
download

Jovanevic, J., Sullivan, B., Hayhoe, M. (2006) Control of attention and gaze in complex environments. Journal of Vision, 6, 1431-1450.
download

Mennie, N., Hayhoe, M., & Sullivan, B. (2006) Look-ahead fixations: anticipatory eye movements in natural tasks. Experimental Brain Research, 179, 427-442.
download

Hayhoe, M. & Ballard, D. (2005) Eye movements in natural behavior. Trends in Cognitive Science, 9, 188-194.
download

Droll, J., Hayhoe, M., Triesch, J. & Sullivan, B. (2005) Task demands control acquisition and storage of visual information. J. Experimental Psychology, 31, 1416-1438.
download

Hayhoe, M., Mennie, N., Sullivan, B. & Gorgos, K. (2005) The role of internal models and prediction in catching balls. Proceedings of AAAI Fall Symposium Series, Fall 2005.
download

Aivar, M.P., Hayhoe, M.M., Chizk, C.L. & Mruczek, R.E.B. (2005) Spatial memory and saccadic targeting in a natural task. Journal of Vision, 5, 177-193.
download

Hayhoe, M. (2004) Advances in relating eye movements and cognition. Infancy 6, 267-274.
download

Hayhoe, M., Shrivastrava, A., Myruczek, R. & Pelz, J. (2003) Visual memory and motor planning in a natural task. J. of Vision, 3, 49-63.
download

Triesch, J., Ballard, D., Hayhoe, M. & Sullivan, B. (2003) What you see is what you need. J. of Vision, 3, 86-94.
download

Shimozaki, S., Hayhoe, M., Zelinsky, G., Weinstein, A.,  Merigan, W. & Ballard, D. (2003) Effect of parietal lobe lesions on saccade targeting and spatial memory in a naturalistic visual search task. Neuropsychologia, 41, 1365-1386.
download

Rao, R., Zelinsky, G., Hayhoe, M. & Ballard, D. (2002) Eye movements in iconic visual search. Vision Research, 42, 1447-1463.
download

Hayhoe, M., Ballard, D., Triesch, J. & Shinoda, H., Aivar, P., Sullivan, B. (2002) Vision in natural and virtual environments. Proceedings, Eye Tracking Research & Applications, 7-13.
download

Hayhoe, M., Triesch, J., Sullivan, B. & Ballard, D. (2002) Saccade contingent scene changes in unconstrained virtual reality. Proceedings, Eye Tracking Research & Application, 95-102.

Hayhoe, M. (2002) Visual short term memory and motor control. The Brain's Eyes: Neurobiological and Clinical Aspects of Oculomotor Research. In J. Hyona, D. Munoz, W. Heide & R. Radach (Eds.), Progress in Brain Research (pp.349-363). Elsevier.

Pelz, J., Hayhoe, M. & Loeber, R. (2001) The coordination of eye, head, and hand movements in a natural task. Experimental Brain Research, 139, 266-277.
download

Land, M. & Hayhoe, M. (2001) In what ways do eye movements contribute to everday activities?. Vision Research, 41, 3559-3566.
download

Shinoda, H., Hayhoe, M. & Shrivastava, A. (2001) What controls attention in natural environments? Vision Research, 41, 3535-3546.
download

Hayhoe, M. (2000) Vision using routines: a functional account of vision. Visual Cognition, 7, 43-64.
download

Karn, K. & Hayhoe, M. (2000) Memory representations guide targeting eye movements in a natural task. Visual Cognition, 7(6), 673-704.
download

Hayhoe, M., Bensinger, D. & Ballard, D. (1998) Task constraints in visual working memory. Vision Research, 38, 125-137.
download

Karn, K. & Moeller, P.  & Hayhoe, M. (1997) Reference Frames in Saccade Targeting. Exp Brain Research, 115, 267-282.
download

Ballard, D., Hayhoe, M., Pook, P. & Rao, R. (1997) Deictic codes for the embodiment of cognition. Behavioral & Brain Sciences, 20, 723-767.
download

Hayhoe, M., Zelinsky, G., Rao, R. & Ballard, D. (1997) Eye movements reveal the spatio-temporal dynamics of visual search. Psychological Science, 8, 448-453.

Hayhoe, M., Rao, R., Zelinsky, G. & Ballard, D. (1996) Modelling Saccade Targeting in visual search. In D. Touretzky, M. Mozer & M. Hasselmo (Eds.), Advances in Neural Information Processing Systems (pp.830-836). Cambridge: MIT Press.

Hayhoe, M., Smeets, J. & Ballard, D. (1996) Influence of hand movements on eye-head coordination. Experimental Brain Res., 109, 434-440.

Pelz, J. & Hayhoe, M. (1995) Influence of the visual scene in visual direction constancy. Vision Res., 35, 2267-2275.

Ballard, D., Hayhoe, M. & Pelz, J. (1995) Memory representations in natural tasks. Cognitive Neuroscience, 7, 66-80.
download

Lachter, J. & Hayhoe, M. (1995) Capacity limitations in memory for visual locations. Perception, 24, 1427-1441.

Hayhoe, M., Lachter, J. & Feldman, J. (1991) Integration of form across saccadic eye movements. Perception, 20, 393-402.
download



Courses

Semester         Course       Unique No.       Title

Spr 2015       PSY 394U                            Perception and Action

2014 Fall       PSY 387N        43855           Perceptual Systems
2014 Spr       PSY 458           44120           Experimental Psychology
2014 Spr       PSY 394U        44353           Perception and Action

 

Movies

Racquetball Demo


Movie Loading...


Saccade-ahead Movie


Movie Loading...


Smooth Pursuit Movie


Movie Loading...


Squash Movie


Movie Loading...


PBJ Movie


Movie Loading...


High Uncertainty Movie


Movie Loading...


Low Uncertainty Movie


Movie Loading...


bottom border