Profile
Mary M Hayhoe
Professor — Ph.D., University of California, San Diego
Contact
- E-mail: mary@psy.utexas.edu
- Phone: (512) 475-9338
- Office: SEA 4.234
- Office Hours: email prof.
Biography
Vision naturally occurs in the context of voluntary information gathering movements involving the eyes, head, and hand. However, much work in vision is dominated by trying to understand the events occurring within a single view of a scene, and we have only limited understanding of the consequences of eye and head movements for vision and visuo-motor coordination. The technology to look at performance in more natural circumstances now exists, and I am currently developing a human sensory-motor lab, in collaboration with Dana Ballard in Computer Science, for measuring unconstrained eye, head, and hand movements in the performance of natural tasks, and for developing a virtual reality display to allow controlled but visually complex stimulation. We also have the capability of providing force feedback for two finger grasping. The new instrumentation allows a large range of experiments not previously possible. My objective is to understand the demands placed on vision and motor systems by natural behavior and the nature of the representations that are required for visually guided tasks.
PSY 394U • Intro To Sensory-Motor Systems
43995 •
Fall 2013
Meets
F 100pm-400pm SEA 4.242
show description
Seminars in Cognitive or Perceptual Systems. Three lecture hours a week for one semester. May be repeated for credit when the topics vary. Prerequisite: Graduate standing and consent of instructor.
PSY 341K • Seeing/Acting In Virtual World
43435 •
Spring 2013
Meets
TTH 930am-1100am SEA 4.242
show description
Topics of contemporary interest that may vary from semester to semester. Three lecture hours a week for one semester. May be repeated for credit when the topics vary. Prerequisite: For psychology majors, upper-division standing and Psychology 301 and 418 with a grade of at least C in each; for nonmajors, upper-division standing, Psychology 301 with a grade of at least C, and one of the following with a grade of at least C: Biology 318M, Civil Engineering 311S, Economics 329, Educational Psychology 371, Electrical Engineering 351K, Government 350K, Mathematics 316, 362K, Mechanical Engineering 335, Psychology 317, Sociology 317L, Social Work 318, Statistics 309, Statistics and Scientific Computation 302, 303, 304, 305, 306, 318.
PSY 341K • Seeing/Acting In Virtual World
43280 •
Spring 2012
Meets
TTH 930am-1100am SEA 3.250
show description
The goal of this course is to teach you how to do experiments and make discoveries about your own perceptions and actions in ordinary life. There are many basic and important things to learn about this topic, that do not involve extensive background knowledge. We can do this because of new Virtual Reality technology that allows us to examine situations close to everyday life. The goal is to make new discoveries by doing several experiments in the Virtual Reality lab. In the course of doing this, you will learn a lot about how to ask scientific questions, do experiments, analyze the data, and make conclusions. You will learn how to write up experiments in a scientific manner and give oral presentations of your findings in class. This will involve learning technical skills that should be generally useful. The thing of greatest value, however, is learning how to form your own questions and to answer them.
PSY 394U • Intro To Sensory-Motor Systems
43425 •
Fall 2011
Meets
F 100pm-400pm SEA 4.242
show description
Seminars in Cognitive or Perceptual Systems. Three lecture hours a week for one semester. May be repeated for credit when the topics vary. Prerequisite: Graduate standing and consent of instructor.
PSY 394U • Intro To Sensory-Motor Systems
43385 •
Fall 2010
Meets
F 100pm-400pm SEA 4.242
show description
Seminars in Cognitive and Perceptual Systems. Three lecture hours a week for one semester. May be repeated for credit when the topics vary. Prerequisite: Graduate standing and consent of instructor.
PSY 341k • Seeing/Acting In Virtl World-W
43935 •
Spring 2010
Meets
TTH 930-1100 SEA 4.242
show description
PSY 341K Seeing and Acting in a Virtual World Spring, 2010
COURSE OUTLINE
Class hours: Tues, Thurs 9.30-11.00 Room 4-242, SEAY
Instructor: Professor Mary Hayhoe
SEAY Room 4-234 X5-9338 mary@mail.cps.utexas.edu
Office hours: Anytime by appointment
TA: Sucharit Katyal
sucharit@mail.utexas.edu, SEA 4.336
Web Site: http://homepage.psy.utexas.edu/homepage/class/psy341K/hayhoe/2010/
The goal of this course is to teach you how to do experiments and make discoveries about your own perceptions and actions in ordinary life. There are many basic and important things to learn about this topic, that do not involve extensive background knowledge. We can do this because of new Virtual Reality technology that allows us to examine situations close to everyday life. The goal is to make new discoveries by doing several experiments in the Virtual Reality lab. In the course of doing this, you will learn a lot about how to ask scientific questions, do experiments, analyze the data, and make conclusions. You will learn how to write up experiments in a scientific manner and give oral presentations of your findings in class. This will involve learning technical skills that should be generally useful. The thing of greatest value, however, is learning how to form your own questions and to answer them.
Text:
Because the course is very selective in the topics covered, there is no assigned text. Readings are available on the class web site.
Several chapters from the following book will be assigned. (The amount of material does not warrant buying the book.)
D.A. Rosenbaum (1991) Human Motor Control . Academic Press (Chapters 1, 2, 5, & 6)
Another useful reference is:
Gazzaniga, M., Ivry, R & Mangun, G (2000) Cognitive Neuroscience Norton, 2nd ed.
Date Topic
Jan 19 Overview of the course: understanding human actions
Introduction to Virtual Reality lab.
Jan 21 Using our Eyes in Everyday Tasks:
Lecture: The nervous system, vision, and motor control.
The eye and eye movements
Rosenbaum Ch 5, Land paper.
Jan 26 Lab: tracking the eyes while catching balls.
Jan 28 Lab: tracking the eyes.
Feb 2 Lecture: Interpreting the data
Feb 4 Discussion of Findings/ class presentations
Feb 9 Interdependence of Vision and Action: Lecture Paper 1 due
(Rosenbaum, Ch 1, p 1-25)
Feb 11 Vision and movement.
(Rosenbaum Ch 2)
Feb 16 Lab: Reaching for virtual targets Rosenbaum Ch 6
Feb 18 Lab: ctd
Feb 23 Understanding the data
Feb 25 Discussion of Findings / class presentations
Mar 2 Review Paper 2 due
Mar 4 Mid-term
Mar 9 Learning Visuo-Motor Relationships: lecture
Mar 11 Lecture
Mar 16, 18 Spring Break
Mar 23 Lab: Hitting virtual balls
Mar 25 Lab: ctd
Mar 30 Discussion of Outcome
Apr 1 Class Presentations
Apr 6 Attention & Vision: Lecture Paper 3 due
Apr 8 Lecture: attention and eye movements in natural environments
Apr 13 Lab: Walking in a Virtual Apartment
Apr 15 Lab: Walking in a Virtual Apartment
Apr 20 Understanding the data
Apr 22 Class presentations
Apr 27 Lecture: Uses of virtual environments
Apr 29 Review
May 4 Review
May 6 Final Exam Paper 4 due
Grading: Grades will be based on the papers, plus the mid-term and final exams. In addition, grades will take into account class attendance, participation in class discussions, and class presentations. (Papers 1-4: 15% each. Midterm and Final: 15% each; Attendance: 5%; Presentations and class discussion: 5%)
Papers should be about 7-10 pages (typewritten, double spaced) reporting the results of the lab experiments.
The exams will consist of short answer questions on the material covered in the preceding half-semester. The final exam will cover only the second half of the course. The exams will cover material discussed in class and in the labs, as well as on the readings.
PSY 394U • Intro To Cognitive Science
44345 •
Fall 2009
Meets
F 100pm-400pm ENS 31NM
show description
Seminars in Cognitive and Perceptual Systems. Three lecture hours a week for one semester. May be repeated for credit when the topics vary. Prerequisite: Graduate standing and consent of instructor.
PSY 394U • Intro To Cognitive Science
44346 •
Fall 2009
Meets
F 900-1200 SEA 4.330
(also listed as
C S 395T )
show description
Seminars in Cognitive and Perceptual Systems. Three lecture hours a week for one semester. May be repeated for credit when the topics vary. Prerequisite: Graduate standing and consent of instructor.
PSY 394U • Perception And Action
44360 •
Fall 2009
Meets
F 100pm-400pm SEA 5.106
(also listed as
NEU 394P )
show description
Seminars in Cognitive and Perceptual Systems. Three lecture hours a week for one semester. May be repeated for credit when the topics vary. Prerequisite: Graduate standing and consent of instructor.
PSY 341K • Seeing/Acting In Virtl World-W
43195 •
Spring 2009
Meets
TTH 930-1100 SEA 4.242
show description
Topics of contemporary interest that may vary from semester to semester. Three lecture hours a week for one semester. May be repeated for credit when the topics vary. Prerequisite: For psychology majors, upper-division standing and Psychology 301 and 418 with a grade of at least C in each; for nonmajors, upper-division standing, Psychology 301 with a grade of at least C, and one of the following with a grade of at least C: Biology 318M, Civil Engineering 311S, Economics 329, Educational Psychology 371, Government 350K, Mathematics 316, Psychology 317, Sociology 317L, Social Work 318, Statistics 309.
Publications
Diaz, G, Cooper, J, Rothkopf, C, & Hayhoe, M. (2013) Saccades to future ball location reveal memory-based prediction in a natural interception task. Journal of Vision, 13(1)20, 1-14.
download
Delerue, C., Hayhoe, M, & Boucart, M. (2013) Eye movements during natural action in schizophrenia J Psychiatry & Neuroscience (in press).
Sullivan, B.T., Johnson, L., Rothkopf, C., Ballard, D. & Hayhoe, M.H. (2012) The role of uncertainty and reward on eye movements in a virtual driving task. Journal of Vision, 12(13):19, 1-17.
download
Hayhoe, M.H., McKinney, T., Chajka, K. & Pelz, J.B. (2011) Predictive eye movements in natural vision. Experimental Brain Research, 2011 Dec 20. [Epub ahead of print]
download
Hayhoe, M & Rothkopf, C. (2010) Vision in the natural world. Wiley Interdisciplinary Reviews: Cognitive Science, 2(2) 158-166.
download
Iorizzo, D.B., Riley, M.E., Hayhoe, M., & Huxlin, K.R. (2011). Differential impact of partial cortical blindness on gaze strategies when sitting and walking - An immersive virtual reality study. Vision Research, 51, pp. 1173-1184.
download
Tatler, B. W., Hayhoe, M., Land, M. F., & Ballard, D. (2011). Eye guidance in natural vision: Reinterpreting salience. Journal of Vision, 11(5), pp. 1-23.
download
McCann, B., Hayhoe, M. & Geisler, W.S. (2011) Decoding natural signals from peripheral retina. Journal of Vision, 11(10):19, 1-11.
download
Hamid, S. N., Stankiewicz, B., & Hayhoe, M. (2010). Gaze patterns in navigation: Encoding information in large-scale environments. Journal of Vision, 10(12), pp. 1-11.
download
Hayhoe, M. & Droll, J. (2009) Seeing what we can do: Insights into vision and action through observations of natural behaviors. In P. Calvo & G. Gomila (Eds.), Handbook of Embodied Cognitive Science. Elsevier.
Hayhoe, M. (2009) Visual Memory in Motor Planning and Action. In J. Brockmole (Ed.), Memory for the Visual World (pp.117-139). Psychology Press.
download
Huxlin, K., Martin, T., Kelly, K., Riley, M., Friedman, D. & Burgin, W. & Hayhoe, M. (2009, September) Perceptual re-learning of complex visual motion after V1 damage in humans. J Neurosci, 29(13) 3981-3991.
download
Hayhoe, M. & Ballard, D. (2009) Modeling the role of task in the control of gaze. Visual Cognition, 17(6-7), pp. 1185-1204.
download
Joyanceyic, J. & Hayhoe, M.(2009) Adaptive gaze control in natural environments. J Neurosci, 29(19), 6234-6238.
download
Hayhoe, M.H., Gillam, B., Chajka, K. & Vecellio, E. (2008) The role of binocular vision in walking. Visual Neuroscience 26(1):73-80.
download
Droll, J.A., Gigone, K. & Hayhoe, M. (2008) Learning where to direct gaze during change detection. Journal of Vision, 7(14):6, 1-12.
download
Sullivan, B., Jovancevic-Misic, J., Hayhoe, M. & Sterns, G. (2008) Use of multiple preferred retinal loci in Stargardt's disease during natural tasks: a case study*. Ophthalmic & Phys Optics, 28, 168-177.
download
Hayhoe, M., Droll, J. & Mennie, N. (2007) Learning where to look. In R. Van Gompel, M. Fischer, W. Murray & R. Hill (Eds.), Eye movements: A window on mind and brain (pp.641-660). Oxford: Elsevier.
download
Hayhoe, M. & Droll, J. (2007) Deciding when to remember and when to forget: Trade-offs between working memory and gaze. JEP-HPP, 33(6), 1352-1365.
Karacan, H. & Hayhoe, M. (2007) Is attention drawn to changes in familiar scences?. Visual Cognition, 16(2), 346-374.
download
Rothkopf, C., Ballard, D., & Hayhoe, M. (2007) Task and context determine where you look. J of Vision, 7(14):16, 1-20.
download
Martin, T., Riley, M., Kelly, K., Hayhoe, M. & Huxlin, K. (2007) Visually-guided behavior of homonymous hemianopes in a naturalistic task. Vision Research, 47, 3434-3446.
download
Droll, J. & Hayhoe, M. (2007) Trade-offs between gaze and working memory use. Journal of Experimental Psychology:Human Perception and Performance, 33(6), 1352-1365.
download
Hayhoe, M. (2006) Integrating information across saccadic eye movements. In M. Peterson, B. Gillam & H. Sedgwick (Eds.), In the Mind's Eye: Julian Hochberg on the Perception of Pictures, Film, and the World. NY: Oxford University Press, 448-453.
download
Jovanevic, J., Sullivan, B., Hayhoe, M. (2006) Control of attention and gaze in complex environments. Journal of Vision, 6, 1431-1450.
download
Mennie, N., Hayhoe, M., & Sullivan, B. (2006) Look-ahead fixations: anticipatory eye movements in natural tasks. Experimental Brain Research, 179, 427-442.
download
Hayhoe, M. & Ballard, D. (2005) Eye movements in natural behavior. Trends in Cognitive Science, 9, 188-194.
download
Droll, J., Hayhoe, M., Triesch, J. & Sullivan, B. (2005) Task demands control acquisition and storage of visual information. J. Experimental Psychology, 31, 1416-1438.
download
Hayhoe, M., Mennie, N., Sullivan, B. & Gorgos, K. (2005) The role of internal models and prediction in catching balls. Proceedings of AAAI Fall Symposium Series, Fall 2005.
download
Aivar, M.P., Hayhoe, M.M., Chizk, C.L. & Mruczek, R.E.B. (2005) Spatial memory and saccadic targeting in a natural task. Journal of Vision, 5, 177-193.
download
Hayhoe, M. (2004) Advances in relating eye movements and cognition. Infancy 6, 267-274.
download
Hayhoe, M., Shrivastrava, A., Myruczek, R. & Pelz, J. (2003) Visual memory and motor planning in a natural task. J. of Vision, 3, 49-63.
download
Triesch, J., Ballard, D., Hayhoe, M. & Sullivan, B. (2003) What you see is what you need. J. of Vision, 3, 86-94.
download
Shimozaki, S., Hayhoe, M., Zelinsky, G., Weinstein, A., Merigan, W. & Ballard, D. (2003) Effect of parietal lobe lesions on saccade targeting and spatial memory in a naturalistic visual search task. Neuropsychologia, 41, 1365-1386.
download
Rao, R., Zelinsky, G., Hayhoe, M. & Ballard, D. (2002) Eye movements in iconic visual search. Vision Research, 42, 1447-1463.
download
Hayhoe, M., Ballard, D., Triesch, J. & Shinoda, H., Aivar, P., Sullivan, B. (2002) Vision in natural and virtual environments. Proceedings, Eye Tracking Research & Applications, 7-13.
download
Hayhoe, M., Triesch, J., Sullivan, B. & Ballard, D. (2002) Saccade contingent scene changes in unconstrained virtual reality. Proceedings, Eye Tracking Research & Application, 95-102.
Hayhoe, M. (2002) Visual short term memory and motor control. The Brain's Eyes: Neurobiological and Clinical Aspects of Oculomotor Research. In J. Hyona, D. Munoz, W. Heide & R. Radach (Eds.), Progress in Brain Research (pp.349-363). Elsevier.
Pelz, J., Hayhoe, M. & Loeber, R. (2001) The coordination of eye, head, and hand movements in a natural task. Experimental Brain Research, 139, 266-277.
download
Land, M. & Hayhoe, M. (2001) In what ways do eye movements contribute to everday activities?. Vision Research, 41, 3559-3566.
download
Shinoda, H., Hayhoe, M. & Shrivastava, A. (2001) What controls attention in natural environments? Vision Research, 41, 3535-3546.
download
Hayhoe, M. (2000) Vision using routines: a functional account of vision. Visual Cognition, 7, 43-64.
download
Karn, K. & Hayhoe, M. (2000) Memory representations guide targeting eye movements in a natural task. Visual Cognition, 7(6), 673-704.
download
Hayhoe, M., Bensinger, D. & Ballard, D. (1998) Task constraints in visual working memory. Vision Research, 38, 125-137.
download
Karn, K. & Moeller, P. & Hayhoe, M. (1997) Reference Frames in Saccade Targeting. Exp Brain Research, 115, 267-282.
download
Ballard, D., Hayhoe, M., Pook, P. & Rao, R. (1997) Deictic codes for the embodiment of cognition. Behavioral & Brain Sciences, 20, 723-767.
download
Hayhoe, M., Zelinsky, G., Rao, R. & Ballard, D. (1997) Eye movements reveal the spatio-temporal dynamics of visual search. Psychological Science, 8, 448-453.
Hayhoe, M., Rao, R., Zelinsky, G. & Ballard, D. (1996) Modelling Saccade Targeting in visual search. In D. Touretzky, M. Mozer & M. Hasselmo (Eds.), Advances in Neural Information Processing Systems (pp.830-836). Cambridge: MIT Press.
Hayhoe, M., Smeets, J. & Ballard, D. (1996) Influence of hand movements on eye-head coordination. Experimental Brain Res., 109, 434-440.
Pelz, J. & Hayhoe, M. (1995) Influence of the visual scene in visual direction constancy. Vision Res., 35, 2267-2275.
Ballard, D., Hayhoe, M. & Pelz, J. (1995) Memory representations in natural tasks. Cognitive Neuroscience, 7, 66-80.
download
Lachter, J. & Hayhoe, M. (1995) Capacity limitations in memory for visual locations. Perception, 24, 1427-1441.
Hayhoe, M., Lachter, J. & Feldman, J. (1991) Integration of form across saccadic eye movements. Perception, 20, 393-402.
download
Movies
Racquetball Demo
Saccade-ahead Movie
Smooth Pursuit Movie
Squash Movie
PBJ Movie
Links
Courses
SPRING 2012
PSY 341K SEEING/ACTING IN VIRTUAL WORLD


