Showing posts with label vision. Show all posts
Showing posts with label vision. Show all posts

Sunday, September 06, 2009

My Bedroom Fan

I spend a lot of time contemplating the fan that spins over my bed. This is a picture of it. That’s approximately how it looks to me most of the time. But that’s not how it really is. In reality the fan is a hub and spoke system with five blades. But when the blades are spinning, they cannot be discriminated and the fan looks more like a solid wheel.

Why is that? Why can I not see the fan as it really is? Why do I see a false image, of a wheel that is not actually there? Am I hallucinating? No matter how carefully I stare, I cannot see actual fan blades. What am I seeing, if not reality? This should shake my confidence in the veracity of vision. Except for tricks and special situations, we generally believe that “seeing is believing.” In other words, what we see is what is there.

But this is a clear case of seeing what is not there, and not seeing what is there. And it is not a trick or special situation. Apparently, the mechanics of my eye cannot resolve the details of the blades as they spin. In order to fixate an image of something on the retina, the image must be still, for a moment at least, about a fifth of a second. That’s the only way we can see something.

What about things that are moving? We can see those under normal circumstances because the eyes take successive “snapshots” of the scene and integrate them over time to communicate movement to the brain, much as the rapid succession of snapshots in a film appears to us as a moving picture (another delusional visual experience). We do not actually see motion. We infer motion.

But in the case of my fan, the movement of the blades is faster than the snapshot rate of my eyes, so I cannot get a fixed image of the blades. The eyes are always moving, jerking around in a process called the visual nystagmus. They vibrate at least 20 times a second, sometimes faster, fixating here, there, everywhere, taking snapshots. It seems like the visual world is stable and that we just look at it and see it as it is, but that is not true. The eyes get at least 20 snapshots per second, no one of them taking in the whole scene. Each snapshot is with the eyes focused on a restricted detail of the scene. Then you synthesize the overall scene in your brain, based on the snapshots. The nice stable scene you think you see is a total fiction. You never saw it. You only saw dozens and dozens of tiny snapshots.

So I thought I would try to beat the visual system and my bedroom fan. I moved my eyes in a fast counter-clockwise motion around the hub, to see if I could make my eyes catch up with the fan blades. And it worked! Every few seconds, I would get a brief image of the individual blades of the fan. That’s because the muscles and nerves for voluntary eye movements are different from the ones used in the visual nystagmus. By adding the two eye movements together, I gave the nystagmus a chance to make a fixation on the blades.

It seemed to work randomly. Whenever there was an eye fixation that happened to hit a blade and not the space between blades, I would see an individual fan blade. Why this did not occur more often, I am not sure. Perhaps I also needed to catch a moment when the blurred motion signals to my brain were calm enough to let an individually fixated image through. Or perhaps my voluntary, circular eye movements were not really very circular, but most often erratic. It is impossible for me to know that.

Anyway, the demonstration proved visually that the blurred circular image I normally see is a complete illusion, not the reality of what is there. The fact that I could force the visual system to apprehend the true reality of the individual blades confirmed the presence of the illusion. So it makes me wonder, what else am I seeing that is illusory? How can I trust that what I see is really there if I know for a fact that sometimes I am seeing it wrong?

Descartes asked this same question in 1640 and came up with this answer: God is good, and God would not deceive you (most of the time). Therefore, you can be reasonably confident that what you see is what is there. Well, that answer doesn’t work for me. In the first place, it is not entirely clear that God is good. Biblical and contemporary evidence would speak to the contrary.

Secondly, my experience with my bedroom fan proved that Descartes’ answer is wrong in this case. What I see most of the time is clearly illusion. Should I assume that God deceived me because God is a malicious trickster?

And finally, Descartes had no evidence to support his claim. It is merely what he believed, because he had been told as much by the Church. I can’t assume his answer is correct if he just made it up or parroted what he had been told. It seems just as likely that the correct answer is that you cannot and should not believe that what you see is what is there. What’s wrong with that answer?

Thursday, June 26, 2008

Perspective on a Difficult Idea

Linear perspective is an extremely compelling visual illusion. And it is an illusion. You know the train tracks do not really converge. If they did, the train would derail.

Why do parallel lines look like they converge in the distance? I think it is a learned response to living in a world of pictures. That interpretation is so overlearned, it occurs without explicit awareness. But it should be possible to unpack that illusion.

Linear perspective was invented in the early 1400’s by an Italian architect (Brunelleschi) and simultaneously by others trying to draw and paint, as a way to represent three dimensional space on a two-dimensional sheet. It is a good invention and it works pretty well. We do see "depth" in a flat picture, even though that is not literally possible because there is no depth in a flat picture.

In the 600 years since then, the technique has become so universal that pictures drawn without it don’t look right.











The artist, Albrecht Durer, in a famous 1525 lithograph, is shown using strings to represent the rays of light coming from the corners of his object. His canvas swings out of the way while he sights down the strings to the object. Then he puts the canvas back in place and makes marks where the strings would hit it. Connect the dots, and you have a mathematically correct map of what the actual object looks like from that point of view.

But what is it a drawing of? The sides of a walkway do not really converge in the distance. If they did, you couldn’t walk it to the end. So a perspective drawing is surely not an accurate representation of reality. Strings or no strings, the perspective drawing is a fantasy, like a unicorn. It is something that does not exist in the world.



Why then does the unrealistic perspective drawing look so convincingly real, at least with respect to depth? Is it because when we look at the world we actually see it wrong? When you look down a long walkway, not a picture of one, are you seeing the world wrongly? We know from practical experience in the world that parallel lines do not converge in the distance, so why do we see convergence? We have to make a mental correction: “The sides look like they converge, but really they don’t.”


I have spent a lot of time looking at scenes (not pictures, but situations) where there seemed to be converging perspective lines. Much to my wife’s consternation, I will often stop to stare down a long hotel hallway like the one shown here, and ask myself, “Do those walls really look like they converge, or am I only imagining it?” I will walk up and down such hallways, trying to understand what I am seeing, and hoping I won’t get reported to hotel security.

And my conclusion is this: I do NOT see the walls converging. I can talk myself into it, but if I turn off my metacognition, what I see is a continuously unfolding horizon and continuous visual information moving around my head. At no time do I worry that the walls are closing in on me.

If I stand motionless and look down the hall as if I were a camera taking a picture, then I CAN see convergence. But that’s because I am pretending to be a camera. I am using metacognition, the ability we all have to introspect on our own mental experience. Metacognition is what allows you to answer the question, "What are you thinking about?" To answer, you must think about your thinking process. For a visual scene, the question, "What do you see?" encourages metacognition. You must think about your visual experience. Instead of just having a visual experience, you are now one step removed from it. You have stepped back from your natural experience and instead you are now using metacognition to examine your own mental imagery.

We learn visual metacognition when we learn to understand pictures. For the last six centuries virtually all pictures used the linear perspective technique of representation, which is derived from metacognition, not simple visual perception.

It is extremely difficult to set aside the ways of seeing that you have unconsciously assumed all your life and which your culture claims is the “correct” way of seeing. When you look at a photograph, you automatically apply metacognition – actually you must. To understand a picture, you must abandon your natural, egocentric point of view and take up the special imaginary point of view implied by the picture so you can imagine you are looking at the scene depicted. It is a sophisticated shift in personal frame of reference, but we do it with ease.

It looks like the perspective lines are “in” the photograph because that’s how we have been taught to interpret such artifacts. A photograph is a 2-dimensional representation of a three-dimensional scene, so we apply Brunelleschi’s rules to it. Whipping out a Sharpie and drawing the perspective lines on the photograph only proves my point that we are using an artist’s metacognitive way of seeing the photo. But we don't normally do that when we are using ordinary cognition, as opposed to metacognition, in the real world.

When I look down the grocery aisle as if I were a camera, I am strongly tempted to see converging lines. Look at them there in the picture! I can do that, but why would I?

Never, when I have been shopping for a box of pasta, have I experienced converging parallel lines. Never. I just go to the pasta section and get what I want, and proceed to the next aisle. Not a single time have I worried if my shopping cart would fit out the narrow opening in the far end of the aisle. Linear perspective just does not come up when you need a box of pasta.

However, if I stand at the head of the aisle and imagine I am a camera, or an artist, and mentally "step back" from my experience, then pop! There are the convergence lines. But they are purely an intellectual, metacognitive, culturally contrived way of seeing, an overlay on my natural experience. I have been taught to see convergence lines and so I do. But when I do, I am not looking at the world any more, but instead, looking at my own mental imagery of the world.

Now that I have learned how to unlearn that cultural habit, I no longer see perspective lines unless I want to. That demonstrates to me that apprehension of linear perspective is not a native property of the biological visual system.

Discussions of the perspective illusion always present pictures to illustrate the points being made. I have done that here, too. I admit that the convergence lines are there in the pictures. Of course they are. But that’s because they are pictures! Metacognition is required to understand pictures, just as it is to read a map, a floor plan, or a blueprint. Understanding pictures is a culturally acquired skill. There is perspectival convergence in the pictures because that’s how we have learned to interpret pictures.

But if you observe the real world, not pictures, you can, with practice, get back into your natural attitude (non-metacognitive) way of perceiving, and there will be no linear convergence. Try it. Walk some hotel hallways and some grocery aisles and some railroad tracks. What do you really see? You will find that the sides do not close in on you. You do not really see linear convergence unless you imagine you are "looking at a scene" instead of being in the world. We CAN take an attitude of detachment toward our perceptual experience, but that is a learned, introspective skill.

It seems to me it would not be too hard to test this hypothesis experimentally, with infants and non-human animals. You could test them for discrimination of natural scenes with and without perspective elements (what most people would call perspective elements, like railroad tracks and hallways). My hypothesis is that there would be no discrimination between scenes conventionally interpreted as containing convergence, and those without. It would be hard to do this without pictures, but not impossible. I notice recently that some hotels go to great lengths to break up the perspective effect in their hallways by using alcoves, varied lighting and wall colors, and non-linear carpet patterns. It should be possible to find comparable but contrasting hallways.

Then you could train the animals or infants to discriminate comparable perspective and non-perspective drawings, then test them on the natural scenes again. If the training were effective, the post-test should show discrimination of scenes with convergent and non-convergent elements. However, It might be difficult to accomplish the pictorial training, as the skill takes a long time to acquire.

Who Cares?
Why does it matter whether we really see linear perspective in the world or just apply that cultural interpretation to what we see? I think it matters for two reasons.

1. It matters if we are seeing the world wrongly. We know the train tracks do not converge in reality but we see that they do. That’s wrong, a perceptual error. Well, if we see the world wrongly in that case, what else are we seeing wrong? What if it's all wrong? Is the world anything like what we think it is?

This is a fundamental question in the philosophy of perception. So-called “realists” believe that we see what is really out there. Sure we make errors, but over time, we generally understand what the world is really like.

On the other hand, “representationalists” say that our brain forms a neurological representation of the world and that is all we have to go on. We do not know anything for sure about the world in-itself. We know only what our brain represents for us, and that includes convergence lines of perspective.

I am a realist, and I have argued endlessly with representationalists about this. Representationalists tend to be interested in robotics and machines that can “represent” the world in computer memory. Representationalists use the illusion of linear perspective to argue, “It looks like the train tracks converge, but they don’t really. Therefore realism in perception is simply not true.”

My argument now is, “I deny that it looks like the train tracks converge. That is a learned attitude, an introspection, not natural perception.”



2. The second reason the perspective illusion matters is because it highlights a fundamental error people make about visual perception. The eye is not like a camera and does not work like a camera. Yes, the eye has a lens and a pupil (shutter opening) and the retina is analogous to a film. But the analogy is flawed and deeply misleading because an eye is a component of an active sensory system in an exploratory animal. A camera is an inert machine.

We do not look at our retinas, ever. The retinal image is nothing like the image on a film, and nobody ever sees it. A camera is passive, but vision is active, exploratory, selective, and cognitive. Recent developments in sensory substitution amply demonstrate how "mental" perception is (e.g., blind people learn to “see” from video signals translated into vibrations, sounds, pin pricks on their backs, or electrical signals to the brain).

Once you shake free of the erroneous camera analogy, you are free to see the world in your natural attitude, not through an arbitrary cultural lens.

Are the seats smaller in the back of this train?