RESUMEN

Depth information is important for postural stability and is generated by two visual systems: binocular and motion parallax. The effect of each type of parallax on postural stability remains unclear. We investigated the effects of binocular and motion parallax loss on static postural stability using a virtual reality (VR) system with a head-mounted display (HMD). A total of 24 healthy young adults were asked to stand still on a foam surface fixed on a force plate. They wore an HMD and faced a visual background in the VR system under four visual test conditions: normal vision (Control), absence of motion parallax (Non-MP)/binocular parallax (Non-BP), and absence of both motion and binocular parallax (Non-P). The sway area and velocity in the anteroposterior and mediolateral directions of the center-of-pressure displacements were measured. All postural stability measurements were significantly higher under the Non-MP and Non-P conditions than those under the Control and Non-BP conditions, with no significant differences in the postural stability measurements between the Control and Non-BP conditions. In conclusion, motion parallax has a more prominent effect on static postural stability than binocular parallax, which clarifies the underlying mechanisms of postural instability and informs the development of rehabilitation methods for people with visual impairments.

Asunto(s)

RESUMEN

Natural, dynamic eye contact behaviour is critical to social interaction but is dysfunctional in video conferencing. In analysing the problem, I introduce the concept of directionality and emphasize the critical role of motion parallax. I then sketch approaches towards re-establishing directionality and enabling natural, dynamic eye contact in video conferences.

RESUMEN

Parallax, as a visual effect, is used for depth perception of objects. But is there also the effect of parallax in the context of electric field imagery? In this work, the example of weakly electric fish is used to investigate how the self-generated electric field that these fish utilize for orientation and communication alike, may be used as a template to define electric parallax. The skin of the electric fish possesses a vast amount of electroreceptors that detect the self-emitted dipole-like electric field. In this work, the weakly electric fish is abstracted as an electric dipole with a sensor line in between the two emitters. With an analytical description of the object distortion for a uniform electric field, the distortion in a dipole-like field is simplified and simulated. On the basis of this simulation, the parallax effect could be demonstrated in electric field images i.e. by closer inspection of voltage profiles on the sensor line. Therefore, electric parallax can be defined as the relative movement of a signal feature of the voltage profile (here, the maximum or peak of the voltage profile) that travels along the sensor line peak trace (PT). The PT width correlates with the object's vertical distance to the sensor line, as close objects create a large PT and distant objects a small PT, comparable with the effect of visual motion parallax.

Asunto(s)

RESUMEN

Motion parallax and binocular disparity contribute to the perceived depth of three-dimensional (3D) objects. However, depth is often misperceived, even when both cues are available. This may be due in part to conflicts with unmodelled cues endemic to computerized displays. Here we evaluated the impact of display-based cue conflicts on depth cue integration by comparing perceived depth for physical and virtual objects. Truncated square pyramids were rendered using Blender and 3D printed. We assessed perceived depth using a discrimination task with motion parallax, binocular disparity, and their combination. Physical stimuli were presented with precise control over position and lighting. Virtual stimuli were viewed using a head-mounted display. To generate motion parallax, observers made lateral head movements using a chin rest on a motion platform. Observers indicated if the width of the front face appeared greater or less than the distance between this surface and the base. We found that accuracy was similar for virtual and physical pyramids. All estimates were more precise when depth was defined by binocular disparity than motion parallax. Our probabilistic model shows that a linear combination model does not adequately describe performance in either physical or virtual conditions. While there was inter-observer variability in weights, performance in all conditions was best predicted by a veto model that excludes the less reliable depth cue, in this case motion parallax.

Asunto(s)

RESUMEN

Cybersickness is an enduring problem for users of virtual environments. While it is generally assumed that cybersickness is caused by discrepancies in perceived self-motion between the visual and vestibular systems, little is known about the relative contribution of active motion parallax and binocular disparity to the occurrence of cybersickness. We investigated the role of these two depth cues in cybersickness by simulating a roller-coaster ride using a head-mounted display. Participants could see the tracks via a virtual frame placed at the front of the roller-coaster cart. We manipulated the state of the frame, so it behaved like: (1) a window into the virtual scene, (2) a 2D screen, (3) and (4) a window for one of the two depth cues, and a 2D screen for the other. Participants completed the Simulator Sickness Questionnaire before and after the experiment, and verbally reported their level of discomfort at repeated intervals during the ride. Additionally, participants' electrodermal activity (EDA) was recorded. The results of the questionnaire and the continuous ratings revealed the largest increase in cybersickness when the frame behaved like a window, and least increase when the frame behaved like a 2D screen. Cybersickness scores were at an intermediate level for the conditions where the frame simulated only one depth cue. This suggests that neither active motion parallax nor binocular disparity had a more prominent effect on the severity of cybersickness. The EDA responses increased at about the same rate in all conditions, suggesting that EDA is not necessarily coupled with subjectively experienced cybersickness.

Asunto(s)

RESUMEN

Although it has been proposed that birds acquire visual depth cues through dynamic head movements, behavioral evidence on how birds use motion parallax depth cues caused by self-motion is lacking. This study investigated whether self-generated motion parallax modulates pecking motor control and visual size perception in pigeons (Columba livia). We trained pigeons to peck a target on a touch monitor and to classify it as small or large. To manipulate motion parallax of the target, we changed the target position on the monitor according to the bird's head position in real time using a custom-built head tracker with two cameras. Pecking motor control was affected by the manipulation of motion parallax: when the motion parallax signified the target position farther than the monitor surface, the head position just before pecking to target was near the monitor surface, and vice versa. By contrast, motion parallax did not affect how the pigeons classified target sizes, implying that motion parallax might not contribute to size constancy in pigeons. These results indicate that motion parallax via head movements modulates pecking motor control in pigeons, suggesting that head movements of pigeons have the visual function of accessing motion parallax depth cues.

Asunto(s)

RESUMEN

Depth information is necessary for perceiving the real size of objects at varying visual distances. To investigate to what extent this size constancy present in another vertebrate class, we addressed the two questions using pigeons: (a) whether pigeons see a corridor illusion based on size constancy and (b) whether pigeons prioritize pictorial cues over motion parallax cues for size constancy, like humans. We trained pigeons to classify target sizes on a corridor. In addition, we presented a dynamic version of corridor illusion in which the target and corridor moved side by side. Target speed was changed to manipulate motion parallax. With the static corridor, pigeons overestimated the target size when it was located higher, indicating that pigeons see a corridor illusion like humans. With the dynamic corridor, the pigeons overestimated the target size depending on target position, as in the static condition, but target speed did not affect their responses, indicating that the pictorial precedence also applies to pigeons. In a follow-up experiment using the same stimulus, we confirmed that humans perceive object size based on pictorial cues. These results suggest that size constancy characteristics are highly similar between pigeons and humans, despite the differences in their phylogeny and neural systems.

RESUMEN

Bumblebees perform complex flight maneuvers around the barely visible entrance of their nest upon their first departures. During these flights bees learn visual information about the surroundings, possibly including its spatial layout. They rely on this information to return home. Depth information can be derived from the apparent motion of the scenery on the bees' retina. This motion is shaped by the animal's flight and orientation: Bees employ a saccadic flight and gaze strategy, where rapid turns of the head (saccades) alternate with flight segments of apparently constant gaze direction (intersaccades). When during intersaccades the gaze direction is kept relatively constant, the apparent motion contains information about the distance of the animal to environmental objects, and thus, in an egocentric reference frame. Alternatively, when the gaze direction rotates around a fixed point in space, the animal perceives the depth structure relative to this pivot point, i.e., in an allocentric reference frame. If the pivot point is at the nest-hole, the information is nest-centric. Here, we investigate in which reference frames bumblebees perceive depth information during their learning flights. By precisely tracking the head orientation, we found that half of the time, the head appears to pivot actively. However, only few of the corresponding pivot points are close to the nest entrance. Our results indicate that bumblebees perceive visual information in several reference frames when they learn about the surroundings of a behaviorally relevant location.

RESUMEN

When the head is tilted, an objectively vertical line viewed in isolation is typically perceived as tilted. We explored whether this shift also occurs when viewing global motion displays perceived as either object-motion or self-motion. Observers stood and lay left side down while viewing (1) a static line, (2) a random-dot display of 2-D (planar) motion or (3) a random-dot display of 3-D (volumetric) global motion. On each trial, the line orientation or motion direction were tilted from the gravitational vertical and observers indicated whether the tilt was clockwise or counter-clockwise from the perceived vertical. Psychometric functions were fit to the data and shifts in the point of subjective verticality (PSV) were measured. When the whole body was tilted, the perceived tilt of both a static line and the direction of optic flow were biased in the direction of the body tilt, demonstrating the so-called A-effect. However, we found significantly larger shifts for the static line than volumetric global motion as well as larger shifts for volumetric displays than planar displays. The A-effect was larger when the motion was experienced as self-motion compared to when it was experienced as object-motion. Discrimination thresholds were also more precise in the self-motion compared to object-motion conditions. Different magnitude A-effects for the line and motion conditions-and for object and self-motion-may be due to differences in combining of idiotropic (body) and vestibular signals, particularly so in the case of vection which occurs despite visual-vestibular conflict.

RESUMEN

PURPOSE: To analyze endoscopic vitreoretinal surgery principles, applications, challenges and potential technological advances. BACKGROUND: Microendoscopic imaging permits vitreoretinal surgery for tissues that are not visible using operating microscopy ophthalmoscopy. Evolving instrumentation may overcome some limitations of current endoscopic technology. ANALYSIS: Transfer of the fine detail in endoscopic vitreoretinal images to extraocular video cameras is constrained currently by the caliber limitations of intraocular probes in ophthalmic surgery. Gradient index and Hopkins rod lenses provide high resolution ophthalmoscopy but restrict surgical manipulation. Fiberoptic coherent image guides offer surgical maneuverability but reduce imaging resolution. Coaxial endoscopic illumination can highlight delicate vitreoretinal structures difficult to image in chandelier or endoilluminator diffuse, side-scattered lighting. Microendoscopy's ultra-high magnification video monitor images can reveal microscopic tissue details blurred partly by ocular media aberrations in contemporary surgical microscope ophthalmoscopy, thereby providing a lower resolution, invasive alternative to confocal fundus imaging. Endoscopic surgery is particularly useful when ocular media opacities or small pupils restrict or prevent transpupillary ophthalmoscopy. It has a growing spectrum of surgical uses that include the management of proliferative vitreoretinopathy and epiretinal membranes as well as the implantation of posterior chamber intraocular lenses and electrode arrays for intraretinal stimulation in retinitis pigmentosa. Microendoscopy's range of applications will continue to grow with technological developments that include video microchip sensors, stereoscopic visualization, chromovitrectomy, digital image enhancement and operating room heads-up displays. CONCLUSION: Microendoscopy is a robust platform for vitreoretinal surgery. Continuing clinical and technological innovation will help integrate it into the modern ophthalmic operating room of interconnected surgical microscopy, microendoscopy, vitrectomy machine and heads-up display instrumentation.

RESUMEN

We examined whether the thresholds of motion and depth perception produced by motion parallax could be specified by the concept of a disparity gradient. We manipulated both the motion parallax amplitude and the angular separation of two dots and calculated the percentages of trials in which participants perceived motion or depth. The results showed that the amplitude of motion parallax for the threshold increased as the separation became larger with the gradients of 0.023, 0.072, and 0.430 for the lower depth, the lower motion, and the upper depth thresholds, respectively. These findings indicate that the gradient is a useful concept to specify the motion and depth thresholds together rather than parallax amplitude alone.

Asunto(s)

RESUMEN

Discerning objects from their surrounds (i.e., figure-ground segmentation) in a way that guides adaptive behaviors is a fundamental task of the brain. Neurophysiological work has revealed a class of cells in the macaque visual cortex that may be ideally suited to support this neural computation: border ownership cells (Zhou H, Friedman HS, von der Heydt R. J Neurosci 20: 6594-6611, 2000). These orientation-tuned cells appear to respond conditionally to the borders of objects. A behavioral correlate supporting the existence of these cells in humans was demonstrated with two-dimensional luminance-defined objects (von der Heydt R, Macuda T, Qiu FT. J Opt Soc Am A Opt Image Sci Vis 22: 2222-2229, 2005). However, objects in our natural visual environments are often signaled by complex cues, such as motion and binocular disparity. Thus for border ownership systems to effectively support figure-ground segmentation and object depth ordering, they must have access to information from multiple depth cues with strict depth order selectivity. Here we measured in humans (of both sexes) border ownership-dependent tilt aftereffects after adaptation to figures defined by either motion parallax or binocular disparity. We find that both depth cues produce a tilt aftereffect that is selective for figure-ground depth order. Furthermore, we find that the effects of adaptation are transferable between cues, suggesting that these systems may combine depth cues to reduce uncertainty (Bülthoff HH, Mallot HA. J Opt Soc Am A 5: 1749-1758, 1988). These results suggest that border ownership mechanisms have strict depth order selectivity and access to multiple depth cues that are jointly encoded, providing compelling psychophysical support for their role in figure-ground segmentation in natural visual environments. NEW & NOTEWORTHY Figure-ground segmentation is a critical function that may be supported by "border ownership" neural systems that conditionally respond to object borders. We measured border ownership-dependent tilt aftereffects to figures defined by motion parallax or binocular disparity and found aftereffects for both cues. These effects were transferable between cues but selective for figure-ground depth order, suggesting that the neural systems supporting figure-ground segmentation have strict depth order selectivity and access to multiple depth cues that are jointly encoded.

Asunto(s)

RESUMEN

PURPOSE: Efficacy of current visual prostheses in object recognition is limited. Among various limitations to be addressed, such as low resolution and low dynamic range, here we focus on reducing the impact of background clutter on object recognition. We have proposed the use of motion parallax via head-mounted camera lateral scanning and computationally stabilizing the object of interest (OI) to support neural background decluttering. Simulations in head-mounted displays (HMD), mimicking the proposed effect, were used to test object recognition in normally sighted subjects. METHODS: Images (24° field of view) were captured from multiple viewpoints and presented at a low resolution (20 × 20). All viewpoints were centered on the OI. Experimental conditions (2 × 3) included clutter (with or without) × head scanning (single viewpoint, 9 coherent viewpoints corresponding to subjects' head positions, and 9 randomly associated viewpoints). Subjects used lateral head movements to view OIs in the HMD. Each object was displayed only once for each subject. RESULTS: The median recognition rate without clutter was 40% for all head scanning conditions. Performance with synthetic background clutter dropped to 10% in the static condition, but it was improved to 20% with the coherent and random head scanning (corrected P = 0.005 and P = 0.049, respectively). CONCLUSIONS: Background decluttering using motion parallax cues but not the coherent multiple views of the OI improved object recognition in low-resolution images. The improvement did not fully eliminate the impact of background. TRANSLATIONAL RELEVANCE: Motion parallax is an effective but incomplete decluttering solution for object recognition with visual prostheses.

RESUMEN

Based on the initial movement of falling prey, hunting archerfish select a C-start that turns them right to where their prey is going to land and lends the speed to arrive simultaneously with prey. Our companion study suggested that the information sampled in less than 100 ms also includes the initial height of falling prey. Here, we examine which cues the fish might be using to gauge height so quickly. First, we show that binocular cues are not required: C-starts that either could or could not have used binocular information were equally fast and precise. Next, we explored whether the fish were using simplifying assumptions about the absolute size of their prey or its distance from a structured background. However, experiments with unexpected changes from the standard conditions failed to cause any errors. We then tested the hypothesis that the fish might infer depth from accommodation or from cues related to blurring in the image of their falling prey. However, the fish also determined the height of 'fake flies' correctly, even though their image could never be focused and their combined size and degree of blurring should have misled the fish. Our findings are not compatible with the view that archerfish use a flexible combination of cues. They also do not support the view that height is gauged relative to structures in the vicinity of starting prey. We suggest that these fish use an elaborate analysis of looming to rapidly gauge initial height.

Asunto(s)

RESUMEN

In this paper, we review the connections and physiology of visual pathways to the cerebellum in birds and consider their role in flight. We emphasize that there are two visual pathways to the cerebellum. One is to the vestibulocerebellum (folia IXcd and X) that originates from two retinal-recipient nuclei that process optic flow: the nucleus of the basal optic root (nBOR) and the pretectal nucleus lentiformis mesencephali (LM). The second is to the oculomotor cerebellum (folia VI-VIII), which receives optic flow information, mainly from LM, but also local visual motion information from the optic tectum, and other visual information from the ventral lateral geniculate nucleus (Glv). The tectum, LM and Glv are all intimately connected with the pontine nuclei, which also project to the oculomotor cerebellum. We believe this rich integration of visual information in the cerebellum is important for analyzing motion parallax that occurs during flight. Finally, we extend upon a suggestion by Ibbotson (2017) that the hypertrophy that is observed in LM in hummingbirds might be due to an increase in the processing demands associated with the pathway to the oculomotor cerebellum as they fly through a cluttered environment while feeding.

RESUMEN

To successfully navigate throughout the world, observers must rapidly recover depth information. One depth cue that is especially important for a moving observer is motion parallax. To perceive unambiguous depth from motion parallax, the visual system must integrate information from two different proximal signals, retinal image motion and a pursuit eye movement. Previous research has shown that aging affects both of these necessary components for motion parallax depth perception, but no research has yet investigated how aging affects the mechanism for integrating motion and pursuit information to recover depth from motion parallax. The goal of the current experiment was to assess the integration time required by older adults to process depth information. In four psychophysical conditions, younger and older observers made motion and depth judgments about stationary or translating random-dot stimuli. Stimulus presentations in all four psychophysical conditions were followed by a high-contrast pattern mask, and minimum stimulus presentation durations (stimulus-to-mask onset asynchrony, or SOA) were measured. These SOAs reflect the minimum neural processing time required to make motion and motion parallax depth judgments. Pursuit latency was also measured. The results revealed that, after accounting for age-related delays in motion processing and pursuit onset, older and younger adults required similar temporal intervals to combine retinal image motion with an internal pursuit signal for the perception of depth. These results suggest that the mechanism for motion and pursuit integration is not affected by age.

Asunto(s)

RESUMEN

Observer translation produces differential image motion between objects that are located at different distances from the observer's point of fixation [motion parallax (MP)]. However, MP can be ambiguous with respect to depth sign (near vs far), and this ambiguity can be resolved by combining retinal image motion with signals regarding eye movement relative to the scene. We have previously demonstrated that both extra-retinal and visual signals related to smooth eye movements can modulate the responses of neurons in area MT of macaque monkeys, and that these modulations generate neural selectivity for depth sign. However, the neural mechanisms that govern this selectivity have remained unclear. In this study, we analyze responses of MT neurons as a function of both retinal velocity and direction of eye movement, and we show that smooth eye movements modulate MT responses in a systematic, temporally precise, and directionally specific manner to generate depth-sign selectivity. We demonstrate that depth-sign selectivity is primarily generated by multiplicative modulations of the response gain of MT neurons. Through simulations, we further demonstrate that depth can be estimated reasonably well by a linear decoding of a population of MT neurons with response gains that depend on eye velocity. Together, our findings provide the first mechanistic description of how visual cortical neurons signal depth from MP.SIGNIFICANCE STATEMENT Motion parallax is a monocular cue to depth that commonly arises during observer translation. To compute from motion parallax whether an object appears nearer or farther than the point of fixation requires combining retinal image motion with signals related to eye rotation, but the neurobiological mechanisms have remained unclear. This study provides the first mechanistic account of how this interaction takes place in the responses of cortical neurons. Specifically, we show that smooth eye movements modulate the gain of responses of neurons in area MT in a directionally specific manner to generate selectivity for depth sign from motion parallax. We also show, through simulations, that depth could be estimated from a population of such gain-modulated neurons.

Asunto(s)

RESUMEN

In addition to depth cues afforded by binocular vision, the brain processes relative motion signals to perceive depth. When an observer translates relative to their visual environment, the relative motion of objects at different distances (motion parallax) provides a powerful cue to three-dimensional scene structure. Although perception of depth based on motion parallax has been studied extensively in humans, relatively little is known regarding the neural basis of this visual capability. We review recent advances in elucidating the neural mechanisms for representing depth-sign (near versus far) from motion parallax. We examine a potential neural substrate in the middle temporal visual area for depth perception based on motion parallax, and we explore the nature of the signals that provide critical inputs for disambiguating depth-sign.This article is part of the themed issue 'Vision in our three-dimensional world'.

Asunto(s)

RESUMEN

For many tasks such as retrieving a previously viewed object, an observer must form a representation of the world at one location and use it at another. A world-based three-dimensional reconstruction of the scene built up from visual information would fulfil this requirement, something computer vision now achieves with great speed and accuracy. However, I argue that it is neither easy nor necessary for the brain to do this. I discuss biologically plausible alternatives, including the possibility of avoiding three-dimensional coordinate frames such as ego-centric and world-based representations. For example, the distance, slant and local shape of surfaces dictate the propensity of visual features to move in the image with respect to one another as the observer's perspective changes (through movement or binocular viewing). Such propensities can be stored without the need for three-dimensional reference frames. The problem of representing a stable scene in the face of continual head and eye movements is an appropriate starting place for understanding the goal of three-dimensional vision, more so, I argue, than the case of a static binocular observer.This article is part of the themed issue 'Vision in our three-dimensional world'.

Asunto(s)

RESUMEN

Successful navigation in the world requires effective visuospatial processing. Unfortunately, older adults have many visuospatial deficits, which can have severe real-world consequences. Although some of these age effects are well documented, some others, such as the perception of depth from motion parallax, are poorly understood. Depth perception from motion parallax requires intact retinal image motion and pursuit eye movement processing. Decades of research have shown that both motion processing and pursuit eye movements are affected by age; it follows that older adults may also be less sensitive to depth from motion parallax. The goals of the present study were to characterize motion parallax depth thresholds in older adults, and to explain older adults' sensitivity to depth from motion parallax in terms of motion and pursuit deficits. Younger and older adults' motion thresholds and pursuit accuracy were measured. Observers' depth thresholds across several different stimulus conditions were measured, as well. Older adults had higher motion thresholds and less accurate pursuit than younger adults. They were also less sensitive to depth from motion parallax at slow and moderate pursuit speeds. Although older adults had higher motion thresholds than younger adults, they used the available motion signals optimally, and age differences in motion processing could not account for the older adults' increased depth thresholds. Rather, these age effects can be explained by changes in older adults' pursuit signals.

Asunto(s)