RESUMEN
Although the integration of information across multiple senses can enhance object representations in memory, how multisensory information affects the formation of categories is uncertain. In particular, it is unclear to what extent categories formed from multisensory information benefit object recognition over unisensory inputs. Two experiments investigated the categorisation of novel auditory and visual objects, with categories defined by spatial similarity, and tested generalisation to novel exemplars. Participants learned to categorise exemplars based on visual-only (geometric shape), auditory-only (spatially defined soundscape) or audio-visual spatial cues. Categorisation to learned as well as novel exemplars was then tested under the same sensory learning conditions. For all learning modalities, categorisation generalised to novel exemplars. However, there was no evidence of enhanced categorisation performance for learned multisensory exemplars. At best, bimodal performance approximated that of the most accurate unimodal condition, although this was observed only for a subset of exemplars within a category. These findings provide insight into the perceptual processes involved in the formation of categories and have relevance for understanding the sensory nature of object representations underpinning these categories.
RESUMEN
Although object categorization is a fundamental cognitive ability, it is also a complex process going beyond the perception and organization of sensory stimulation. Here we review existing evidence about how the human brain acquires and organizes multisensory inputs into object representations that may lead to conceptual knowledge in memory. We first focus on evidence for two processes on object perception, multisensory integration of redundant information (e.g. seeing and feeling a shape) and crossmodal, statistical learning of complementary information (e.g. the 'moo' sound of a cow and its visual shape). For both processes, the importance attributed to each sensory input in constructing a multisensory representation of an object depends on the working range of the specific sensory modality, the relative reliability or distinctiveness of the encoded information and top-down predictions. Moreover, apart from sensory-driven influences on perception, the acquisition of featural information across modalities can affect semantic memory and, in turn, influence category decisions. In sum, we argue that both multisensory processes independently constrain the formation of object categories across the lifespan, possibly through early and late integration mechanisms, respectively, to allow us to efficiently achieve the everyday, but remarkable, ability of recognizing objects. This article is part of the theme issue 'Decision and control processes in multisensory perception'.
Asunto(s)
Encéfalo , Aprendizaje , Femenino , Animales , Bovinos , Humanos , Reproducibilidad de los Resultados , Encéfalo/fisiología , Memoria , Percepción , Percepción Visual/fisiología , Estimulación Luminosa , Percepción Auditiva/fisiologíaRESUMEN
The precision of temporal multisensory integration is associated with specific aspects of physical functioning in ageing, including gait speed and incidents of falling. However, it is unknown if such an association exists between multisensory integration and grip strength, an important index of frailty and brain health and predictor of disease and mortality in older adults. Here, we investigated whether temporal multisensory integration is associated with longitudinal (eight-year) grip strength trajectories in a large sample of 2,061 older adults (mean age = 64.42 years, SD = 7.20; 52% female) drawn from The Irish Longitudinal Study on Ageing (TILDA). Grip strength (kg) for the dominant hand was assessed with a hand-held dynamometer across four testing waves. Longitudinal k-means clustering was applied to these data separately for sex (male, female) and age group (50-64, 65-74, 75+ years). At wave 3, older adults participated in the Sound Induced Flash Illusion (SIFI), a measure of the precision of temporal audio-visual integration, which included three audio-visual stimulus onset asynchronies (SOAs): 70, 150 and 230 ms. Results showed that older adults with a relatively lower (i.e., weaker) grip strength were more susceptible to the SIFI at the longer SOAs compared to those with a relatively higher (i.e., stronger) grip strength (p <.001). These novel findings suggest that older adults with relatively weaker grip strength exhibit an expanded temporal binding window for audio-visual events, possibly reflecting a reduction in the integrity of the central nervous system.
RESUMEN
Sustained integration of sensory inputs over increased temporal delays is associated with reduced cognitive and physical functioning in older adults and adverse outcomes such as falls. Here, we explored the relationship between multisensory integration and a clinically relevant measure of balance/postural control; Sit-to-Stand Time, the efficiency with which an older adult can transition between a seated and a standing posture. We investigated whether temporal multisensory integration was associated with performance on the Five-Times Sit-to-Stand Test (FTSST) in a large sample of 2556 older adults (mean age = 63.62 years, SD = 7.50; 55% female) drawn from The Irish Longitudinal Study on Ageing (TILDA). K-means clustering was applied to FTSST data, yielding three clusters characterised by fast (mean = 10.88 s; n = 1122), medium (mean = 14.34 s; n = 1133) and slow (mean = 18.97 s; n = 301) sit-to-stand times. At wave 3 of TILDA, older adults participated in the Sound Induced Flash Illusion (SIFI), a measure of the precision of temporal audio-visual integration, which included three audio-visual stimulus onset asynchronies (SOAs): 70, 150 and 230 ms. Older adults with the slowest sit-to-stand times were more susceptible to the SIFI at the longest SOA (230 ms) compared to the shortest SOA (70 ms) relative to those with the fastest times (p = 0.02). Older adults who take longer to repeatedly transition from a seated to a standing posture exhibit an expanded temporal binding window for audio-visual events, supporting a link between multisensory perception and balance/postural control in ageing.