Subjects: Other Disciplines >> Synthetic discipline submitted time 2023-10-09 Cooperative journals: 《心理学报》
Abstract： Different dimensions of visual and auditory stimuli can map to each other to influence human behavioral responses, a phenomenon known as audiovisual cross-modal correspondence. A common audiovisual cross- modal correspondence is between auditory tones and visual spatial locations, with individuals tending to map high-pitched sounds to high spatial location and low-pitched sounds to low spatial location. When a high-pitch sound is accompanied or preceded by a visual stimulus, the participants respond faster to visual stimuli presented in the high spatial location than to visual stimuli presented in the low spatial location, and vice versa. Researchers have different views on the level at which audiovisual cross-modal correspondence occurs. Some argue that audiovisual cross-modal correspondence occurs at the perceptual level, increasing the perceptual saliency of the stimulus, while others argue that audiovisual cross-modal correspondence occurs at a later semantic or decision level. As inhibition of return (IOR) in the attentional system can affect human perception, this study used a cue-target paradigm to explore the interaction between IOR and audiovisual cross-modal correspondence to elucidate the occurrence level and mechanism of audiovisual cross-modal correspondence. Audiovisual cross-modal correspondence between auditory tones and visual spatial locations was expected to occur at the perceptual level and therefore would be subject to the IOR effect occurring at the same processing level. The present study consisted of 3 experiments. Experiment 1 had a 2 × 2 within-subjects design; we manipulated the spatial cue validity (valid cue vs. invalid cue) and audiovisual cross-modal correspondence (congruent vs. incongruent). During the experiment, a fixation point was first presented in the middle of the screen for 750 ms. The box above or below the fixation point was then bolded for 50 ms, but this cue was not predictive of the spatial location of the target. After a time interval of 250 ms, a fixation point was presented in bold as a central cue. A central cue is commonly used in spatial IOR research, as it facilitates stable occurrence of IOR. The central cue was presented for 50 ms, and then the auditory stimulus (either high or low pitch) was presented for 50 ms. After a 200-ms interval, the visual target was presented for 100 ms in the box above or below the fixation point. The participants were instructed to perform a detection task for the presence of a visual target. The experimental design and procedure of Experiment 2 were identical to those of Experiment 1, except that the sound presented before the visual target was a single tone that was present or absent. Experiment 3 had a 2 × 2 × 2 within-subjects design. Experiment 3 added a factor to Experiment 1, namely, stimulus onset asynchrony (SOA) between the cue and the target (600 ms vs. 1300 ms). In all three experiments, the overall accuracy (ACC) was very high; thus, no further statistical analysis was conducted for the ACC. In terms of reaction time (RT), the results of Experiment 1 showed that both spatial IOR and audiovisual cross-modal correspondence occurred. Importantly, there was an interaction between spatial cue validity and audiovisual cross-modal correspondence. Specifically, when the cue was valid, audiovisual cross-modal correspondence occurred, and when the cue was invalid, there was no audiovisual cross-modal correspondence. The results of Experiment 2 showed that the interaction between cue validity and sound presentation was not significant, and there was no evidence that IOR influenced the sound-induced facilitation effect. The results of Experiment 3 showed that the interaction among spatial cue validity, cross-modal correspondence congruency, and SOA was significant. Specifically, at an SOA of 600 ms, the interaction between spatial cue validity and cross-modal correspondence congruency was significant. When the cue was valid, audiovisual cross-modal correspondence occurred, and when the cue was invalid, there was no audiovisual cross-modal correspondence. At an SOA of 1300 ms, the interaction between cue validity and cross-modal correspondence congruency was not significant, and cross-modal correspondence occurred in both valid-cue and invalid-cue conditions. The results of the analysis of the IOR effect showed that the IOR effect under the 600-ms SOA condition (22 ms) was significantly larger than that under the 1300-ms SOA condition (16 ms). As the SOA increased, the IOR effect size decreased. In conclusion, the present results suggested that the IOR effect, occurring at the perceptual level, moderated audiovisual cross-modal correspondence. When the IOR effect occurred, audiovisual cross-modal correspondence occurred in the cued location, but not in the non-cued location. The alerting effect induced by the sound did not interact with IOR. With the weakening of the IOR effect, the audiovisual cross-modal correspondence in the cued location decreased, and the moderating effect of the IOR effect on audiovisual cross-modal correspondence weakened. The present results support that the audiovisual cross-modal correspondence between auditory tones and visual spatial locations occurs at the perceptual level, and the occurrence of audiovisual cross-modal correspondence conforms to the principle of inverse effectiveness.
Subjects: Psychology >> Developmental Psychology submitted time 2023-03-28 Cooperative journals: 《心理科学进展》
Abstract： The interaction between exogenous attention and multisensory integration is a complex and controversial topic, which has been debated for a long time. In order to explain the interaction mechanism between them, here we summarized two parts based on previous researches. First, exogenous attention can modulate multisensory integration in a bottom-up manner, including three hypotheses as spatial uncertainty, sensory sensitivity and the differences in unimodal signal strength. Second, multisensory integration can also modulate exogenous attention. On one hand, stimuli from multiple sense modalities can be automatically integrated in a bottom-up manner. The integrated multisensory events can capture attention more efficiently compared to unimodal events, even under quite complex circumstances. On the other hand, integrated multisensory events exert top-down control on attentional capture via multisensory signal templates that are stored in the brain.
Subjects: Psychology >> Developmental Psychology submitted time 2023-03-28 Cooperative journals: 《心理科学进展》
Abstract： Sound-induced Flash Illusion (SiFI) is an auditory-dominated multisensory integration phenomenon that occurs when flashes presented in conjunction with an incongruent number of auditory sounds results in the flashes being perceived as equal in number to the auditory sounds. Here we summarize several factors that could impact on SiFI: (1) Bottom-up variance factors comprising physical properties (i.e., spatial characteristics of stimuli, differences in stimulus intensity, and time interval between audiovisual stimuli), top-down variance factors comprisingcognitive processes (i.e., attention, feedback patterns, and cognitive expectations), and between-subjects variance factors, such as the dependence for audiovisual stimuli, the ability to integrate audiovisual stimuli, and perceptual sensitivity to audiovisual stimuli; (2) Cognitive processing stages and neural mechanisms of SiFI (i.e., related brain regions). Future studies should focus on the effects of cognitive processes such as attention, reward, audiovisual integration on SiFI. The effects of SiFI on memory and learning should also be explored in future research. In addition, future studies combining computational models and neuroscience should further explore the cognitive and neural mechanisms of SiFI.
Subjects: Psychology >> Social Psychology submitted time 2023-03-28 Cooperative journals: 《心理科学进展》
Abstract： In visual search, the phenomenon that attention is attracted by task-independent salient stimulus, which leads to search efficiency reduction is called attentional capture. In the traditional theories of visual attentional capture, stimulus-driven theory and goal-driven theory were argued for nearly 20 years. According to stimulus-driven theory, attention is automatically captured by physically salient objects, and regardless of the intentions of the observers. Other researchers believe that only stimuli that match the features of the search target will capture attention. In recent years, two new hybrid models were proposed, which combined bottom-up capture and top-down control settings, called rapid disengagement hypothesis and signal suppression hypothesis. The main content of the rapid disengagement hypothesis is that a salient distractor can always capture attention in a bottom-up manner, but attention only landed on the position of the highlighted stimulus that similar to the target. If the selected stimulus does not look like the target at all, disengagement from that location would be fast and swift. In the empirical evidences of the rapid disengagement hypothesis, spatial-cueing paradigm and oculomotor disengagement paradigm were most often adopted. In those tasks, participants usually took a singleton search strategy to promote search. The signal suppression hypothesis posits that a salient object can automatically produce a bottom-up “attend-to-me” signal, but this signal can be suppressed via top-down control processes when the highlighted object does not meet the task requirements. In the empirical evidences of the signal suppression hypothesis, an additional singleton paradigm was most often adopted. In those tasks, participants were forced to take a feature search strategy. The rapid disengagement hypothesis and the signal suppression hypothesis are indispensable components of the theories of attentional capture, and there are both similarities and differences between them. The similarity lies in the fact that both two theories assume that the initial stage of the attention capture occurs automatically. However, there are different opinions about the shifting of attention during this initial stage. The rapid disengagement hypothesis holds that there is an attention shift in the initial stage of the processing of the salient stimulus, and when the attention has enough time to disengage from the highlight stimulus that does not match the target, attentional capture will not occur. Different from the above views, the signal suppression hypothesis believes that there is no attention shift in the initial stage of the highlight stimulus processing. Attention capture does not actually occur because the salience signal can be suppressed by a top-down mechanism when the salient stimulus is inconsistent with the target. Future researches would focus on the following aspects: (1) More studies adopting different stimuli and experimental methods are needed to support rapid disengagement hypothesis and signal suppression hypothesis; (2) The effects of reward and training on “attentional capture-disengagement” and “signal-suppression” should also be explored in future researches; (3) The neural bases of reactive inhibition mechanism and active inhibition mechanism that involved in rapid disengagement hypothesis and signal suppression hypothesis is a problem which deserves attention.
Subjects: Psychology >> Social Psychology submitted time 2023-03-27 Cooperative journals: 《心理学报》
Abstract： It has been well documented that the spotlight of attention is intrinsically rhythmic, which discretely samples a single or multiple objects. Adopting high resolution behavioral approach, attention oscillation has been revealed. However, neural mechanism of attention oscillation remains poorly understood. In the present study, basing on functional anatomy of the primary visual cortex, we aimed to investigate the role of primary visual cortex (V1) in attention oscillation, by using a modified high temporal resolution cue-target paradigm in a 4AFC task. In the present study, behavioral oscillations in visual attention under ordinary (binocular; not dichoptic) viewing condition (exp. 1) and binocular dichoptic (exp. 2) condition were examined. In experiment 1, 16 paid participants were asked to detect target at either the previously cued (valid condition) or uncued location (invalid condition). The cue-target SOA varied from 0.1 s to 1.08 s in steps of 20 ms. Performances were evaluated in a 4AFC task. If they saw target, they were instructed to judge the location of the target (1 for target on the upper left; 2 for upper right; 4 for lower left; 5 for lower right) on the keypad. While, 16 paid participants were recruited to detect target at either cued or uncued locations under binocular dichoptic condition. Target could occur in the same or different eye of cue stimuli. Amplitude of target contrast decrement was determined with QUEST procedure before cue-target experiment. Except that no cue stimuli were presented, threshold procedure was identical to the cue-target experiment procedure. Results showed that when grating locations were presented under ordinary viewing condition, a theta rhythm was visible. While targets were presented in the same or different eye under binocular dichoptic condition, attention oscillation was clearly seen at 12.5 Hz with antiphase relationship between cued and uncued conditions. The findings under ordinary viewing condition are in general consistent with previous studies. While, under binocular dichoptic condition, attention oscillation increased to a higher frequency. This study indicates that attention oscillation may occur at or beyond primary visual cortex where binocular integration begins.
Subjects: Psychology >> Social Psychology submitted time 2023-03-27 Cooperative journals: 《心理学报》
Abstract： Previous studies have showed that information held in working memory (WM) can guide or capture attention during visual search in a relatively automatic way, even when it is irrelevant and detrimental to current task performance. Some researchers have proposed that the semantic match between WM contents and distractors could also capture attention, as well as the perceptual match. As we known, the verbal WM contents can be stored in the visual and auditory inputs. Even though the automatic influence of visual verbal WM on visual attention have been demonstrated, it remains unknown whether the auditory verbal WM could automatically capture attention. Therefore, it is necessary to investigate the attention guidance by the verbal WM contents. The present study included two experiments to explore the questions presented above. In Experiment 1, the memory item was a verbal Chinese character that presented visually, denoting a color, such as “红”. The participants were instructed to remember the word and avoid the potential distractors. Subsequently, they completed a visual search task, in order to test whether the verbal WM contents could guide attention. The results showed that, compared with the control condition, the visual search RTs were longer in the perceptual-matching and semantic-matching conditions, and the same as the RTs in the fastest trials. With the memory item that never matched the target in the search task, we suggested that the verbal WM contents that were presented visually (vis-VWM) could capture attention at perceptual and semantic levels automatically. In Experiment 2, the memory item was presented by the auditory inputs via the headphones (audi-VWM). The results showed that the visual search RTs in the semantic-matching condition were shorter than RTs in the control and perceptual-matching conditions, and there was no significant difference in the other conditions. Meanwhile, compared the shortest RTs across the different conditions, the results showed that the RTs in the semantic-matching condition were longer than in the control condition, which suggested that the aurally presented verbal WM could capture attention at the semantic level in the fastest response trials. In conclusion, the present study demonstrated that the verbal working memory that presented visually could automatically capture attention at both perceptual and semantic levels, and also verified the hypothesis that the attention capture effect would occur at the early stages of attention. However, the contents of verbal working memory would always capture attention at the earlier processing stage and could only be rejected at the later processing stage when the contents were aurally presented. Due to the modality specificity, attentional resources would be distributed to different sensory modalities. The memory-matching distractors could be rejected at the later processing stage because of there were the sufficient cognitive resources.
Subjects: Psychology >> Social Psychology submitted time 2023-03-27 Cooperative journals: 《心理学报》
Abstract： Both audiovisual integration and inhibition of return (IOR) can facilitate the processing of sensory information, such as enhancing the perceptual processing. Previous studies found that IOR decreased the audiovisual integration at previously attended locations. Several hypotheses have been put forward to explain the effect of IOR on audiovisual integration: perceptual sensitivity, spatial uncertainty, and differences in unimodal signal strength. In present study, we used cue-target paradigm and manipulated the SOA conditions (400~600 ms vs. 1000~1200 ms) to investigate how audiovisual integration would be modulated by IOR induced by visual exogenous spatial cues.The current study was a 2 (SOA conditions: 400~600 ms, 1000~1200 ms) × 3 (target modalities: visual, auditory, audiovisual) × 2 (cue validities: cued, uncued) factorial design. Twenty-seven undergraduate students were recruited as paid volunteers from a university. The visual (V) target was a red and white block (1°×1°). The auditory (A) target (duration of 100 ms) was a 1000 Hz sinusoidal tone presented by speakers. The audiovisual (AV) target was composed by the simultaneous presentation of both the visual and the auditory stimuli. At the beginning of each trial, the fixation stimulus was presented for 800~1000 ms in the center of the display. Following the fixation stimulus, a visual white square served as a exogenous cue was presented for 50 ms at the left or right location randomly. Then, the fixation stimulus was randomly presented for 150~250/450~550 ms, which was followed by a central cue with a delay of 50 ms. Before the target (100 ms) occurrence, the fixation stimulus randomly appeared again for 150~250/450~550 ms. Thus, the SOA between the peripheral cue and the target was completed in 400~600/1000~1200 ms. The target (A, V, or AV) randomly appeared (6/7) for 100 ms in the left or right locations, or no stimulus appeared (1/7). During the experiment, participants were instructed to respond to the target stimulus at any possible locations by pressing a response button as quickly and accurately as possible.The results showed that the responses to AV targets were faster than V or A targets, indicating the appearance of the bimodal advancement effect. A smaller magnitude of audiovisual IOR as compared to visual IOR was found whether it’s in short or long SOA conditions. In addition, visual IOR effect was significantly reduced under the long SOA condition compared with the short SOA condition while the audiovisual integration effect increased by SOA. The results of the relative multisensory response enhancement (rMRE), race model (probability difference) and positive area under the curve (pAUC) showed that audiovisual integration decreased at cued compared to uncued locations under the short SOA condition but not the long SOA condition. Based on the aforementioned findings, it is assumed that visual IOR decreased the audiovisual integration in the short SOA, and audiovisual integration would be modulated by different SOA conditions. The current result supported the hypothesis of differences in unimodal signal strength.
Subjects: Psychology >> Social Psychology submitted time 2023-03-27 Cooperative journals: 《心理学报》
Abstract： Previous studies usually used the instruction to control the attention of the participants to different spatial locations to investigate the influence of endogenous spatial attention on the audiovisual integration, which found that endogenous spatial attention enhanced audiovisual integration. However, in reality, it is difficult to assign attention in an all-or-none manner. In present study, we used endogenous spatial cue-target paradigm to investigate the effect of endogenous spatial cue validity on audiovisual integration.The current study was a 2 (cue validities: valid, invalid) � 3 (target modalities: visual, auditory, audiovisual) factorial design. A total of 62 undergraduate students were recruited as paid volunteers. Experiment 1 recruited 35 participants (5 males; age range: 18~26 years; mean age: 21.26 � 1.77 years). Experiment 2 recruited 27 participants (6 males; age range: 19~25 years; mean age: 22.19 � 1.75 years). The visual (V) target was a white pentagonal asterisk block (2白2�). The auditory (A) target was a 1600 Hz sinusoidal tone presented by speakers. The audiovisual (AV) target was composed by the simultaneous presentation of both the visual and the auditory stimuli. At the beginning of each trial, the fixation stimulus was presented for 600~800 ms in the center of the monitor. Following the fixation stimulus, the cue was presented for 200 ms, which could predict (50% or 80%) the location of the target. Before the target that appeared for 100 ms, the inter stimulus interval (ISI) lasted for 700 ms. The target (A, V, or AV) randomly appeared for 100 ms in the left or right locations. At last, the fixation stimuli appeared for 600 ms to wait for the correspondence responses to targets. During the experiment, the participants were asked to locate targets by pressing buttons (F/J) as quickly and accurately as possible. The results showed that the responses to AV targets were faster than V or A targets, indicating the appearance of the bimodal advancement effect in both experiments. Each target modality showed significant cueing effect. And the cueing effect in experiment 2 was significantly larger than the cueing effect in experiment 1. In addition, in experiment 1, relative multisensory response enhancement (rMRE), race model (probability difference) showed no significant difference at valid compared to invalid locations. However, in experiment 2, rMRE and race model (probability difference) increased at valid compared to invalid locations. The results suggested that endogenous spatial attention enhanced audiovisual integration in high spatial validity condition. In summary, Endogenous spatial attention had different effects on the audiovisual integration under different spatial cue validity. High spatial cue validity enhanced audiovisual integration. The current study provides direct behavioral evidence for endogenous spatial attention to enhance audiovisual integration.
Subjects: Psychology >> Social Psychology submitted time 2023-03-27 Cooperative journals: 《心理学报》
Abstract： Auditory dominance refers to the auditory information in multisensory integration; more priority is given to auditory information, and it is processed in a dominant position. Sound-induced flash illusion (SiFI) is a typical auditory dominance phenomenon, namely, the visual perception of a stimulus for briefly heard voices, qualitatively changing at the same time, resulting in a fission illusion (F1B2) and a fusion illusion (F2B1). Previous studies have shown that elderly adults experience illusions more often than young adults. However, there is not yet a consensus regarding the mechanism when it is investigated using resting fMRI, though resting-state neural activity can reveal the intrinsic functional architecture of the brain (Fox & Raichle, 2007). Therefore, the present study aims to investigate how resting-state neural activity (ALFF) is related to SiFIs in elderly adults and will provide important novel insights into the differences in SiFIs between elderly and young adults.We selected 50 elderly adults (ages: 50~69 year old, M = 61.78, SD = 4.17) and 50 young adults (ages: 17~27 year old, M = 20.86, SD = 2.17). The present study was a 2 (participants: elderly vs. young adults) × 2 (flash number: 1 vs. 2) × 3 (sound number: 0 vs. 1 vs 2) mixed design. RS-fMRI data were collected by a magnetic resonance scanner in the participants’ natural state of wakefulness and relaxation. The RS-fMRI data were obtained by a Philips 3.0T magnetic resonance scanner, and the images of all participants' resting states were obtained by gradient echoplanar imaging (EPI) and scan parameters as follows: the TR = 2000 ms, TE = 30 ms, of view (FOV) = 220 mm × 220 mm, Turn corner = 90°, matrix = 64×64, Layer number = 36, layer thickness = 4 mm, with a thick layer of scanning time 400 s. We used the low-frequency amplitude of the resting state of the brain (ALFF) to investigate the correlation between SiFI and spontaneous brain region activity in elderly and young adults to reveal SiFI differences. ALFF results were calculated using DPABI, an RS-fMRI data processing software ( Yan et al., 2016). From the perspective of the accuracy results, elderly and young adults both experienced fission and fusion illusions. However, regardless of experiencing a fission illusion or a fusion illusion, the amount of illusion experienced by elderly adults was greater than that experienced by young adults. From the correlation analysis results of ALFF and illusions, there was a significant positive correlation between the F1B2 illusion and spontaneous medial prefrontal cortex (MPFC) activity in elderly adults, and there was a significant negative correlation between the F1B2 illusion and spontaneous activity in the right superior occipital gyrus (SOG) and the left lingual gyrus in young adults. For the F2B1 illusion, there was a significant negative correlation between the F2B1 illusion and spontaneous activity in the right superior occipital gyrus (SOG), the left lingual gyrus (IFG) and the right cerebellum and a significant positive correlation between the F2B1 illusion and the spontaneous activity in the left inferior frontal gyrus (IFG), the right middle frontal gyrus (MFG) and the left inferior temporal gyrus (ITG) in elderly adults. However, there was a significant positive correlation between the F2B1 illusion and spontaneous activity in the left superior frontal gyrus (SFG) in young adults. The present study showed that the increased illusions experienced by elderly adults were related to spontaneous activity during resting states in multiple brain regions.
Subjects: Psychology >> Social Psychology submitted time 2023-03-27 Cooperative journals: 《心理学报》
Abstract： Statistical regularity refers to the regular presentation of stimuli implicit in a task. Previous studies have shown that statistical regularity based on location can affect the judgement of subsequent stimuli presented at that location. The effect of attentional capture would decrease when the distractor frequently appears in a certain location. However, comprehensive studies on whether statistical regularity based on features can modulate attention are lacking. The current study adopted a variant of the additional singleton paradigm to investigate the influence of feature-based statistical regularity of singletons on the attentional suppression effect. Experiment 1 was a single-factor within-subject design, and the presentation of a colour singleton was manipulated (colour singleton absent vs. colour singleton present) to investigate the attentional suppression effect. During the task, the participants adopted a feature search strategy to search for a target of a specific shape (diamond or circle) and ignored the salient colour singleton. In half of the trials, all stimuli were the same colour (green or red); in the other half of the trials, one colour singleton was presented among the search sequences. Similar to Experiment 1, Experiment 2 was a single-factor within-subject design, but the statistical regularity of the singleton features was manipulated (colour singleton absent vs. low probability colour singleton present vs. high probability colour singleton present). In one-third of the trials, all stimuli were the same colour (colour singleton absent). In the trials in which a colour singleton was presented, the colour singleton frequently appeared in a specific colour (50%, called high probability colour); in the other half of the singleton-present trials, a colour singleton appeared in one of the three colours randomly (called low probability colour). The participants were asked to respond by pressing the keyboard as quickly and accurately as possible in both Experiment 1 and Experiment 2. Based on the reaction times, the results showed that (1) in Experiment 1, when the participants were forced to adopt the feature search strategy, they responded significantly faster in the colour singleton-present trials than in the colour singleton-absent trials; (2) in Experiment 2, regardless of whether there was a high or low probability colour condition, the participants responded significantly faster when the colour singleton was present than when it was absent; (3) compared with the low probability colour condition, the high probability colour condition corresponded to significantly faster responses. These results suggest that the influence of statistical regularity on attention is not confined to location, and feature-based statistical regularity of singletons can also modulate the attentional suppression effect.
Subjects: Psychology >> Social Psychology submitted time 2023-03-27 Cooperative journals: 《心理学报》
Abstract： Audiovisual integration is the integration of visual and auditory information into a unified, coherent and stable perceptual process. Although endogenous spatial attention can promote audiovisual integration in youth, studies have found differences in endogenous spatial attention between older adults and youth. It is unclear how endogenous spatial attention affects audiovisual integration in older adults and how audiovisual integration differs between older adults and young adults under endogenous spatial attention conditions. In this study, using the endogenous cue-target paradigm, three experiments investigated how endogenous spatial attention affects the audiovisual integration of elderly individuals under 50% (Experiment 1), 70% (Experiment 2), and 90% (Experiment 3) conditions.A mixed 2 (participant type: elderly vs. young) � 2 (cue type: valid cue vs. invalid cue) � 3 (target stimulus type: A vs. V vs. AV) experimental design was used. The visual stimulus was a 2� � 2� red (RGB: 234, 86, 97) and yellow (RGB: 247, 200, 125) intersecting meta-pattern, the auditory stimulus was a 1600 Hz, 60 dB sinusoidal tone presented by ear headphones, and the audiovisual stimulus was visual and auditory stimuli presented simultaneously on the same side. The gaze screen was presented for 500 ms, followed by a cue screen for 200 ms. The cue was an arrow pointing left or right. After a time interval of 600 ms, the target stimulus (A vs. V vs. AV) was presented in a box on the left or right side for 100 ms. Before the experiment, participants were informed that the cue validity was 50% for Experiment 1, 70% for Experiment 2, and 90% for Experiment 3 and were asked to judge the orientation of the target stimulus and to press the (N/M) key quickly and accurately.From the reaction time results, it is clear that the reaction time of elderly people is significantly slower than that of younger people. From the relative amount of multisensory response enhancement (rMRE) and race model results, we can see that (1) audiovisual integration was weaker in older adults than in younger adults regardless of cue validity; (2) at 50% cue validity (Experiment 1), audiovisual integration in the valid cue condition was not significantly different from that in the invalid cue condition for both older and younger adults; (3) at 70% cue validity (Experiment 2), audiovisual integration in the valid cue condition was not significantly different from that in the invalid cue condition for older adults, and audiovisual integration in the valid cue condition was significantly higher than that in the invalid cue condition for younger adults; and (4) at 90% cue validity (Experiment 3), audiovisual integration in the valid cue condition was significantly higher than that in the invalid cue condition for both older and younger adults.Endogenous spatial attention had different moderating effects on audiovisual integration in older adults under different cue validity conditions and could promote audiovisual integration in older adults under high cue validity conditions. The findings further support the spatial uncertainty hypothesis and deepen the understanding of the interaction between endogenous attention and audiovisual integration.
Subjects: Psychology >> Social Psychology submitted time 2023-03-27 Cooperative journals: 《心理学报》
Abstract： Attention effect has been greatly explored in multisensory integration. Previous studies found that endogenous spatial attention enhanced multisensory integration, while exogenous spatial attention decreased multisensory integration. However, there is no research integrates two kinds of spatial attention into the multisensory integration. In present study, we used endogenous-exogenous spatial cue target paradigm to investigate the effect of endogenous spatial attention and exogenous spatial attention on multisensory integration.The present study consisted of 2 experiments. In these experiments, we mainly manipulated the endogenous cue validities (including cued, uncued), exogenous cue validities (including cued, uncued) and target modalities (including visual, auditory, and audiovisual modalities). Thirty-six students in Liaoning Normal University were recruited in Exp. 1. The visual (V) target was a white pentagonal asterisk block (2°×2°). The auditory (A) target was a 1 600 Hz sinusoidal tone presented by speakers. The audiovisual (AV) target was composed by the simultaneous presentation of both the visual and the auditory stimuli. At the beginning of each trial, the fixation stimulus was presented for 600~800 ms in the center of the monitor. Following the fixation stimulus, the endogenous cue was presented for 200 ms, which could predict (80%) the location of the target. Then a visual white square served as a exogenous cue was presented for 200 ms at the left or right location randomly. Before the target that appeared for 100 ms, the inter stimulus interval (ISI) lasted for 150 ms. The target (A, V, or AV) randomly appeared for 100 ms in the left or right locations. At last, the fixation stimuli appeared for 1000 ms to wait for the correspondence responses to targets. During the experiment, the participants were asked to locate targets by pressing buttons (F/J) as quickly and accurately as possible. Thirty-six college students were recruited in Exp. 2. In Exp. 2, visual stimuli included checkerboard squares (3.2°×3.2°) with gray (RGB: 147, 149, 152) in the middle and black (RGB: 0, 0, 0) in the middle; auditory stimuli included high-frequency sinusoidal tone (1400) and low-frequency sinusoidal tone (714). The visual target was one of the above two visual stimuli, and the auditory target was one of the above two auditory stimuli. The pairings of two single channel stimuli constituted audiovisual target. The Exp. 2 consisted of four audiovisual targets. Each set of audiovisual targets were balanced among the subjects.The results showed that the responses to AV targets were faster than V or A targets, indicating the appearance of the bimodal advancement effect in both experiments. In addition, we found exogenous spatial attention’s race model (probability difference) showed significant smaller at cued compared to uncued condition in both experiments, while the endogenous spatial attention reduced the extent to which the exogenous spatial attention weakened the effect of multisensory integration in Exp.2, but not in Exp. 1. From the results of the relative amount of multisensory response enhancement (rMRE), In Exp. 1, the effects of endogenous spatial attention and exogenous spatial attention on multisensory integration were marginal significant. In Exp. 2, the two kinds of spatial attention had significant interaction with multisensory integration.In summary, exogenous spatial attention decreased multisensory integration in both experiments. Endogenous spatial attention is involved in multisensory integration and has an impact on exogenous spatial attention in Exp. 2. The effects of endogenous spatial attention and exogenous spatial attention on multisensory integration in an interactive manner.
Subjects: Psychology >> Social Psychology submitted time 2023-03-27 Cooperative journals: 《心理学报》
Abstract： Both inhibition of return (IOR) and emotion have the characteristics of attentional bias and improving search efficiency. Previous studies mostly used a single modality presentation of emotional stimuli to investigate the relationship between the two, but the findings are inconsistent. Existing studies have shown that the congruent emotion of audiovisual dual modality can be integrated into the perceptual stage, which is the same as the processing stage of IOR. Therefore, the present study adopted the cue-target paradigm and used audiovisual dual modality to present emotional stimuli to further investigate the interaction between emotion and IOR. Experiment 1 was a three-factor within-subject design. We manipulated the presentation of cue validity (cued vs. uncued), target modalities (visual vs. audiovisual), and emotion type (negative vs. neutral). The task of the subjects was to identify the emotional stimuli of visual modality. Experiment 2 was similar to Experiment 1, but the emotional congruency was changed. The audiovisual dual modality presented incongruent emotional stimuli (visual negative face-auditory neutral sound; visual neutral face-auditory negative sound) to further investigate whether the impact of the audiovisual dual modality emotional stimulus on IOR was caused by the emotional stimulus of the auditory modality, that is, whether the emotional stimulus of the auditory modality was processed. In Experiment 1, the responses in the cued condition were slower than those in the uncued condition, which suggested that IOR occurred. More importantly, the interaction between emotion type and cue validity in the audiovisual dual modality condition showed that congruent negative emotion produces a smaller IOR effect (11 ms) than neutral emotion (25 ms). At the same time, the audiovisual dual modality condition produced a smaller IOR effect (18 ms) than the visual single modality condition (40 ms). We also found a larger multisensory response enhancement effect in the congruent negative emotion than in the neutral emotion. In Experiment 2, the results showed that there was no interaction between emotion and IOR under the condition of audiovisual dual modality, and there was no significant difference in IOR effect between single modality and audiovisual dual modality. This indicated that the IOR effect was not influenced by the presence of incongruent emotion in the audiovisual dual modality. In summary, the present study showed that the IOR effect was influenced only when the audiovisual dual modality presented the same emotion. Our findings revealed that IOR and audiovisual dual modality congruent emotion in the same processing stage had a mutual influence. Audiovisual dual modality congruent emotion weakened the IOR effect, and the differences between the negative emotion and the neutral emotion showed the adaptability of IOR. At the same time, this study further supports the perceptual inhibition theory of IOR.
Subjects: Psychology >> Cognitive Psychology submitted time 2023-02-23
Abstract：
Different dimensions of visual and auditory stimuli can map to each other to influence human behavioral responses, a phenomenon known as audiovisual cross-modal correspondence. A common audiovisual cross-modal correspondence is between auditory tones and visual spatial locations, with individuals tending to map high-pitched sounds to high spatial location and low-pitched sounds to low spatial location. When a high-pitch sound is accompanied or preceded by a visual stimulus, the participants respond faster to visual stimuli presented in the high spatial location than to visual stimuli presented in the low spatial location, and vice versa. Researchers have different views on the level at which audiovisual cross-modal correspondence occurs. Some argue that audiovisual cross-modal correspondence occurs at the perceptual level, increasing the perceptual saliency of the stimulus, while others argue that audiovisual cross-modal correspondence occurs at a later semantic or decision level. As inhibition of return (IOR) in the attentional system can affect human perception, this study used a cue-target paradigm to explore the interaction between IOR and audiovisual cross-modal correspondence to elucidate the occurrence level and mechanism of audiovisual cross-modal correspondence. Audiovisual cross-modal correspondence between auditory tones and visual spatial locations was expected to occur at the perceptual level and therefore would be subject to the IOR effect occurring at the same processing level.
The present study consisted of 3 experiments. Experiment 1 had a 2 × 2 within-subjects design; we manipulated the spatial cue validity (valid cue vs. invalid cue) and audiovisual cross-modal correspondence (congruent vs. incongruent). During the experiment, a fixation point was first presented in the middle of the screen for 750 ms. The box above or below the fixation point was then bolded for 50 ms, but this cue was not predictive of the spatial location of the target. After a time interval of 250 ms, a fixation point was presented in bold as a central cue. A central cue is commonly used in spatial IOR research, as it facilitates stable occurrence of IOR. The central cue was presented for 50 ms, and then the auditory stimulus (either high or low pitch) was presented for 50 ms. After a 200-ms interval, the visual target was presented for 100 ms in the box above or below the fixation point. The participants were instructed to perform a detection task for the presence of a visual target. The experimental design and procedure of Experiment 2 were identical to those of Experiment 1, except that the sound presented before the visual target was a single tone that was present or absent. Experiment 3 had a 2 × 2 × 2 within-subjects design. Experiment 3 added a factor to Experiment 1, namely, stimulus onset asynchrony (SOA) between the cue and the target (600 ms vs. 1300 ms).
In all three experiments, the overall accuracy (ACC) was very high; thus, no further statistical analysis was conducted for the ACC. In terms of reaction time (RT), the results of Experiment 1 showed that both spatial IOR and audiovisual cross-modal correspondence occurred. Importantly, there was an interaction between spatial cue validity and audiovisual cross-modal correspondence. Specifically, when the cue was valid, audiovisual cross-modal correspondence occurred, and when the cue was invalid, there was no audiovisual cross-modal correspondence. The results of Experiment 2 showed that the interaction between cue validity and sound presentation was not significant, and there was no evidence that IOR influenced the sound-induced facilitation effect. The results of Experiment 3 showed that the interaction among spatial cue validity, cross-modal correspondence congruency, and SOA was significant. Specifically, at an SOA of 600 ms, the interaction between spatial cue validity and cross-modal correspondence congruency was significant. When the cue was valid, audiovisual cross-modal correspondence occurred, and when the cue was invalid, there was no audiovisual cross-modal correspondence. At an SOA of 1300 ms, the interaction between cue validity and cross-modal correspondence congruency was not significant, and cross-modal correspondence occurred in both valid-cue and invalid-cue conditions. The results of the analysis of the IOR effect showed that the IOR effect under the 600-ms SOA condition (22 ms) was significantly larger than that under the 1300-ms SOA condition (16 ms). As the SOA increased, the IOR effect size decreased.
In conclusion, the present results suggested that the IOR effect, occurring at the perceptual level, moderated audiovisual cross-modal correspondence. When the IOR effect occurred, audiovisual cross-modal correspondence occurred in the cued location, but not in the non-cued location. The alerting effect induced by the sound did not interact with IOR. With the weakening of the IOR effect, the audiovisual cross-modal correspondence in the cued location decreased, and the moderating effect of the IOR effect on audiovisual cross-modal correspondence weakened. The present results support that the audiovisual cross-modal correspondence between auditory tones and visual spatial locations occurs at the perceptual level, and the occurrence of audiovisual cross-modal correspondence conforms to the principle of inverse effectiveness.
Peer Review Status:
Awaiting Review
Subjects: Psychology >> Cognitive Psychology Subjects: Psychology >> Experimental Psychology submitted time 2022-11-26
Abstract：
Audiovisual integration is the integration of visual and auditory information into a unified, coherent and stable perceptual process. Although endogenous spatial attention can promote audiovisual integration in youth, studies have found differences in endogenous spatial attention between older adults and youth. It is unclear how endogenous spatial attention affects audiovisual integration in older adults and how audiovisual integration differs between older adults and young adults under endogenous spatial attention conditions. In this study, using the endogenous cue#2;target paradigm, three experiments investigated how endogenous spatial attention affects the audiovisual integration of elderly individuals under 50% (Experiment 1), 70% (Experiment 2), and 90% (Experiment 3) conditions. A mixed 2 (participant type: elderly vs. young) × 2 (cue type: valid cue vs. invalid cue) × 3 (target stimulus type: A vs. V vs. AV) experimental design was used. The visual stimulus was a 2° × 2° red (RGB: 234, 86, 97) and yellow (RGB: 247, 200, 125) intersecting meta–pattern, the auditory stimulus was a 1600 Hz, 60 dB sinusoidal tone presented by ear headphones, and the audiovisual stimulus was visual and auditory stimuli presented simultaneously on the same side. The gaze screen was presented for 500 ms, followed by a cue screen for 200 ms. The cue was an arrow pointing left or right. After a time interval of 600 ms, the target stimulus (A vs. V vs. AV) was presented in a box on the left or right side for 100 ms. Before the experiment, participants were informed that the cue validity was 50% for Experiment 1, 70% for Experiment 2, and 90% for Experiment 3 and were asked to judge the orientation of the target stimulus and to press the (N/M) key quickly and accurately. From the reaction time results, it is clear that the reaction time of elderly people is significantly slower than that of younger people. From the relative amount of multisensory response enhancement (rMRE) and race model results, we can see that (1) audiovisual integration was weaker in older adults than in younger adults regardless of cue validity; (2) at 50% cue validity (Experiment 1), audiovisual integration in the effective cue condition was not significantly different from that in the invalid cue condition for both older and younger adults; (3) at 70% cue validity (Experiment 2), audiovisual integration in the effective cue condition was not significantly different from that in the invalid cue condition for older adults, and audiovisual integration in the effective cue condition was significantly higher than that in the invalid cue condition for younger adults; and (4) at 90% cue validity (Experiment 3), audiovisual integration in the effective cue condition was significantly higher than that in the ineffective cue condition for both older and younger adults. Endogenous spatial attention had different moderating effects on audiovisual integration in older adults under different cue validity conditions and could promote audiovisual integration in older adults under high cue validity conditions. The findings further support the spatial uncertainty hypothesis and deepen the understanding of the interaction between endogenous attention and audiovisual integration.
Peer Review Status:Awaiting Review
Subjects: Psychology >> Cognitive Psychology submitted time 2021-11-20
Abstract： Both inhibition of return (IOR) and emotion have the characteristics of attentional bias and improving search efficiency. Previous studies mostly used single modality presentation of emotional stimuli to investigate the relationship between the two, but the results of the research are not consistent. Existing studies have shown that the congruent emotion of audiovisual dual modality can be integrated into the perceptual stage, which is the same as the processing stage of IOR. Therefore, the present study adopted the cue-target paradigm and used audiovisual dual modality to present emotional stimuli to further investigate the interaction between emotion and IOR. Experiment 1 was a three-factors within-subject design. We mainly manipulated the presentation of cue validity (cued vs. uncued), target modalities (visual vs. audiovisual) and emotion type (negative vs. neutral). The task of the subjects was to identify the emotional stimuli of visual modality. Experiment 2 was similar to Experiment 1, but the emotional congruency was changed. The audiovisual dual modality presented incongruent emotion stimuli (visual negative face-auditory neutral sound; visual neutral face-auditory negative sound) to further investigate whether the impact of the audiovisual dual modality emotional stimulus on IOR was caused by the emotional stimulus of the auditory modality, that is, whether the emotional stimulus of the auditory modality has been processed. In Experiment 1, the responses in the cued condition were slower than those in the uncued condition, which suggested that IOR occurred. More importantly, the interaction between emotion type and cue validity in the condition of audiovisual dual modality, which showed that congruent negative emotion produces less IOR effect (11 ms) than neutral emotion (25 ms). At the same time, the audiovisual dual modality condition produced less IOR effect (18 ms) than the visual single modality condition (40 ms). We also found a larger multisensory response enhancement effect in the congruent negative emotion than in the neutral emotion. In Experiment 2, the results showed that there was no interaction between emotion and IOR under the condition of audiovisual dual modality, and there was no significant difference in IOR effect between single modality and audiovisual dual modality. This indicated that the IOR effect was not influenced by the presence of incongruent emotion in audiovisual dual modality. In summary, the present study showed that the IOR effect was influenced only when the audiovisual dual modality presented the same emotion. Our findings revealed that IOR and audiovisual dual modality congruent emotion in the same processing stage had a mutual influence. Audiovisual dual modality congruent emotion weakened the IOR effect and the differences between the negative emotion and the neutral emotion showed the adaptability of IOR. At the same time, this study further supported the perceptual inhibition theory of IOR. "
Peer Review Status:Awaiting Review
Subjects: Psychology >> Cognitive Psychology Subjects: Psychology >> Experimental Psychology submitted time 2021-02-25
Abstract： Background: Previous laboratory studies have shown that an individual’s response in the current trial can be influenced by a previous trial, and this has been described as an effect of trial history. Existing studies have shown that there is a trial history effect with visual spatial inhibition of return (IOR), and some studies have shown that changes in stimulus modalities also affect reaction times (RTs). The present study used the “prime-neutral cue-target” paradigm to examine the trial history effect in cross-modal, non-spatial IOR and attempted to decrease the trial history effect. Method: In two experiments, we mainly manipulated the cue-target modalities in the current trial (auditory-visual vs. visual-auditory modalities), cue validity in the current trial (cued vs. uncued) and cue validity in the previous trial (cued vs. uncued). Thirty participants were recruited in Experiment 1. The visual prime cue was a red or blue disk with a radius of 2° visual angle, and the auditory prime cue was a verbal sound in Chinese at 75 dB (\hong\ or \lan\). The visual neutral cue was a green disk with a radius of 2° visual angle, and the auditory neutral cue was a verbal sound in Chinese at 75 dB (\lv\); The visual target was a red or blue disk with a radius of 2° visual angle, and the auditory target was a verbal sound in Chinese at 75 dB (\hong\ and \lan\). During the experiment, each trial began with a 400 ms fixation cross in the centre of the monitor, and a 300 ms visual or auditory prime cue was followed by a 200 ms fixation cross. After the 300 ms visual or auditory neutral cue, another fixation cross was presented for 300 ms, and then a 300 ms auditory or visual target was presented. The participants were asked to discriminate the identity of the target(i.e., either a colour disk or vocalization of \hong\or \lan\) within 1500 ms. Following a 1500 ms intertrial interval (ITI) with a blank screen, the next trial was initiated. Twenty-nine participants were recruited in Experiment 2, the ITI was 4500 ms, and the other parameters were identical to those in Experiment 1. Results: Regarding the RTs results, Experiment 1 showed that the RTs for cued targets in the current trial were larger than RTs for uncued targets, which was a colour-based non-spatial IOR. The IOR effect size in the current trial showed an interaction between the cue validity in the previous trial and the cue-target modality in the current trial. The IOR effect size on the current trial after a valid cue trial was larger than the IOR effect size with an invalid cue in the previous trial when the current trial was a visual cue and auditory target; however, there was no difference in the IOR effect size when the cue was auditory, and the target was visual in the current trial. Furthermore, the analysis of the target modality across trials revealed that the valid cue, but not the invalid cue, in the previous trial, could induce a larger IOR effect size in the current trial with visual cues. A longer ITI (4500 ms) was used in Experiment 2 compared to Experiment 1, and the results showed that there was a difference in the IOR effect size in the current trial between the visual cues and auditory cues in the current trial. The IOR effect size in the current trial was not influenced by the validity of the previous trial or whether the current trial had auditory cues or visual cues. Conclusion: These results suggested an interaction between trials on cross-modal non-spatial IOR, but the effect was related to the cue-target modality. There was not only the cue validity effect across trials but also the target modality switch effect between trials. Increasing the time interval between trials can reduce the effect of the previous trial on the IOR effect size in the current trial."
Subjects: Psychology >> Cognitive Psychology submitted time 2021-02-03
Abstract： Statistical regularity refers to the regular presentation of stimuli implicit in a task. Previous studies have shown that statistical regularity based on location can affect the judgement of subsequent stimuli presented at that location. The effect of attentional capture would decrease when the distractor frequently appears in a certain location. However, comprehensive studies on whether statistical regularity based on features can modulate attention are lacking. The current study adopted a variant of the additional singleton paradigm to investigate the influence of feature-based statistical regularity of singletons on the attentional suppression effect. Experiment 1 was a single-factor within-subject design, and the presentation of a colour singleton was manipulated (colour singleton absent vs. colour singleton present) to investigate the attentional suppression effect. During the task, the participants adopted a feature search strategy to search for a target of a specific shape (diamond or circle) and ignored the salient colour singleton. In half of the trials, all stimuli were the same colour (green or red); in the other half of the trials, one colour singleton was presented among the search sequences. Similar to experiment 1, experiment 2 was a single-factor within-subject design, but the statistical regularity of the singleton features was manipulated (colour singleton absent vs. low probability colour singleton present vs. high probability colour singleton present). In one-third of the trials, all stimuli were the same colour (colour singleton absent). In the trials in which a colour singleton was presented, the colour singleton frequently appeared in a specific colour (50%, called high probability colour); in the other half of the singleton-present trials, a colour singleton appeared in one of the three colours randomly (called low probability colour). The participants were asked to respond by pressing the keyboard as quickly and accurately as possible in both experiment 1 and experiment 2. Based on the reaction times, the results showed that (1) in experiment 1, when the participants were forced to adopt the feature search strategy, they responded significantly faster in the colour singleton-present trials than in the colour singleton-absent trials; (2) in experiment 2, regardless of whether there was a high or low probability colour condition, the participants responded significantly faster when the colour singleton was present than when it was absent; (3) compared with the low probability colour condition, the high probability colour condition corresponded to significantly faster responses. These results suggest that the influence of statistical regularity on attention is not confined to location, and feature-based statistical regularity of singletons can also modulate the attentional suppression effect. "
Peer Review Status:Awaiting Review
Subjects: Psychology >> Cognitive Psychology submitted time 2020-09-04
Abstract： " In the traditional theory of visual attentional capture, the stimulus-driven theory and goal-driven theory were argued for nearly 20 years. Later, two new hybrid models were proposed, which combined bottom-up capture and top-down control settings, called the rapid disengagement hypothesis and the signal suppression hypothesis. The main content of the rapid disengagement hypothesis is that attention is captured by a salient distractor but is immediately disengaged when the distractor does not contain target’s defining attribute. Signal suppression hypothesis posits that a salient distractor can automatically produce a bottom-up “attend-to-me” signal, but this signal can be suppressed via top-down control processes so that it does not actually capture attention. The empirical evidence of the rapid disengagement hypothesis indicated that the spatial-cuing paradigm and oculomotor disengagement paradigm were most often adopted, and participants took the singleton search strategy. The empirical evidence of the signal suppression hypothesis indicated that the additional singleton paradigm was most often adopted, and participants were forced to take the feature search strategy. In the future, more studies adopting different stimuli and experimental methods are needed to support those two hybrid models. The effects of reward and training on “attentional capture-disengagement” and “signal-suppression” should also be explored in future research.
Peer Review Status:Awaiting Review
Subjects: Psychology >> Cognitive Psychology submitted time 2020-06-05
Abstract： "
Peer Review Status:Awaiting Review
Hits
YES
Hits
Downloads
Comment