Asunto(s)

RESUMEN

The integration of electroencephalography (EEG) and functional near-infrared spectroscopy (fNIRS) can facilitate the advancement of brain-computer interfaces (BCIs). However, existing research in this domain has grappled with the challenge of the efficient selection of features, resulting in the underutilization of the temporal richness of EEG and the spatial specificity of fNIRS data.To effectively address this challenge, this study proposed a deep learning architecture called the multimodal DenseNet fusion (MDNF) model that was trained on two-dimensional (2D) EEG data images, leveraging advanced feature extraction techniques. The model transformed EEG data into 2D images using a short-time Fourier transform, applied transfer learning to extract discriminative features, and consequently integrated them with fNIRS-derived spectral entropy features. This approach aimed to bridge existing gaps in EEG-fNIRS-based BCI research by enhancing classification accuracy and versatility across various cognitive and motor imagery tasks.Experimental results on two public datasets demonstrated the superiority of our model over existing state-of-the-art methods.Thus, the high accuracy and precise feature utilization of the MDNF model demonstrates the potential in clinical applications for neurodiagnostics and rehabilitation, thereby paving the method for patient-specific therapeutic strategies.

Asunto(s)

RESUMEN

Brain-computer interface (BCI) technology has gained recognition in various fields, including clinical applications, assistive technology, and human-computer interaction research. BCI enables communication, control, and monitoring of the affective/cognitive states of users. Recently, BCI has also found applications in the artistic field, enabling real-time art composition using brain activity signals, and engaging performers, spectators, or an entire audience with brain activity-based artistic environments. Existing techniques use specific features of brain activity, such as the P300 wave and SSVEPs, to control drawing tools, rather than directly reflecting brain activity in the output image. In this study, we present a novel approach that uses a latent diffusion model, a type of deep neural network, to generate images directly from continuous brain activity. We demonstrate this technology using local field potentials from the neocortex of freely moving rats. This system continuously converted the recorded brain activity into images. Our end-to-end method for generating images from brain activity opens new possibilities for creative expression and experimentation. Notably, our results show that the generated images successfully reflect the dynamic and stochastic nature of the underlying neural activity, providing a unique procedure for visualization of brain function.

Asunto(s)

RESUMEN

Individuals with motor dysfunction caused by damage to the central nervous system are unable to transmit voluntary movement commands to their muscles, resulting in a reduced ability to control their limbs. However, traditional rehabilitation methods have problems such as long treatment cycles and high labor costs. Functional electrical stimulation (FES) based on brain-computer interface (BCI) connects the patient's intentions with muscle contraction, and helps to promote the reconstruction of nerve function by recognizing nerve signals and stimulating the moving muscle group with electrical impulses to produce muscle convulsions or limb movements. It is an effective treatment for sequelae of neurological diseases such as stroke and spinal cord injury. This article reviewed the current research status of BCI-based FES from three aspects: BCI paradigms, FES parameters and rehabilitation efficacy, and looked forward to the future development trend of this technology, in order to improve the understanding of BCI-based FES.

Asunto(s)

RESUMEN

Stroke is an acute cerebrovascular disease in which sudden interruption of blood supply to the brain or rupture of cerebral blood vessels cause damage to brain cells and consequently impair the patient's motor and cognitive abilities. A novel rehabilitation training model integrating brain-computer interface (BCI) and virtual reality (VR) not only promotes the functional activation of brain networks, but also provides immersive and interesting contextual feedback for patients. In this paper, we designed a hand rehabilitation training system integrating multi-sensory stimulation feedback, BCI and VR, which guides patients' motor imaginations through the tasks of the virtual scene, acquires patients' motor intentions, and then carries out human-computer interactions under the virtual scene. At the same time, haptic feedback is incorporated to further increase the patients' proprioceptive sensations, so as to realize the hand function rehabilitation training based on the multi-sensory stimulation feedback of vision, hearing, and haptic senses. In this study, we compared and analyzed the differences in power spectral density of different frequency bands within the EEG signal data before and after the incorporation of haptic feedback, and found that the motor brain area was significantly activated after the incorporation of haptic feedback, and the power spectral density of the motor brain area was significantly increased in the high gamma frequency band. The results of this study indicate that the rehabilitation training of patients with the VR-BCI hand function enhancement rehabilitation system incorporating multi-sensory stimulation can accelerate the two-way facilitation of sensory and motor conduction pathways, thus accelerating the rehabilitation process.

Asunto(s)

RESUMEN

In the field of brain-computer interfaces (BCIs) based on functional near-infrared spectroscopy (fNIRS), traditional subject-specific decoding methods suffer from the limitations of long calibration time and low cross-subject generalizability, which restricts the promotion and application of BCI systems in daily life and clinic. To address the above dilemma, this study proposes a novel deep transfer learning approach that combines the revised inception-residual network (rIRN) model and the model-based transfer learning (TL) strategy, referred to as TL-rIRN. This study performed cross-subject recognition experiments on mental arithmetic (MA) and mental singing (MS) tasks to validate the effectiveness and superiority of the TL-rIRN approach. The results show that the TL-rIRN significantly shortens the calibration time, reduces the training time of the target model and the consumption of computational resources, and dramatically enhances the cross-subject decoding performance compared to subject-specific decoding methods and other deep transfer learning methods. To sum up, this study provides a basis for the selection of cross-subject, cross-task, and real-time decoding algorithms for fNIRS-BCI systems, which has potential applications in constructing a convenient and universal BCI system.

Asunto(s)

RESUMEN

Brain-computer interface (BCI) based on steady-state visual evoked potential (SSVEP) have attracted much attention in the field of intelligent robotics. Traditional SSVEP-based BCI systems mostly use synchronized triggers without identifying whether the user is in the control or non-control state, resulting in a system that lacks autonomous control capability. Therefore, this paper proposed a SSVEP asynchronous state recognition method, which constructs an asynchronous state recognition model by fusing multiple time-frequency domain features of electroencephalographic (EEG) signals and combining with a linear discriminant analysis (LDA) to improve the accuracy of SSVEP asynchronous state recognition. Furthermore, addressing the control needs of disabled individuals in multitasking scenarios, a brain-machine fusion system based on SSVEP-BCI asynchronous cooperative control was developed. This system enabled the collaborative control of wearable manipulator and robotic arm, where the robotic arm acts as a "third hand", offering significant advantages in complex environments. The experimental results showed that using the SSVEP asynchronous control algorithm and brain-computer fusion system proposed in this paper could assist users to complete multitasking cooperative operations. The average accuracy of user intent recognition in online control experiments was 93.0%, which provides a theoretical and practical basis for the practical application of the asynchronous SSVEP-BCI system.

Asunto(s)

RESUMEN

This study investigates a brain-computer interface (BCI) system based on an augmented reality (AR) environment and steady-state visual evoked potentials (SSVEP). The system is designed to facilitate the selection of real-world objects through visual gaze in real-life scenarios. By integrating object detection technology and AR technology, the system augmented real objects with visual enhancements, providing users with visual stimuli that induced corresponding brain signals. SSVEP technology was then utilized to interpret these brain signals and identify the objects that users focused on. Additionally, an adaptive dynamic time-window-based filter bank canonical correlation analysis was employed to rapidly parse the subjects' brain signals. Experimental results indicated that the system could effectively recognize SSVEP signals, achieving an average accuracy rate of 90.6% in visual target identification. This system extends the application of SSVEP signals to real-life scenarios, demonstrating feasibility and efficacy in assisting individuals with mobility impairments and physical disabilities in object selection tasks.

Asunto(s)

Asunto(s)

RESUMEN

Injection molding is a common plastic processing technique that allows melted plastic to be injected into a mold through pressure to form differently shaped plastic parts. In injection molding, in-mold electronics (IME) can include various circuit components, such as sensors, amplifiers, and filters. These components can be injected into the mold to form a whole within the melted plastic and can therefore be very easily integrated into the molded part. The brain-computer interface (BCI) is a direct connection pathway between a human or animal brain and an external device. Through BCIs, individuals can use their own brain signals to control these components, enabling more natural and intuitive interactions. In addition, brain-computer interfaces can also be used to assist in medical treatments, such as controlling prosthetic limbs or helping paralyzed patients regain mobility. Brain-computer interfaces can be realized in two ways: invasively and noninvasively, and in this paper, we adopt a noninvasive approach. First, a helmet model is designed according to head shape, and second, a printed circuit film is made to receive EEG signals and an IME injection mold for the helmet plastic parts. In the electronic film, conductive ink is printed to connect each component. However, improper parameterization during the injection molding process can lead to node displacements and residual stress changes in the molded part, which can damage the circuits in the electronic film and affect its performance. Therefore, in this paper, the use of the BCI molding process to ensure that the node displacement reaches the optimal value is studied. Second, the multistrategy differential evolutionary algorithm is used to optimize the injection molding parameters in the process of brain-computer interface formation. The relationship between the injection molding parameters and the actual target value is investigated through Latin hypercubic sampling, and the optimized parameters are compared with the target parameters to obtain the optimal parameter combination. Under the optimal parameters, the node displacement can be optimized from 0.585 to 0.027 mm, and the optimization rate can reach 95.38%. Ultimately, by detecting whether the voltage difference between the output inputs is within the permissible range, the reliability of the brain-computer interface after node displacement optimization can be evaluated.

Asunto(s)

RESUMEN

This study explores neuroplasticity through the use of virtual reality (VR) and brain-computer interfaces (BCIs). Neuroplasticity is the brain's ability to reorganize itself by forming new neural connections in response to learning, experience, and injury. VR offers a controlled environment to manipulate sensory inputs, while BCIs facilitate real-time monitoring and modulation of neural activity. By combining VR and BCI, researchers can stimulate specific brain regions, trigger neurochemical changes, and influence cognitive functions such as memory, perception, and motor skills. Key findings indicate that VR and BCI interventions are promising for rehabilitation therapies, treatment of phobias and anxiety disorders, and cognitive enhancement. Personalized VR experiences, adapted based on BCI feedback, enhance the efficacy of these interventions. This study underscores the potential for integrating VR and BCI technologies to understand and harness neuroplasticity for cognitive and therapeutic applications. The researchers utilized the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) method to conduct a comprehensive and systematic review of the existing literature on neuroplasticity, VR, and BCI. This involved identifying relevant studies through database searches, screening for eligibility, and assessing the quality of the included studies. Data extraction focused on the effects of VR and BCI on neuroplasticity and cognitive functions. The PRISMA method ensured a rigorous and transparent approach to synthesizing evidence, allowing the researchers to draw robust conclusions about the potential of VR and BCI technologies in promoting neuroplasticity and cognitive enhancement.

Asunto(s)

RESUMEN

A brain-computer interface could control a bionic hand by interpreting electroencephalographic (EEG) signals associated with wrist extension (WE) and wrist flexion (WF) movements. Misinterpretations of the EEG may stem from variations in the force, speed and range of these movements. To address this, we designed, constructed and tested a novel dynamometer, the IsoReg, which regulates WE and WF movements during EEG recording experiments. The IsoReg restricts hand movements to isometric WE and WF, controlling their speed and range of motion. It measures movement force using a dual-load cell system that calculates the percentage of maximum voluntary contraction and displays it to help users control movement force. Linearity and measurement accuracy were tested, and the IsoReg's performance was evaluated under typical EEG experimental conditions with 14 participants. The IsoReg demonstrated consistent linearity between applied and measured forces across the required force range, with a mean accuracy of 97% across all participants. The visual force gauge provided normalised force measurements with a mean accuracy exceeding 98.66% across all participants. All participants successfully controlled the motor tasks at the correct relative forces (with a mean accuracy of 89.90%) using the IsoReg, eliminating the impact of inherent force differences between typical WE and WF movements on the EEG analysis. The IsoReg offers a low-cost method for measuring and regulating movements in future neuromuscular studies, potentially leading to improved neural signal interpretation.

Asunto(s)

RESUMEN

The research and development of emerging technologies has potential long-term and societal impacts that pose governance challenges. This essay summarizes the development of research ethics in China over the past few decades, as well as the measures taken by the Chinese government to build its ethical governance system of science and technology after the occurrence of the CRISPR-babies incident. The essay then elaborates on the current problems of this system through the case study of ethical governance of brain-computer interface research, and explores how the transition from research ethics to translational bioethics, which encourages interdisciplinary collaboration and focuses on societal implications, may respond to the challenges of ethical governance of science and technology.

Asunto(s)

Asunto(s)

RESUMEN

Objective.Steady-state visual evoked potentials (SSVEPs) in response to flickering stimuli are popular in brain-computer interfacing but their implementation in virtual reality (VR) offers new opportunities also for clinical applications. While traditional SSVEP target selection relies on single-frequency stimulation of both eyes simultaneously, further called congruent stimulation, recent studies attempted to improve the information transfer rate by using dual-frequency-coded SSVEP where each eye is presented with a stimulus flickering at a different frequency, further called incongruent stimulation. However, few studies have investigated incongruent multifrequency-coded SSVEP (MultiIncong-SSVEP).Approach.This paper reports on a systematical investigation of incongruent dual-, triple-, and quadruple-frequency-coded SSVEP for use in VR, several of which are entirely novel, and compares their performance with that of congruent dual-frequency-coded SSVEP.Main results.We were able to confirm the presence of a summation effect when comparing monocular- and binocular single-frequency congruent stimulation, and a suppression effect when comparing monocular- and binocular dual-frequency incongruent stimulation, as both tap into the binocular vision capabilities which, when hampered, could signal amblyopia.Significance.In sum, our findings not only evidence the potential of VR-based binocularly incongruent SSVEP but also underscore the importance of paradigm choice and decoder design to optimize system performance and user comfort.

Asunto(s)

RESUMEN

Objective. Over the last decades, error-related potentials (ErrPs) have repeatedly proven especially useful as corrective mechanisms in invasive and non-invasive brain-computer interfaces (BCIs). However, research in this context exclusively investigated the distinction of discrete events intocorrectorerroneousto the present day. Due to this predominant formulation as a binary classification problem, classical ErrP-based BCIs fail to monitor tasks demanding quantitative information on error severity rather than mere qualitative decisions on error occurrence. As a result, fine-tuned and natural feedback control based on continuously perceived deviations from an intended target remains beyond the capabilities of previously used BCI setups.Approach.To address this issue for future BCI designs, we investigated the feasibility of regressing rather than classifying error-related activity non-invasively from the brain.Main results.Using pre-recorded data from ten able-bodied participants in three sessions each and a multi-output convolutional neural network, we demonstrated the above-chance regression of ongoing target-feedback discrepancies from brain signals in a pseudo-online fashion. In a second step, we used this inferred information about the target deviation to correct the initially displayed feedback accordingly, reporting significant improvements in correlations between corrected feedback and target trajectories across feedback conditions.Significance.Our results indicate that continuous information on target-feedback discrepancies can be successfully regressed from cortical activity, paving the way to increasingly naturalistic, fine-tuned correction mechanisms for future BCI applications.

Asunto(s)

RESUMEN

BACKGROUND: Emotion is an important area in neuroscience. Cross-subject emotion recognition based on electroencephalogram (EEG) data is challenging due to physiological differences between subjects. Domain gap, which refers to the different distributions of EEG data at different subjects, has attracted great attention for cross-subject emotion recognition. COMPARISON WITH EXISTING METHODS: This study focuses on narrowing the domain gap between subjects through the emotional frequency bands and the relationship information between EEG channels. Emotional frequency band features represent the energy distribution of EEG data in different frequency ranges, while relationship information between EEG channels provides spatial distribution information about EEG data. NEW METHOD: To achieve this, this paper proposes a model called the Frequency Band Attention Graph convolutional Adversarial neural Network (FBAGAN). This model includes three components: a feature extractor, a classifier, and a discriminator. The feature extractor consists of a layer with a frequency band attention mechanism and a graph convolutional neural network. The mechanism effectively extracts frequency band information by assigning weights and Graph Convolutional Networks can extract relationship information between EEG channels by modeling the graph structure. The discriminator then helps minimize the gap in the frequency information and relationship information between the source and target domains, improving the model's ability to generalize. RESULTS: The FBAGAN model is extensively tested on the SEED, SEED-IV, and DEAP datasets. The accuracy and standard deviation scores are 88.17% and 4.88, respectively, on the SEED dataset, and 77.35% and 3.72 on the SEED-IV dataset. On the DEAP dataset, the model achieves 69.64% for Arousal and 65.18% for Valence. These results outperform most existing models. CONCLUSIONS: The experiments indicate that FBAGAN effectively addresses the challenges of transferring EEG channel domain and frequency band domain, leading to improved performance.

Asunto(s)

RESUMEN

Stroke has been the second leading cause of death and disability worldwide. With the innovation of therapeutic schedules, its death rate has decreased significantly but still guides chronic movement disorders. Due to the lack of independent activities and minimum exercise standards, the traditional rehabilitation means of occupational therapy and constraint-induced movement therapy pose challenges in stroke patients with severe impairments. Therefore, specific and effective rehabilitation methods seek innovation. To address the overlooked limitation, we design a pneumatic rehabilitation glove system. Specially, we developed a pneumatic glove, which utilizes ElectroEncephaloGram (EEG) acquisition to gain the EEG signals. A proposed EEGTran model is inserted into the system to distinguish the specific motor imagination behavior, thus, the glove can perform specific activities according to the patient's imagination, facilitating the patients with severe movement disorders and promoting the rehabilitation technology. The experimental results show that the proposed EEGTrans reached an accuracy of 87.3% and outperformed that of competitors. It demonstrates that our pneumatic rehabilitation glove system contributes to the rehabilitation training of stroke patients.

Asunto(s)

RESUMEN

With the development of brain-computer interface (BCI) technology and its translational application in clinical medicine, BCI medicine has emerged, ushering in profound changes to the practice of medicine, while also bringing forth a series of ethical issues related to BCI medicine. BCI medicine is progressively emerging as a new disciplinary focus, yet to date, there has been limited literature discussing it. Therefore, this paper focuses on BCI medicine, firstly providing an overview of the main potential medical applications of BCI technology. It then defines the discipline, outlines its objectives, methodologies, potential efficacy, and associated translational medical research. Additionally, it discusses the ethics associated with BCI medicine, and introduces the standardized operational procedures for BCI medical applications and the methods for evaluating the efficacy of BCI medical applications. Finally, it anticipates the challenges and future directions of BCI medicine. In the future, BCI medicine may become a new academic discipline or major in higher education. In summary, this article is hoped to provide thoughts and references for the development of the discipline of BCI medicine.

Asunto(s)

RESUMEN

The hybrid brain-computer interface (BCI) is verified to reduce disadvantages of conventional BCI systems. Transcranial electrical stimulation (tES) can also improve the performance and applicability of BCI. However, enhancement in BCI performance attained solely from the perspective of users or solely from the angle of BCI system design is limited. In this study, a hybrid BCI system combining MI and SSVEP was proposed. Furthermore, transcranial alternating current stimulation (tACS) was utilized to enhance the performance of the proposed hybrid BCI system. The stimulation interface presented a depiction of grabbing a ball with both of hands, with left-hand and right-hand flickering at frequencies of 34 Hz and 35 Hz. Subjects watched the interface and imagined grabbing a ball with either left hand or right hand to perform SSVEP and MI task. The MI and SSVEP signals were processed separately using filter bank common spatial patterns (FBCSP) and filter bank canonical correlation analysis (FBCCA) algorithms, respectively. A fusion method was proposed to fuse the features extracted from MI and SSVEP. Twenty healthy subjects took part in the online experiment and underwent tACS sequentially. The fusion accuracy post-tACS reached 90.25% ± 11.40%, which was significantly different from pre-tACS. The fusion accuracy also surpassed MI accuracy and SSVEP accuracy respectively. These results indicated the superior performance of the hybrid BCI system and tACS would improve the performance of the hybrid BCI system.

Asunto(s)