Neurofeedback (NF) technology based on electroencephalogram (EEG) data or functional magnetic resonance imaging (fMRI) has been widely studied and applied. In contrast, functional near infrared spectroscopy (fNIRS) has become a new technique in NF research in recent years. fNIRS is a neuroimaging technology based on hemodynamics, which has the advantages of low cost, good portability and high spatial resolution, and is more suitable for use in natural environments. At present, there is a lack of comprehensive review on fNIRS-NF technology (fNIRS-NF) in China. In order to provide a reference for the research of fNIRS-NF technology, this paper first describes the principle, key technologies and applications of fNIRS-NF, and focuses on the application of fNIRS-NF. Finally, the future development trend of fNIRS-NF is prospected and summarized. In conclusion, this paper summarizes fNIRS-NF technology and its application, and concludes that fNIRS-NF technology has potential practicability in neurological diseases and related fields. fNIRS can be used as a good method for NF training. This paper is expected to provide reference information for the development of fNIRS-NF technology.
Brain-computer interface (BCI) has high application value in the field of healthcare. However, in practical clinical applications, convenience and system performance should be considered in the use of BCI. Wearable BCIs are generally with high convenience, but their performance in real-life scenario needs to be evaluated. This study proposed a wearable steady-state visual evoked potential (SSVEP)-based BCI system equipped with a small-sized electroencephalogram (EEG) collector and a high-performance training-free decoding algorithm. Ten healthy subjects participated in the test of BCI system under simplified experimental preparation. The results showed that the average classification accuracy of this BCI was 94.10% for 40 targets, and there was no significant difference compared to the dataset collected under the laboratory condition. The system achieved a maximum information transfer rate (ITR) of 115.25 bit/min with 8-channel signal and 98.49 bit/min with 4-channel signal, indicating that the 4-channel solution can be used as an option for the few-channel BCI. Overall, this wearable SSVEP-BCI can achieve good performance in real-life scenario, which helps to promote BCI technology in clinical practice.
Brain-computer interfaces (BCIs) have become one of the cutting-edge technologies in the world, and have been mainly applicated in medicine. In this article, we sorted out the development history and important scenarios of BCIs in medical application, analyzed the research progress, technology development, clinical transformation and product market through qualitative and quantitative analysis, and looked forward to the future trends. The results showed that the research hotspots included the processing and interpretation of electroencephalogram (EEG) signals, the development and application of machine learning algorithms, and the detection and treatment of neurological diseases. The technological key points included hardware development such as new electrodes, software development such as algorithms for EEG signal processing, and various medical applications such as rehabilitation and training in stroke patients. Currently, several invasive and non-invasive BCIs are in research. The R&D level of BCIs in China and the United State is leading the world, and have approved a number of non-invasive BCIs. In the future, BCIs will be applied to a wider range of medical fields. Related products will develop shift from a single mode to a combined mode. EEG signal acquisition devices will be miniaturized and wireless. The information flow and interaction between brain and machine will give birth to brain-machine fusion intelligence. Last but not least, the safety and ethical issues of BCIs will be taken seriously, and the relevant regulations and standards will be further improved.
Due to the high complexity and subject variability of motor imagery electroencephalogram, its decoding is limited by the inadequate accuracy of traditional recognition models. To resolve this problem, a recognition model for motor imagery electroencephalogram based on flicker noise spectrum (FNS) and weighted filter bank common spatial pattern (wFBCSP) was proposed. First, the FNS method was used to analyze the motor imagery electroencephalogram. Using the second derivative moment as structure function, the ensued precursor time series were generated by using a sliding window strategy, so that hidden dynamic information of transition phase could be captured. Then, based on the characteristic of signal frequency band, the feature of the transition phase precursor time series and reaction phase series were extracted by wFBCSP, generating features representing relevant transition and reaction phase. To make the selected features adapt to subject variability and realize better generalization, algorithm of minimum redundancy maximum relevance was further used to select features. Finally, support vector machine as the classifier was used for the classification. In the motor imagery electroencephalogram recognition, the method proposed in this study yielded an average accuracy of 86.34%, which is higher than the comparison methods. Thus, our proposed method provides a new idea for decoding motor imagery electroencephalogram.
Control at beyond-visual ranges is of great significance to animal-robots with wide range motion capability. For pigeon-robots, such control can be done by the way of onboard preprogram, but not constitute a closed-loop yet. This study designed a new control system for pigeon-robots, which integrated the function of trajectory monitoring to that of brain stimulation. It achieved the closed-loop control in turning or circling by estimating pigeons’ flight state instantaneously and the corresponding logical regulation. The stimulation targets located at the formation reticularis medialis mesencephali (FRM) in the left and right brain, for the purposes of left- and right-turn control, respectively. The stimulus was characterized by the waveform mimicking the nerve cell membrane potential, and was activated intermittently. The wearable control unit weighted 11.8 g totally. The results showed a 90% success rate by the closed-loop control in pigeon-robots. It was convenient to obtain the wing shape during flight maneuver, by equipping a pigeon-robot with a vivo camera. It was also feasible to regulate the evolution of pigeon flocks by the pigeon-robots at different hierarchical level. All of these lay the groundwork for the application of pigeon-robots in scientific researches.
Artificial intelligence-enhanced brain-computer interfaces (BCI) are expected to significantly improve the performance of traditional BCIs in multiple aspects, including usability, user experience, and user satisfaction, particularly in terms of intelligence. However, such AI-integrated or AI-based BCI systems may introduce new ethical issues. This paper first evaluated the potential of AI technology, especially deep learning, in enhancing the performance of BCI systems, including improving decoding accuracy, information transfer rate, real-time performance, and adaptability. Building on this, it was considered that AI-enhanced BCI systems might introduce new or more severe ethical issues compared to traditional BCI systems. These include the possibility of making users’ intentions and behaviors more predictable and manipulable, as well as the increased likelihood of technological abuse. The discussion also addressed measures to mitigate the ethical risks associated with these issues. It is hoped that this paper will promote a deeper understanding and reflection on the ethical risks and corresponding regulations of AI-enhanced BCIs.
Patients with amyotrophic lateral sclerosis ( ALS ) often have difficulty in expressing their intentions through language and behavior, which prevents them from communicating properly with the outside world and seriously affects their quality of life. The brain-computer interface (BCI) has received much attention as an aid for ALS patients to communicate with the outside world, but the heavy device causes inconvenience to patients in the application process. To improve the portability of the BCI system, this paper proposed a wearable P300-speller brain-computer interface system based on the augmented reality (MR-BCI). This system used Hololens2 augmented reality device to present the paradigm, an OpenBCI device to capture EEG signals, and Jetson Nano embedded computer to process the data. Meanwhile, to optimize the system’s performance for character recognition, this paper proposed a convolutional neural network classification method with low computational complexity applied to the embedded system for real-time classification. The results showed that compared with the P300-speller brain-computer interface system based on the computer screen (CS-BCI), MR-BCI induced an increase in the amplitude of the P300 component, an increase in accuracy of 1.7% and 1.4% in offline and online experiments, respectively, and an increase in the information transfer rate of 0.7 bit/min. The MR-BCI proposed in this paper achieves a wearable BCI system based on guaranteed system performance. It has a positive effect on the realization of the clinical application of BCI.
Speech imagery is an emerging brain-computer interface (BCI) paradigm with potential to provide effective communication for individuals with speech impairments. This study designed a Chinese speech imagery paradigm using three clinically relevant words—“Help me”, “Sit up” and “Turn over”—and collected electroencephalography (EEG) data from 15 healthy subjects. Based on the data, a Channel Attention Multi-Scale Convolutional Neural Network (CAM-Net) decoding algorithm was proposed, which combined multi-scale temporal convolutions with asymmetric spatial convolutions to extract multidimensional EEG features, and incorporated a channel attention mechanism along with a bidirectional long short-term memory network to perform channel weighting and capture temporal dependencies. Experimental results showed that CAM-Net achieved a classification accuracy of 48.54% in the three-class task, outperforming baseline models such as EEGNet and Deep ConvNet, and reached a highest accuracy of 64.17% in the binary classification between “Sit up” and “Turn over”. This work provides a promising approach for future Chinese speech imagery BCI research and applications.
With the development of brain-computer interface (BCI) technology and its translational application in clinical medicine, BCI medicine has emerged, ushering in profound changes to the practice of medicine, while also bringing forth a series of ethical issues related to BCI medicine. BCI medicine is progressively emerging as a new disciplinary focus, yet to date, there has been limited literature discussing it. Therefore, this paper focuses on BCI medicine, firstly providing an overview of the main potential medical applications of BCI technology. It then defines the discipline, outlines its objectives, methodologies, potential efficacy, and associated translational medical research. Additionally, it discusses the ethics associated with BCI medicine, and introduces the standardized operational procedures for BCI medical applications and the methods for evaluating the efficacy of BCI medical applications. Finally, it anticipates the challenges and future directions of BCI medicine. In the future, BCI medicine may become a new academic discipline or major in higher education. In summary, this article is hoped to provide thoughts and references for the development of the discipline of BCI medicine.
This paper realized a portable brain-computer interface (BCI) system tailored for smart healthcare. Through the decoding of steady-state visual evoked potential (SSVEP), this system can rapidly and accurately identify the intentions of subjects, thereby meeting the practical demands of daily medical scenarios. Firstly, an SSVEP stimulation interface and an electroencephalogram (EEG) signal acquisition software were designed, which enable the system to execute multi-target and multi-task operations while also incorporating data visualization functionality. Secondly, the EEG signals recorded from the occipital region were decomposed into eight sub-frequency bands using filter bank canonical correlation analysis (FBCCA). Subsequently, the similarity between each sub-band signal and the reference signals was computed to achieve efficient SSVEP decoding. Finally, 15 subjects were recruited to participate in the online evaluation of the system. The experimental results indicated that in real-world scenarios, the system achieved an average accuracy of 85.19% in identifying the intentions of the subjects, and an information transfer rate (ITR) of 37.52 bit/min. This system was awarded third prize in the Visual BCI Innovation Application Development competition at the 2024 World Robot Contest, validating its effectiveness. In conclusion, this study has developed a portable, multifunctional SSVEP online decoding system, providing an effective approach for human-computer interaction in smart healthcare.