Implementation of Artificial Intelligence on Brain-Computer Interface: Review

Authors

  • Lu Liu

DOI:

https://doi.org/10.61173/xw35y605

Keywords:

Artificial intelligence, brain-computer interfaces, language decoding

Abstract

Brain-computer interface technology (BCIs) has established a potential pathway for direct two-way communication between humans and computers. In recent years, with the help of Artificial Intelligence (AI) in advancing the analysis of neural activity and the decoding of brain signals, the combination of AI and BCI applications is becoming a hot direction. The objective of this paper is to offer a comprehensive overview of the implementations of the combination integrating AI and BCIs. In recent years, AI has garnered significant attention across five key application areas, including communication, psychological state estimation, motor imagery (MI), calibration, and interference suppression. Therefore, this paper will review the current state of BCI technology, analyze the hot fields of AI and BCI combined applications, and finally make a forecast for future trends. Despite the current shortcomings, the combination of AI and BCIs remains promising, foretelling a broad future in the decoding and analysis of brain signals.

References

[1] Barnova, K., Mikolasova, M., Kahankova, R. V., Jaros, R., Kawala-Sterniuk, A., Snasel, V., … Martinek, R. (2023). Implementation of artificial intelligence and machine learningbased methods in brain-computer interaction. Computers in Biology and Medicine, 163, 107135.

[2] H. Yaacob, F. Hossain, S. Shari, S. K. Khare, C. P. Ooi and U. R. Acharya, “Application of Artificial Intelligence Techniques for Brain-Computer Interface in Mental Fatigue Detection: A Systematic Review (2011-2022),” in IEEE Access, vol. 11, pp. 74736-74758, 2023.

[3] M.-P. Hosseini, D. Pompili, K. Elisevich, H. Soltanian- Zadeh, Optimized deep learning for eeg big data and seizure prediction bci via internet of things, IEEE Trans. Big Data 3 (4) (2017) 392-404.

[4] W. Karwowski, W. Siemionow, K. Gielo-Perczak, Physical neuroergonomics: The human brain in control of physical work activities, Theor. Issues Ergon. Sci. 4 (1-2) (2003) 175-199.

[5] Baranauskas G. What limits the performance of current invasive brain machine interfaces. Front Syst Neurosci 2014;8:68.

[6] Athanasiou A, Xygonakis I, Pandria N, et al. Towards Rehabilitation Robotics: Off-the-Shelf BCI Control of Anthropomorphic Robotic Arms. Biomed Res Int 2017; 2017:5708937.

[7] Li JH, Yan YZ. Improvement and Simulation of Artificial Intelligence Algorithm in Special Movements. Applied Mechanics & Materials 2014;513-517:2374-8.

[8] Gao, X., Wang, Y., Chen, X., & Gao, S. (2021). Interface, interaction, and intelligence in generalized brain-computer interfaces. Trends in Cognitive Sciences, 25(8), 671-684.

[9] Ramadan, R.A. et al. (2017) Brain-computer interface: control signals review. Neurocomputing 223, 26-44.

[10] Lotte, F. et al. (2018) A review of classification algorithms for EEG-based brain-computer interfaces: a 10 year update. J. Neural Eng. 15, 031005.

[11] Zheng, N. et al. (2017) Hybrid-augmented intelligence: collaboration and cognition. Front. Inf. Technol. Electron. Eng. 18, 153-179.

[12] Rao, R.P. (2019) Towards neural co-processors for the brain: combining decoding and encoding in brain-computer interface. Curr. Opin. Neurobiol. 55, 142-151.

[13] Min, B.K. et al. (2017) Harnessing prefrontal cognitive signals for brain-machine interfaces. Trends Biotechnol. 35, 585- 597.

[14] Gerson, A.D. et al. (2006) Cortically coupled computer vision for rapid image search. IEEE Trans. Neural Syst. Rehabil. Eng. 14, 174-179.

[15] Netzer, E. and Geva, A.B. (2020) Human-in-the-loop active learning via brain computer interface. Ann. Math. Artif. Intell. 88, 1191-1205.

[16] Saproo, S. et al. (2016) Cortically coupled computing: a new paradigm for synergistic human-machine interaction. Computer 49, 60-68.

[17] Lees, S. et al. (2018) A review of rapid serial visual presentation-based brain-computer interface. J. Neural Eng. 15, 021001.

[18] Zhao, Y., Chen, Y., Cheng, K., & Huang, W. (2023). Artificial intelligence based multimodal language decoding from brain activity: A review. Brain Research Bulletin, 201, 110713.

[19] Buchweitz, A., Shinkareva, S.V., Mason, R.A., Mitchell, T.M., Just, M.A., 2012. Identifying bilingual semantic neural representations across languages. Brain Lang. 120 (3), 282-289.

[20] Sheikh, U.A., Carreiras, M., Soto, D., 2019. Decoding the meaning of unconsciously processed words using fMRI-based MVPA. Neuroimage 191, 430-440.

[21] Yang, Y., Wang, J., Bailer, C., Cherkassky, V., Just, M.A., 2017. Commonalities and differences in the neural representations of English, Portuguese, and Mandarin sentences: when knowledge of the brain language mappings for two languages is better than one. Brain Lang. 175, 77-85.

[22] Pereira, F., Lou, B., Pritchett, B., Ritter, S., Gershman, S.J., Kanwisher, N., Botvinick, M., Fedorenko, E., 2018. Toward a universal decoder of linguistic meaning from brain activation. Nat. Commun. 9, 13.

[23] Correia, J.M., Jansma, B., Hausfeld, L., Kikkert, S., Bonte, M., 2015. EEG decoding of spoken words in bilingual listeners: from words to language invariant semanticconceptual representations. Front. Psychol. 6, 10.

[24] Dash, D., Ferrari, P., Wang, J., 2020. Decoding imagined and spoken phrases from noninvasive neural (MEG) signals. Front. Neurosci. 14, 15.

[25] Makin, J.G., Moses, D.A., Chang, E.F., 2020. Machine Dean&Francis Lu Liu translation of cortical activity to text with an encoder-decoder framework. Nat. Neurosci. 23 (4), 575-582.

[26] Ramsey, N.F., Salari, E., Aarnoutse, E.J., Vansteensel, M.J., Bleichner, M.G., Freudenburg, Z.V., 2018. Decoding spoken phonemes from sensorimotor cortex with high-density ECoG grids. Neuroimage 180, 301-311.

[27] Matsuo, E., Kobayashi, I., Nishimoto, S., Nishida, S., Asoh, H., Ieee, 2018. Describing Semantic Representations of Brain Activity Evoked by Visual Stimuli, IEEE International Conference on Systems, Man, and Cybernetics (SMC). Ieee, IEEE Syst Man & Cybernet Soc, Miyazaki, JAPAN, pp. 576- 583.

[28] Takada, S., Togo, R., Ogawa, T., Haseyama, M., Ieee, 2020. Generation of Viewed Image Captions from Human Brain Activity via Unsupervised Text Latent Space, IEEE International Conference on Image Processing (ICIP). Ieee, Electr Network, pp. 2521-2525.

[29] Huang, W., Yan, H., Cheng, K., Wang, Y., Wang, C., Li, J., Li, C., Li, C., Zuo, Z., Chen, H., 2021b. A dual-channel language decoding from brain activity with progressive transfer training. Hum. Brain Mapp. 42 (15), 5089-5100.

[30] Branco, M.P., Freudenburg, Z.V., Aarnoutse, E.J., Bleichner, M.G., Vansteensel, M.J., Ramsey, N.F., 2017. Decoding hand gestures from primary somatosensory cortex using high-density ECoG. Neuroimage 147, 130-142.

[31] Hu, X.T., Guo, L., Han, J.W., Liu, T.M., 2015. Decoding semantics categorization during natural viewing of video streams. IEEE Trans. Auton. Ment. Dev. 7 (3), 201-210.

[32] Huth, A.G., De Heer, W.A., Griffiths, T.L., Theunissen, F.E., Gallant, J.L., 2016. Natural speech reveals the semantic maps that tile human cerebral cortex. Nature 532 (7600), 453-458.

[33] Nishida, S., Nishimoto, S., 2018. Decoding naturalistic experiences from human brain activity via distributed representations of words. Neuroimage 180, 232-242.

[34] W. Gao, T. Yu, J.-G. Yu, Z. Gu, K. Li, Y. Huang, Z.L. Yu, Y. Li, Learning invariant patterns based on a convolutional neural network and big electroencephalography data for subjectindependent p300 brain-computer interfaces, IEEE Trans. Neural Syst. Rehabil. Eng. 29 (2021) 1047-1057.

[35] Barnova, K., Mikolasova, M., Kahankova, R. V., Jaros, R., Kawala-Sterniuk, A., Snasel, V., … Martinek, R. (2023). Implementation of artificial intelligence and machine learningbased methods in brain-computer interaction. Computers in Biology and Medicine, 163, 107135.

[36] T. Radüntz, J. Scouten, O. Hochmuth, B. Meffert, Automated eeg artifact elimination by applying machine learning algorithms to ica-based features, J. Neural Eng. 14 (4) (2017).

[37] A. Rezeika, M. Benda, P. Stawicki, F. Gembler, A. Saboor, I. Volosyak, Brain-computer interface spellers, Brain Sci. 8 (4) (2018) 1-38.

[38] M. Pahwa, M. Kusner, C.D. Hacker, D.T. Bundy, K.Q. Weinberger, E.C. Leuthardt, N.N. Pouratian, Optimizing the detection of wakeful and sleep-like states for future electrocorticographic brain computer interface applications, PLOS ONE 10 (11) (2015) 1-16.

[39] A.J. Casson, Artificial neural network classification of operator workload with an assessment of time variation and noise-enhancement to increase performance, Front. Neurosci. 8 (2014) 1-10.

[40] C. Yaacoub, G. Mhanna, S. Rihana, A genetic-based feature selection approach in the identification of left/right hand motor imagery for a braincomputer interface, Brain Sci. 7 (12) (2017) 1–15.

[41] L. Minati, A. Nigri, C. Rosazza, M.G. Bruzzone, Thoughts turned into highlevel commands, Med. Eng. Phys. 34 (5) (2012) 650-658.

[42] C. Xiang, L. Zhang, Y. Tang, W. Zou, C. Xu, Ms-capsnet, IEEE Signal Process. Lett. 25 (12) (2018) 1850-1854.

[43] A. Jafarifarmand, M.A. Badamchizadeh, S. Khanmohammadi, M.A. Nazari, B.M. Tazehkand, A new selfregulated neuro-fuzzy framework for classification of eeg signals in motor imagery bci, IEEE Trans. Fuzzy Syst. 26 (3) (2018) 1485–1497.

Downloads

Published

2024-12-31