Brain-inspired multimodal learning based on
neural networks
Chang Liu;Fuchun Sun;Bo Zhang;
【期刊名称】《临床转化神经医学(英文版)》 【年(卷),期】2018(000)001
【摘要】Modern computational models have leveraged biological advances in human brain research. This study addresses the problem of multimodal learning with the help of brain-inspired models. Specifically, a unified multimodal learning architecture is proposed based on deep neural networks, which are inspired by the biology of the visual cortex of the human brain. This unified framework is validated by two practical multimodal learning tasks: image captioning, involving visual and natural language signals, and visual-haptic fusion, involving haptic and visual signals. Extensive experiments are conducted under the framework, and competitive results are achieved. 【总页数】12页(P.61-72) 【关键词】
【作者】Chang Liu;Fuchun Sun;Bo Zhang;
【作者单位】Department of Computer Science and Technology, Tsinghua University;Department of Computer Science and Technology, Tsinghua University;Department of Computer Science and Technology, Tsinghua University;
【正文语种】英文 【中图分类】R338 【相关文献】
1.EEG classification based on probabilistic neural network with supervised learning in brain computer interface [J], 吴婷; Yan Guozheng; Yang Banghua; Sun Hong[1
2.ADAPTIVE LEARNING CONTROL OF CUTTING PARAMETERS FOR SCULPTURED SURFACE CUTTING BASED ON GENETIC ALGORITHMS AND NEURAL NETWORK [J],
3.Near Optimal Output Feedback Control of Nonlinear Discrete-time Systems Based on Reinforcement Neural Network Learning [J], Qiming Zhao; Hao Xu; Sarangapani Jagannathan
4.Neural network identification for underwater vehicle motion control system based on hybrid learning algorithm [J], Sun Yushan; Wang Jianguo; Wan Lei; Hu Yunyan; Jiang Chunmeng
5.A special hierarchical fuzzy neural-networks based reinforcement learning for multi-variables system [J], ZHANG Wen-zhi; LU Tian-sheng
以上内容为文献基本信息，获取文献全文请下载
Brain-inspired multimodal learning based on neural networks
