节点文献
基于特征融合的神经影像数据分类模型
Neural image data classification model based on feature fusion
【摘要】 为了解决三维卷积神经网络(3D CNN)在神经影像数据分类预测中难以捕捉数据全局特征的问题,引入有效建模全局关系的多层感知混合器(MLP-Mixer),提出了一种基于特征融合的混合模型,通过结合3D CNN和MLP-Mixer的优势,提高对神经影像数据的分类性能。首先,在特征提取阶段,将3D CNN用于从静息态功能性磁共振成像(rs-fMRI)数据中提取局部空间特征,将MLP-Mixer用于捕捉全局关系特征;其次,在融合分类模块,采用缩放点积自注意力技术结合空间特征和全局关系特征,动态地权衡和整合不同特征的重要性,增强模型的表达能力,并通过全连接层完成分类任务。实验结果显示,该混合模型在处理神经影像数据的二分类和多分类任务时,分类准确率分别提高了4.12%和5.16%,在召回率、F1分数等指标上也显著优于其他网络模型,表明本文混合模型能有效提升分类准确性,为神经影像数据的自动化分类提供了一种新的技术途径,具有广泛的工程应用潜力。
【Abstract】 In order to solve the problem of difficulty in capturing global features of three-dimensional convolutional neural network(3D CNN) in the classification and prediction of neuroimaging data, a multilayer perceptron mixer(MLP-Mixer) that effectively models global relationships was introduced, and a feature fusion based hybrid model was proposed aimed at improving the classification performance of neuroimaging data by combining the advantages of 3D CNN and MLP-Mixer. Firstly, in the feature extraction stage, 3D CNN was used to extract local spatial features from resting-state functional magnetic resonance imaging(rs-fMRI) data, while MLP-Mixer was used to capture global relational features. Secondly, in the fusion classification module, the scaled dot-product self-attention technique was used to combine spatial features with global relationship features, dynamically balancing and integrating the importance of different features, enhancing the expressive power of the model, and completing the classification task through a fully connected layer. The experimental results show that the hybrid model has achieved a maximum improvement of 4.12% and 5.16% in classification accuracy for binary and multiclass classification tasks of neural imaging data, respectively. It is also significantly better than other network models in terms of recall rate, F1 score, and other indicators. This indicates that the hybrid model proposed can effectively improve classification accuracy and provide a new technological approach for automated classification of neuroimaging data, with broad potential for engineering applications.
【Key words】 computer technology; 3D convolutional neural network; multi-layer perceptron mixer; functional magnetic resonance imaging; feature fusion;
- 【文献出处】 吉林大学学报(工学版) ,Journal of Jilin University(Engineering and Technology Edition) , 编辑部邮箱 ,2026年05期
- 【分类号】TP391.41;TP18
- 【下载频次】2