%0 Journal Article %A LI Lei %A SHEN Mu %A WANG Peng %A ZHANG Lin %A LI Xingyuan %T Construction of Multi-Modal Knowledge Graph for Epilepsy Related Papers %D 2022 %R 10.13190/j.jbupt.2021-187 %J Journal of Beijing University of Posts and Telecommunications %P 19-24 %V 45 %N 4 %X The performance of the existing named entity recognition and relation extraction models would sharply decline due to the lack of a large amount of annotated data for epilepsy-related papers. To solve this issue, a zero-resource named entity recognition and relation extraction model in the epilepsy domain is proposed based on medical data and a pre-training model from similar domains. The performance of the existing unsupervised and semi-supervised models on the epilepsy paper data set isevaluated, and then a domain adversarial network and a relation discriminator are introduced based on the characteristics of the data set to effectively improve the construction effect of the epilepsy domain knowledge graph. Electroencephalography (EEG) features of epilepsy patients are embedded into the knowledge graph in a visual modality. While improving the interpretability of EEG analysis, it builds a more intuitive multi-modal knowledge graph. %U https://journal.bupt.edu.cn/EN/10.13190/j.jbupt.2021-187