Deep ranking based cost-sensitive multi-label learning for distant supervision relation extraction

作者:

Highlights:

• In distant supervision relation extraction, the relation classes can have latent connections (class ties). In this paper, to exploit class ties between relations, we propose a general ranking based multi-label learning framework combined with convolutional neural networks. Ranking based loss functions with regularization technique are introduced to learn the latent connections between relations. Furthermore, to relieve the class-imbalance problem in distant supervision relation extraction, we further adopt cost-sensitive learning to rescale the costs from the positive and negative labels. Extensive experiments on a widely used dataset show the effectiveness of our model to exploit class ties and to relieve class imbalance problem. Our model achieves state-of-the-art performance.

摘要

•In distant supervision relation extraction, the relation classes can have latent connections (class ties). In this paper, to exploit class ties between relations, we propose a general ranking based multi-label learning framework combined with convolutional neural networks. Ranking based loss functions with regularization technique are introduced to learn the latent connections between relations. Furthermore, to relieve the class-imbalance problem in distant supervision relation extraction, we further adopt cost-sensitive learning to rescale the costs from the positive and negative labels. Extensive experiments on a widely used dataset show the effectiveness of our model to exploit class ties and to relieve class imbalance problem. Our model achieves state-of-the-art performance.

论文关键词:Distant supervision,Relation extraction,Class ties,Class imbalance,Multi-label learning,Cost-sensitive learning,Deep ranking

论文评审过程:Received 9 December 2018, Revised 25 July 2019, Accepted 3 August 2019, Available online 26 August 2019, Version of Record 20 October 2020.

论文官网地址:https://doi.org/10.1016/j.ipm.2019.102096