Evaluation of text summaries without human references based on the linear optimization of content metrics using a genetic algorithm
作者:
Highlights:
• The proposed evaluation provides a better correlation than state-of-the-art methods.
• 31 state-of-the-art metrics are combined to generate an optimized evaluation metric.
• The proposed evaluation method enables a balanced correlation improvement.
• The relevance of evaluation metrics presents a direct relation of individual correlation.
• State-of-the-art metrics with higher correlations improve the resultant final rank.
摘要
•The proposed evaluation provides a better correlation than state-of-the-art methods.•31 state-of-the-art metrics are combined to generate an optimized evaluation metric.•The proposed evaluation method enables a balanced correlation improvement.•The relevance of evaluation metrics presents a direct relation of individual correlation.•State-of-the-art metrics with higher correlations improve the resultant final rank.
论文关键词:Evaluation of text summaries,Linear optimization of content metrics,Genetic algorithm,ROUGE-C,Latent semantic analysis,Jensen-Shannon divergence
论文评审过程:Received 24 June 2019, Revised 30 July 2020, Accepted 31 July 2020, Available online 8 August 2020, Version of Record 10 February 2021.
论文官网地址:https://doi.org/10.1016/j.eswa.2020.113827