What is a good evaluation protocol for text localization systems? Concerns, arguments, comparisons and solutions

作者：

Highlights：

• We propose a two-level annotation evaluation protocol for text detection algorithms.

• Algorithms with different granularity outputs are equitably compared.

• All matching strategies between the ground truth and the detections are handled.

• Quantity and quality scores are given to describe a detector's behavior.

• The protocol can manage any irregular text representation.

摘要

•We propose a two-level annotation evaluation protocol for text detection algorithms.•Algorithms with different granularity outputs are equitably compared.•All matching strategies between the ground truth and the detections are handled.•Quantity and quality scores are given to describe a detector's behavior.•The protocol can manage any irregular text representation.

论文关键词：Evaluation protocol,Text detection

论文评审过程：Received 15 July 2015, Revised 9 October 2015, Accepted 3 December 2015, Available online 4 January 2016, Version of Record 29 January 2016.

论文官网地址：https://doi.org/10.1016/j.imavis.2015.12.001