Weakly supervised moment localization with natural language based on semantic reconstruction

作者：

Highlights：

• A new framework is proposed for weakly supervised cross-modal moment localization.

• A multi-task loss is designed for the weakly supervised optimizing of the network.

• The proposal generation module could exploit moment-wise temporal relationships.

• Extensive experimental results demonstrate the effectiveness of our method.

摘要

•A new framework is proposed for weakly supervised cross-modal moment localization.•A multi-task loss is designed for the weakly supervised optimizing of the network.•The proposal generation module could exploit moment-wise temporal relationships.•Extensive experimental results demonstrate the effectiveness of our method.

论文关键词：Cross-modal moment localization,Weakly supervised temporal grounding,Semantic reconstruction

论文评审过程：Received 3 April 2022, Revised 19 July 2022, Accepted 1 August 2022, Available online 6 August 2022, Version of Record 13 August 2022.

论文官网地址：https://doi.org/10.1016/j.imavis.2022.104532