Goal driven network pruning for object recognition
作者:
Highlights:
• Proposed algorithm uncovers a smaller network competent in a sub-task in the dataset.
• It is inspired by the top-down attention part, removes non-contributory neurons.
• Eliminates re-training from scratch when a sub-task is assigned to the network.
• Hence, useful for the future’s unified networks trained on very multi-class datasets.
• Capable of reducing storage significantly and accelerating forward pass.
摘要
•Proposed algorithm uncovers a smaller network competent in a sub-task in the dataset.•It is inspired by the top-down attention part, removes non-contributory neurons.•Eliminates re-training from scratch when a sub-task is assigned to the network.•Hence, useful for the future’s unified networks trained on very multi-class datasets.•Capable of reducing storage significantly and accelerating forward pass.
论文关键词:Deep learning,Computer vision,Network pruning,Network compressing,Top-down attention,Perceptual visioning
论文评审过程:Received 14 July 2019, Revised 12 February 2020, Accepted 21 May 2020, Available online 27 May 2020, Version of Record 1 November 2020.
论文官网地址:https://doi.org/10.1016/j.patcog.2020.107468