Deep representation-based transfer learning for deep neural networks
作者:
Highlights:
• A deep representation-based transfer learning method is proposed for knowledge transfer between deep neural networks.
• The method transfers domain-invariant representation by learning the similarity structure between source representations.
• The method reduces the influence of unfavorable source representations through boosting-based representation transfer.
• The computational process of the method is vectorized with comparable training efficiency to traditional fine-tuning.
• The image classification and time series prediction experiments demonstrate the universal transfer capability of the method.
摘要
•A deep representation-based transfer learning method is proposed for knowledge transfer between deep neural networks.•The method transfers domain-invariant representation by learning the similarity structure between source representations.•The method reduces the influence of unfavorable source representations through boosting-based representation transfer.•The computational process of the method is vectorized with comparable training efficiency to traditional fine-tuning.•The image classification and time series prediction experiments demonstrate the universal transfer capability of the method.
论文关键词:Transfer learning,Deep learning,Deep neural networks,Representation learning,Representational similarity analysis
论文评审过程:Received 4 May 2022, Revised 18 July 2022, Accepted 22 July 2022, Available online 27 July 2022, Version of Record 18 August 2022.
论文官网地址:https://doi.org/10.1016/j.knosys.2022.109526