Deep representation-based transfer learning for deep neural networks

作者:

Highlights:

• A deep representation-based transfer learning method is proposed for knowledge transfer between deep neural networks.

• The method transfers domain-invariant representation by learning the similarity structure between source representations.

• The method reduces the influence of unfavorable source representations through boosting-based representation transfer.

• The computational process of the method is vectorized with comparable training efficiency to traditional fine-tuning.

• The image classification and time series prediction experiments demonstrate the universal transfer capability of the method.

摘要

•A deep representation-based transfer learning method is proposed for knowledge transfer between deep neural networks.•The method transfers domain-invariant representation by learning the similarity structure between source representations.•The method reduces the influence of unfavorable source representations through boosting-based representation transfer.•The computational process of the method is vectorized with comparable training efficiency to traditional fine-tuning.•The image classification and time series prediction experiments demonstrate the universal transfer capability of the method.

论文关键词:Transfer learning,Deep learning,Deep neural networks,Representation learning,Representational similarity analysis

论文评审过程:Received 4 May 2022, Revised 18 July 2022, Accepted 22 July 2022, Available online 27 July 2022, Version of Record 18 August 2022.

论文官网地址:https://doi.org/10.1016/j.knosys.2022.109526