SOM-based information maximization to improve and interpret multi-layered neural networks: From information reduction to information augmentation approach to create new information

作者:

Highlights:

• Necessity of information augmentation in neural networks.

• New interpretation of information-theoretic methods in neural networks.

• New interpretation of SOM in creating new knowledge.

• New learning methods for training multi-layered neural networks and for coping with the vanishing information problem.

• Demonstration of improved generalization with excessive information.

摘要

•Necessity of information augmentation in neural networks.•New interpretation of information-theoretic methods in neural networks.•New interpretation of SOM in creating new knowledge.•New learning methods for training multi-layered neural networks and for coping with the vanishing information problem.•Demonstration of improved generalization with excessive information.

论文关键词:Information maximization,Vanishing information,Pre-training,SOM,Generalization,Interpretation

论文评审过程:Received 3 April 2018, Revised 26 November 2018, Accepted 24 January 2019, Available online 1 February 2019, Version of Record 15 February 2019.

论文官网地址:https://doi.org/10.1016/j.eswa.2019.01.056