A framework for parameter estimation and model selection in kernel deep stacking networks

作者:

Highlights:

• Kernel deep stacking networks (KDSNs) are a novel method in biomedical research.

• KDSNs belong to the class of supervised deep learning.

• They are computationally faster to train than artificial neural networks.

• KDSNs require the specification of a large number of tuning parameters.

• We propose a new data-driven framework for model selection in KDSNs.

• The proposed methodology includes model-based optimization and hill climbing.

• No pre-specification of any of the KDSN tuning parameters is required.

• Application of the proposed methodology results in a fast tuning procedure.

• KDSNs are competitive with other techniques in the field of deep learning.

摘要

Highlights•Kernel deep stacking networks (KDSNs) are a novel method in biomedical research.•KDSNs belong to the class of supervised deep learning.•They are computationally faster to train than artificial neural networks.•KDSNs require the specification of a large number of tuning parameters.•We propose a new data-driven framework for model selection in KDSNs.•The proposed methodology includes model-based optimization and hill climbing.•No pre-specification of any of the KDSN tuning parameters is required.•Application of the proposed methodology results in a fast tuning procedure.•KDSNs are competitive with other techniques in the field of deep learning.

论文关键词:Deep learning,Artificial neural networks,Kernel regression,Model-based optimization

论文评审过程:Received 9 November 2015, Revised 9 March 2016, Accepted 21 April 2016, Available online 30 May 2016, Version of Record 6 June 2016.

论文官网地址:https://doi.org/10.1016/j.artmed.2016.04.002