Incremental learning model inspired in Rehearsal for deep convolutional networks

作者:

Highlights:

• An incremental learning model inspired in Rehearsal (recall of past memories based on a subset of data) is proposed.

• Experiments were performed over MNIST, Fashion-MNIST, CIFAR-10 and Caltech 101 in two different scenarios.

• Several metrics were used to compare learning quality results when each new megabatch of data is used.

• Friedman’s non-parametric statistical test and Holm post-hoc test were used for supporting the analysis of the results.

• Random-based selection of representative samples obtains the best results.

摘要

•An incremental learning model inspired in Rehearsal (recall of past memories based on a subset of data) is proposed.•Experiments were performed over MNIST, Fashion-MNIST, CIFAR-10 and Caltech 101 in two different scenarios.•Several metrics were used to compare learning quality results when each new megabatch of data is used.•Friedman’s non-parametric statistical test and Holm post-hoc test were used for supporting the analysis of the results.•Random-based selection of representative samples obtains the best results.

论文关键词:Artificial Neural Network,Deep Learning,Deep convolutional networks,Rehearsal,Incremental learning

论文评审过程:Received 27 April 2020, Revised 29 July 2020, Accepted 2 September 2020, Available online 16 September 2020, Version of Record 28 September 2020.

论文官网地址:https://doi.org/10.1016/j.knosys.2020.106460