A short term memory for Neural Networds which allows recognition and reproduction of complex sequences of integers with the minimum number of weights

摘要

An artificial short term memory, the binary kernel function, is presented to facilitate the learning of complex sequences of integers by Neural Networks, requiring far fewer weights than are usually needed. This is achieved by using only a single weight to encode repeat occurrences of an integer in a sequence. The coding used allows a complex sequence to be learned in only one presentation. The kernel's exponential complexity growth is overcome with hierarchical architectures which chunk the sequences to be learnt. Architectures are introduced for recognition and reproduction of complex sequences.