A Cognitive Neural Architecture Able to Learn and Communicate through Natural Language
Open Access
- 11 November 2015
- journal article
- research article
- Published by Public Library of Science (PLoS) in PLOS ONE
- Vol. 10 (11), e0140866
- https://doi.org/10.1371/journal.pone.0140866
Abstract
Communicative interactions involve a kind of procedural knowledge that is used by the human brain for processing verbal and nonverbal inputs and for language production. Although considerable work has been done on modeling human language abilities, it has been difficult to bring them together to a comprehensive tabula rasa system compatible with current knowledge of how verbal information is processed in the brain. This work presents a cognitive system, entirely based on a large-scale neural architecture, which was developed to shed light on the procedural knowledge involved in language elaboration. The main component of this system is the central executive, which is a supervising system that coordinates the other components of the working memory. In our model, the central executive is a neural network that takes as input the neural activation states of the short-term memory and yields as output mental actions, which control the flow of information among the working memory components through neural gating mechanisms. The proposed system is capable of learning to communicate through natural language starting from tabula rasa, without any a priori knowledge of the structure of phrases, meaning of words, role of the different classes of words, only by interacting with a human through a text-based interface, using an open-ended incremental learning process. It is able to learn nouns, verbs, adjectives, pronouns and other word classes, and to use them in expressive language. The model was validated on a corpus of 1587 input sentences, based on literature on early language assessment, at the level of about 4-years old child, and produced 521 output sentences, expressing a broad range of language processing functionalities.Other Versions
This publication has 40 references indexed in Scilit:
- Real-Time Parallel Processing of Grammatical Structure in the Fronto-Striatal System: A Recurrent Network Simulation Study Using Reservoir ComputingPLOS ONE, 2013
- Recurrent temporal networks and language acquisition—from corticostriatal neurophysiology to reservoir computingFrontiers in Psychology, 2013
- Mechanisms Gating the Flow of Information in the Cortex: What They Might Look Like and What Their Uses may beFrontiers in Computational Neuroscience, 2011
- Large-scale model of mammalian thalamocortical systemsProceedings of the National Academy of Sciences of the United States of America, 2008
- Connecting language to the worldArtificial Intelligence, 2005
- Working memory and focal attention.Journal of Experimental Psychology: Learning, Memory, and Cognition, 2001
- Subsymbolic Natural Language Processing: An Integrated Model of Scripts, Lexicon, and MemoryLanguage, 1997
- Script-based inference and memory retrieval in subsymbolic story processingApplied Intelligence, 1995
- Intonation Patterns in Child-Directed Speech: Mother-Father DifferencesChild Development, 1984
- The Language of ThoughtNoûs, 1980