Measuring the diffusion of innovations from textual data sources besides patent data has not been studied extensively. However, early and accurate indicators of innovation and the recognition of trends in innovation are mandatory to successfully prom...
Philosophical transactions of the Royal Society of London. Series B, Biological sciences
Dec 16, 2019
We argue that natural language can be usefully described as quasi-compositional and we suggest that deep learning-based neural language models bear long-term promise to capture how language conveys meaning. We also note that a successful account of h...
Philosophical transactions of the Royal Society of London. Series B, Biological sciences
Dec 16, 2019
In the last decade, deep artificial neural networks have achieved astounding performance in many natural language-processing tasks. Given the high productivity of language, these models must possess effective generalization abilities. It is widely as...
We review information-theoretic measures of cognitive load during sentence processing that have been used to quantify word prediction effort. Two such measures, surprisal and next-word entropy, suffer from shortcomings when employed for a predictive ...
Speech comprehension requires rapid online processing of a continuous acoustic signal to extract structure and meaning. Previous studies on sentence comprehension have found neural correlates of the predictability of a word given its context, as well...
Annals of the New York Academy of Sciences
Jun 4, 2019
Discovering the true nature of reality may ultimately hinge on grasping the nature and essence of human understanding. What are the fundamental elements or building blocks of human cognition? And how will the rise of superintelligent machines challen...
Syntactic and semantic information processing can interact selectively during language comprehension. However, the nature and extent of the interactions, in particular of semantic effects on syntax, remain to some extent elusive. We revisit an influe...
BACKGROUND: Deep Learning (DL) has advanced the state-of-the-art capabilities in bioinformatics applications which has resulted in trends of increasingly sophisticated and computationally demanding models trained by larger and larger data sets. This ...
Journal of experimental child psychology
Aug 10, 2018
Self-derivation of new factual knowledge through integration of separate episodes of learning is one means by which children build knowledge. Content generated in this manner becomes incorporated into the knowledge base and is retained over time; suc...