Defining an integrated model of the neural processing of speech in light of its multiscale dynamics

Introduction

This interdisciplinary project will define an integrated model of speech processing by recording, modelling, and manipulating neural oscillatory dynamics during the perception of speech defined as a multiscale temporal signal.

Background

Dominant models of speech perception describe its underlying neural mechanisms at a static neuroanatomical level, neglecting the cognitive algorithmic and neural dynamic levels of description. These latter can only be investigated by considering the temporal dimension of speech, which is structured according to a hierarchy of linguistic timescales (phoneme, syllable, word, phrase).

Recent Advances

Recent advances in behavioural paradigms, computational modelling, and neuroimaging data analysis make it now possible to investigate the cognitive algorithms and neural dynamics subtending the processing of speech.

Project Objectives

To define an integrated model of speech perception, this project seeks to:

1. Record neural activity in humans with magnetoencephalography and intracranial recordings during the perception of continuous speech.
2. Quantify linguistic information at each timescale of speech with a computational model.
3. Estimate their respective and shared neural correlates with multivariate and directed connectivity analyses.

Feasibility

Feasibility is ensured by in-house access to neuroimaging and intracranial recordings as exemplified in the data on Figure 1 of this proposal.

Research Significance

This project will critically test whether neural oscillations play a fundamental role in the computational processes of perception and cognition. It will define the mapping between speech and neural timescales and reveal how information is transferred and combined along the linguistic computational processing hierarchy.

Contributions of Hemispheric Pathways

It will overall specify—in terms of the nature of the information processed and of the dynamical hierarchical organization—the respective contributions of left and right hemispheric ventral and dorsal auditory pathways in speech processing.