DOHEN
Marion
Associate Professor Grenoble-INP









MANUAL GESTURES IN MULTIMODAL SPOKEN COMMUNICATION

  • Gesture / speech coordination: motion capture (manual and articulatory), role of prosody, motor and communicational coordination factors, multimodal pointing (hand / speech)
> Associated PhDs:
  • Benjamin Roustan - 2008-2012
  • Hélène Serré - 2018-2021
    • > Associated funded projects:
  • Gesture/speech coordination and the child's linguistic development - scientific coordinator: M. Dohen - 2011 - funded by the Pôle Grenoble Cognition
  • Salammbo - scientific coordinators: A. Rochet-Capellan & S. Fuchs - 2018-2021 - funded by the ANR and the DFG

    • Contribution of manual gestures for the compensation of perturbations in spoken communication: modality deficiency, Specific Language Impairments, trisomy 21
    > Associated funded projects:

    > Collaborations : A. Rochet-Capellan (GIPSA-lab, Grenoble, France), J.-M. Colletta (Lidilem, Mother and Foreign Language Linguistics and Didactics Lab, Grenoble, France), E. Gillet-Perret (speech therapist, CRTLA, Grenoble Hospital), Olivier Richard (LIG, Computer Science Lab, Grenoble, France).

    Back to top



    SPOKEN COMMUNICATION IN PEOPLE WITH TRISOMY 21

    • "Communiquons Ensemble (ComEns)" (Let's communicate together) research project: study of the co-construction of the multimodal communicating space between people with trisomy 21 and ordinary people. Aim: understand the communicative difficulties of people with trisomy 21 and explore potential compensatory strategies

    > Visit the ComEns website: here
    > Look at ComEns:
    • Descriptive movie on the ComEns project: here (in French)
    • Film on the participation of people with trisomy 21 to the ComEns project: here (in French)
    • Animation movie to broadly explain the communicative difficulties of people with trisomy 21 («Parler avec Tom»): here (in French)
    > Read about ComEns in the media: here and here (all in French)
    > Listen about ComEns on the radio: here and here

    > Associated PhD: Alexandre Hennequin

    > Associated funded projects:
    • ComEns "Communicating together" - scientific coordinators: M. Dohen and A. Rochet-Capellan - 2014-2016 - funded by the FIRAH

    > Collaborations: A. Rochet-Capellan (GIPSA-lab, Grenoble, France), ARIST (Association for research and social integration of people with trisomy 21, Grenoble, France), J.-M. Colletta (Lidilem, Mother and Foreign Language Linguistics and Didactics Lab, Grenoble, France), ISTR-Univ. Lyon 1 (school for speech therapists, Lyon, France).

    Back to top



    ARTICULATORY CAPABILITIES OF PEOPLE WITH A COMMUNICATIVE IMPAIRMENT

    • Adults and children - trisomy 21, Specific Language Impairments (SLI)
    • Acoustico-articulatory exploration

    > Collaborations: A. Rochet-Capellan (GIPSA-lab, Grenoble, France), E. Gillet-Perret (CRTLA, Grenoble Hospital, France) and Maëva Garnier (GIPSA-lab, Grenoble, France).

    > Associated funded projects:
    • ComEns "Communicating together" - scientific coordinators: M. Dohen and A. Rochet-Capellan - 2014-2017 - funded by the FIRAH
    • StopNCo "Effort and coordination in the production of stop consonants" - scientific coordinator: M. Garnier - 2015-2019 - funded by the ANR (French Research Agency)

    Back to top



    MULTISENSORIALITY AND MULTIMODALITY OF PROSODY

    • Prosodic focus

    • Production (acoustic and articulatory measurements) and perception (visual only and auditory-visual tests) studies

    • Inter-linguistic study of the auditory-visual perception of prosody (comparison between French and Japanese)

    > Associated PhD: Marion Dohen (2002-2005)

    > Collaborations: H. Lœvenbruck and J.-L. Schwartz (GIPSA-lab, Grenoble, France) and H. Hill (Cognitive Information Science Department, ATR research labs, Japan and Psychology Department, Wollongong University, Australia).

    Back to top



    NEURAL CORRELATES OF THE AUDITORY AND AUDITORY-VISUAL PERCEPTION OF PROSODY USING fMRI

    > Associated doctoral dissertation: Marcella Perrone-Bertolotti (2007-2011)

    > Associated funded projects:

    > Collaborations: H. Lœvenbruck and M. Sato (GIPSA-lab, Grenoble, France), D. Callan and A. Callan (Neural Information Analysis Department, ATR research labs, Japan), M. Baciu, M. Perrone and C. Pichat (Psychology and NeuroCognition Lab, LPNC, Grenoble, France).

    Back to top



    INNERSPEECH

    • Physiological and neural traces
    > Associated funded projects:
    • INNERSPEECH "Neural correlates of innerspeech" - 2014-2018 - scientific coordinator: H. Loevenbruck - funded by the ANR (French Research Agency)
    • Embodied emotion and speech Monitoring Grenoble (EMG) - scientific coordinator: M. Mermillod - 2014 - funded by the PEPS CUE Grenoble - CNRS

    • Characterization of auditory-verbal hallucinations in people with schizophrenia
    > Associated PhD: Lucile Rapin (2007-2011)
    > Associated funded projects:
    • "Orofacial traces of auditory-verbal hallucinations in people with schizophrenia: electromyography and electroglottography" - 2009 - scientific coordinator: H. Lœvenbruck (GIPSA-lab, Grenoble, France) and M. Polosan (Grenoble Hospital). - funded by the cluster régional 11 Handicap, Vieillissement, Neurosciences
    • "Exploration of the cognitive mechanisms involved in auditory-verbal hallucinations in people with schizophrenia" - 2009 - scientific coordinators: H. Lœvenbruck (GIPSA-lab, Grenoble, France) and T. Woodward (CNOS, Canada) - funded by the centre Jacques Cartier


    > Collaborations: H. Lœvenbruck (GIPSA-lab then LPNC, Grenoble, France), L. Rapin (GIPSA-lab, Grenoble, France then Laboratoire de Phonétique, UQUAM, Montreal, Canada), M. Perrone-Bertolotti and M. Baciu (Psychology and NeuroCognition lab,LPNC, Grenoble, France), M. Polosan (Psychiatry and Neurology Department, Grenoble Hospital), T. Woodward (Cognitive Neuroscience of Schizophrenia Research Lab, Vancouver, Canada).

    Back to top


    Attributions :

    Departement: Speech and Cognition

    Team: Speech Multimodality Development

    Domaine Universitaire
    BP 46
    38402 Saint Martin d'Hères cedex

    Office: B352

    Mail: marion.dohen@gipsa-lab.grenoble-inp.fr

    Tel: +33 (0)4 76 57 48 50

    Fax: +33 (0)4 76 57 47 10

    Mail : marion.dohen@gipsa-lab.grenoble-inp.fr

    Tel : +33(0)4 76 57 48 50

    Fax : +33 (0)4 76 57 47 10

    Grenoble Images Parole Signal Automatique laboratoire

    UMR 5216 CNRS - Grenoble INP - Université Joseph Fourier - Université Stendhal