Cross-modal and cross-language activation in bilinguals reveals lexical competition even when words or signs are unheard or unseen

Published August 29, 2022

Bibliographic Details
Authors: Villameriel, Saúl; Costello, Brendan; Giezen, Marcel; Carreiras, Manuel
Format: Article
Publication date:2022
Country:España
Institution:Universidad del País Vasco
Repository:Addi. Archivo Digital para la Docencia y la Investigación
OAI Identifier:oai:addi.ehu.eus:10810/58529
Online Access:http://hdl.handle.net/10810/58529
Access Level:Open access
Keyword:language coactivation
bimodal bilingualism
lexical access
sublexical competition
visual world paradigm
_version_ 1878736333693779968
author Villameriel, Saúl
author2 Costello, Brendan
Giezen, Marcel
Carreiras, Manuel
author2_role author
author
author
author_browse Carreiras, Manuel
Costello, Brendan
Giezen, Marcel
Villameriel, Saúl
author_facet Villameriel, Saúl
Costello, Brendan
Giezen, Marcel
Carreiras, Manuel
author_role author
collection Addi. Archivo Digital para la Docencia y la Investigación
description Published August 29, 2022
eu_rights_str_mv openAccess
format article
id ES_8d2eb9eaa4e409f005aaa909c0cbb381
institution Universidad del País Vasco
instname_str Universidad del País Vasco
network_acronym_str ES
network_name_str España
oai_identifier_str oai:addi.ehu.eus:10810/58529
publishDate 2022
publishDateSort 2022
publisher PNAS
publisherStr PNAS
reponame_str Addi. Archivo Digital para la Docencia y la Investigación
spelling Cross-modal and cross-language activation in bilinguals reveals lexical competition even when words or signs are unheard or unseen Villameriel, Saúl Costello, Brendan Giezen, Marcel Carreiras, Manuel language coactivation bimodal bilingualism lexical access sublexical competition visual world paradigm Published August 29, 2022 We exploit the phenomenon of cross-modal, cross-language activation to examine the dynamics of language processing. Previous within-language work showed that seeing a sign coactivates phonologically related signs, just as hearing a spoken word coactivates phonologically related words. In this study, we conducted a series of eye-tracking experiments using the visual world paradigm to investigate the time course of crosslanguage coactivation in hearing bimodal bilinguals (Spanish–Spanish Sign Language) and unimodal bilinguals (Spanish/Basque). The aim was to gauge whether (and how) seeing a sign could coactivate words and, conversely, how hearing a word could coactivate signs and how such cross-language coactivation patterns differ from withinlanguage coactivation. The results revealed cross-language, cross-modal activation in both directions. Furthermore, comparison with previous findings of within-language lexical coactivation for spoken and signed language showed how the impact of temporal structure changes in different modalities. Spoken word activation follows the temporal structure of that word only when the word itself is heard; for signs, the temporal structure of the sign does not govern the time course of lexical access (location coactivation precedes handshape coactivation)—even when the sign is seen. We provide evidence that, instead, this pattern of activation is motivated by how common in the lexicon the sublexical units of the signs are. These results reveal the interaction between the perceptual properties of the explicit signal and structural linguistic properties. Examining languages across modalities illustrates how this interaction impacts language processing. The authors acknowledge financial support from the Spanish Ministry of Economy and Competitiveness (MINECO), through the “Severo Ochoa” Programme for Centres/Units of Excellence in R&D (CEX2020-001010-S), from the Basque Government through the BERC (Basque Excellence Research Centres) 2022-2025 program, from the National Research Agency [Agencia Estatal de Investigación], MINECO, and European Regional Development Fund, through Grant Nos. PSI-2016-76435-P and PID2019-107325GB-I00 to B.C. and M.G. and PID2021-122918OB-I00 to M.C.), and through Juan de la Cierva Fellowships (FJCI-2017-31806 and IJC2019-038991-I to B.C.). PNAS http://hdl.handle.net/10810/58529
spellingShingle Cross-modal and cross-language activation in bilinguals reveals lexical competition even when words or signs are unheard or unseen
Villameriel, Saúl
language coactivation
bimodal bilingualism
lexical access
sublexical competition
visual world paradigm
title Cross-modal and cross-language activation in bilinguals reveals lexical competition even when words or signs are unheard or unseen
title_full Cross-modal and cross-language activation in bilinguals reveals lexical competition even when words or signs are unheard or unseen
title_fullStr Cross-modal and cross-language activation in bilinguals reveals lexical competition even when words or signs are unheard or unseen
title_full_unstemmed Cross-modal and cross-language activation in bilinguals reveals lexical competition even when words or signs are unheard or unseen
title_short Cross-modal and cross-language activation in bilinguals reveals lexical competition even when words or signs are unheard or unseen
title_sort Cross-modal and cross-language activation in bilinguals reveals lexical competition even when words or signs are unheard or unseen
topic language coactivation
bimodal bilingualism
lexical access
sublexical competition
visual world paradigm
topic_facet language coactivation
bimodal bilingualism
lexical access
sublexical competition
visual world paradigm
url http://hdl.handle.net/10810/58529