todoELE | Etiquetas | Pablo Robles-García

Bibliografía - Pablo Robles-García

3K-LEx. Desarrollo y validación de una prueba de amplitud léxica en español

Pablo Robles-García (2020)

En Journal of Spanish Language Teaching 7.1

Este trabajo presenta el proceso de creación y validación de 3K-LEx, una prueba de amplitud léxica de respuesta Sí/No que evalúa el conocimiento de las 3.000 palabras más frecuentes en español. El proceso de validación incluyó la comparación entre los resultados de dos versiones diferentes de la prueba. 1.121 estudiantes completaron ambas versiones, de 162 ítems cada una: 108 palabras reales y 54 pseudopalabras. No se observaron diferencias en los resultados entre ambas versiones. También se compararon dos tipos de administración de la prueba: supervisada y no supervisada, y se evaluaron los resultados en ambas modalidades mediante diferentes matrices de penalización. 88 estudiantes (52 con prueba supervisada y 36 no supervisada) participaron en este proceso. Los participantes de la modalidad no supervisada emplearon más tiempo en realizar la prueba y seleccionaron el doble de pseudopalabras. La matriz 1-2 fue la que más aproximó los resultados obtenidos entre ambas modalidades.

----------------------

This study presents the creation and validation of 3K-LEx, a Yes/No vocabulary test that measures vocabulary knowledge of the 3,000 most frequent words in Spanish. For validation purposes, students’ performance was compared on two different versions of the test. 1,121 students completed two sub-tests of 162 items each: 108 real words and 54 pseudowords. Results showed that both versions were not significantly different. Two types of test administration were also compared among 88 participants: 52 supervised and 36 unsupervised. Results from both modalities were evaluated through different penalization methods. Students from the unsupervised modality spent more time on the test and selected twice the number of pseudowords. The 1-2 formula is the most effective penalization method to balance the results between modalities.

L2 Spanish vocabulary teaching in US universities: Instructors’ beliefs and reported practices

Claudia H. Sánchez-Gutiérrez, Pablo Robles-García, Mercedes Pérez Serrano (2025)

En Language Teaching Research 29 - 2

Texto completo

Studies on teachers’ beliefs about vocabulary learning and teaching have focused, so far, on English as a second language (L2), or foreign language (FL), in different contexts but little attention has been given to other L2s and FLs. In this study, 15 Spanish L2 instructors at large universities were interviewed in order to better understand where they stand when it comes to (1) the importance they give to vocabulary, as compared to grammar, in their classes, (2) how they decide which words to teach, and (3) how they assess students’ word knowledge. These interviews were subsequently analysed following Grounded Theory. Most instructors declared favoring grammar over vocabulary in their courses because the former is seen as more challenging and useful than the latter and because institutional practices and materials also present such a preference. When it comes to vocabulary selection, most of them declared feeling insecure in their decisions due to lack of access to useful resources and to vocabulary goals not being stated clearly anywhere in the syllabi. This lack of clarity when it comes to vocabulary learning goals also results in doubts about the usefulness of even evaluating word learning at all and an overreliance on informal assessments.

The wisdom of crowds: When teacher judgments outperform word-frequency as a predictor of students’ vocabulary knowledge

Pablo Robles-García, Jeffrey Stewart, Christopher Nicklin, Joseph P. Vitta, Stuart McLean, Brandon Kramer (2023)

En Language Teaching Research

Texto completo

This study investigated the effectiveness of word-frequency and teacher judgments in determining students’ vocabulary knowledge and compared the predictive powers of both approaches when estimating vocabulary knowledge. Twenty-nine second language (L2) Spanish teachers were asked to predict how likely their students would know words from a 216-word Yes/No test that measures knowledge of the first 3,000 words in Spanish. The accuracy of their responses was compared with the results of 1,075 L2 Spanish students who completed the same test. To examine if the results could generalize to other L2 settings, 394 L2 English students completed a 70-word Yes/No test that measures knowledge of the first 14,000 words in English, and 15 L2 English language instructors attempted to predict which words would or would not be recognized. Results showed that for both language contexts, (1) the median teacher rater could assess students’ vocabulary knowledge with an accuracy roughly comparable to frequency, (2) the combination of teachers’ judgments displayed a stronger relationship with students’ performance on the vocabulary test than frequency, since the average of three or more teachers’ ratings improved upon frequency when examined with 1,000 bootstrapped samples, and (3) using teacher judgments and frequency together did not substantially improve the prediction of students’ vocabulary knowledge.

Publica