Tipo: artículo

Metodología: estudio empírico

Temas: inteligencia artificial

Resumen:

Texto completo

In large-scale international writing assessments, human raters often exhibit inconsistency, undermining reliability and validity. Large language models (LLMs) offer a potential solution, but their assessment reliability remains underexplored. This study employed generalizability theory and many-facet Rasch modeling to compare human and LLM raters across three essay genres (4315 samples).Findings reveal that human-LLM discrepancies stem from fundamental evaluation differences, with minimal divergence in key-point scoring. Humans excel in holistic scoring scenarios but struggle with complex analytical rubrics where LLMs demonstrate advantages. While LLMs perform adequately for relative...

Ver ficha completa

Tipo: artículo

Metodología: estudio empírico

Temas: motivación

Resumen:

With increasing attention paid to the effects of learning a foreign language (FL) on older adults in the currently ageing world, psychological individual difference (ID) variables (e.g. learning motivation) remain much under-investigated, compared with cognitive IDs. This exploratory study examined older adults’ English learning motivation in the Chinese context of English as a foreign language (EFL) by conducting a web-based survey (n = 510) and semi-structured interviews (n = 21). Results showed that (1) the selected sociobiographical variables influenced older adults’ English learning motivation to different degrees, among which education, use frequency of English and socioeconomic status (SES) emerged as very important predictors; and (2) four motivators for English learning by older adults emerged as traveling or visiting...

Ver ficha completa