Tipo: artículo

Metodología: estudio empírico

Temas: inteligencia artificial

Resumen:

Texto completo

Large language models (LLMs) are increasingly used in language learning and assessment, yet their English proficiency is seldom reported against interpretable proficiency standards. We introduce the China’s Standards of English Language Ability (CSE) framework to assess the proficiency levels and subskills of LLMs. The test is referred to as the CSEBench and comprises 624 expert-annotated multiple-choice items across CSE Levels 2–7. Each item is accompanied by metadata, including difficulty level and subskill labels covering vocabulary, syntax, phonology, and cohesion/discourse. Critically, the dataset includes test responses from 2,050 middle school and and sophomore college students who...

Ver ficha completa

Tipo: artículo

Metodología: estudio empírico

Temas: inteligencia artificial

Resumen:

Texto completo

The widespread usage of computer-based assessments and individualized learning platforms has increased demand for the rapid production of high-quality items. Automated item generation (AIG), the process of using item models to generate new items with the help of computer technology, was proposed to reduce reliance on human subject experts. While AIG has been used in test development, recent advances in machine learning algorithms offer the potential to enhance its efficiency further. This paper presents an innovative approach utilizing OpenAI's latest transformer-based language model, GPT-3, to generate reading passages. Existing reading passages were used in carefully engineered prompts to...

Ver ficha completa

Tipo: artículo

Metodología: estudio empírico

Temas: inteligencia artificial

Resumen:

Texto completo

The integration of large language models (LLMs) into intelligent tutoring systems promises personalized learning, yet procedural domains such as primary mathematics remain challenging due to inconsistency and pedagogical opacity. LLM tutors may give unsolicited answers or show unstable scaffolding when students vary arithmetic, units, or rounding. This design science research develops and evaluates a rule-guided tutoring system for mathematical word problems in primary schools. We formalize a distinction between rule-guided scaffolding, in which tutoring is governed by a three-layer architecture (diagnosis → intent selection → constrained response generation), and ad-hoc scaffolding, where...

Ver ficha completa

Tipo: artículo

Metodología: estudio empírico

Temas: inteligencia artificial

Resumen:

Texto completo

The advent of Generative Artificial Intelligence (GenAI) and large language models like LLama, Palm2, GPT, Gemini, and Claude has revolutionized education by generating human-like text and contextually relevant responses. Our research investigates the impact of structured prompt training on students' learning in data analysis and programming. We experimented with 157 first-year engineering students divided into three groups: a control group (internet access, no GenAI), an experimental group 1 (internet and GenAI without prompt training), and an experimental group 2 (internet and GenAI with prompt training). The prompt training session included techniques like few-shot prompting, chain...

Ver ficha completa

Tipo: artículo

Metodología: estudio empírico

Temas: inteligencia artificial

Resumen:

Texto completo

Large Language Models (LLMs) offer scalable educational support, but face barriers regarding accuracy, cost, and learning depth. To interrogate these limitations, we developed the Teaching Assistant for Specialized Knowledge (TAsk), a retrieval-augmented generation enabled and educator curated pipeline. In this nine-week pilot study (N = 33 participants), we deployed TAsk in a graduate-level biological chemistry course. We compared TAsk against human expert teaching assistants (TAs) using blinded review process and analyzed inquiry depth. We observed three major findings related to potential pedagogical decisions and educational theory. First, TAsk delivered effective feedback that was...

Ver ficha completa

Tipo: artículo

Metodología: estudio empírico

Temas: inteligencia artificial

Resumen:

Texto completo

High-quality instruction is essential to facilitating student learning, prompting many professional development (PD) programmes for teachers to focus on improving classroom dialogue. However, during PD programmes, analysing discourse data is time-consuming, delaying feedback on teachers' performance and potentially impairing the programmes' effectiveness. We therefore explored the use of ChatGPT (a fine-tuned GPT-3.5 series model) and GPT-4o to automate the coding of classroom discourse data. We equipped these AI tools with a codebook designed for mathematics discourse and academically productive talk. Our dataset consisted of over 400 authentic talk turns in Chinese from synchronous online...

Ver ficha completa

Tipo: artículo

Metodología: estudio empírico

Temas: inteligencia artificial

Resumen:

Texto completo

In AI literacy education, there are few examples of education based on AI ethical principles, and limited knowledge exists regarding curriculum design that incorporates AI ethical principles and its effects. Therefore, in this study, we propose a curriculum that teaches the ethical use of large language models (LLM) such as ChatGPT and verify its impact on educational effectiveness and technology acceptance among students aged 12 to 24. The validation results show that the proposed curriculum particularly contributes to the understanding of LLM concepts and their ethical use in decision support. We also demonstrate that experience using ChatGPT influences the level of understanding of...

Ver ficha completa

Tipo: artículo

Metodología: trabajo teórico

Temas: inteligencia artificial

Resumen:

Texto completo

Generative AI, currently most visible in education through large language models (LLMs), is increasingly embedded in students’ everyday learning practices, supporting tasks such as writing, coding, reasoning, and analysis. Yet its educational value remains uncertain because systems designed to improve immediate task performance may also weaken the cognitive and metacognitive processes that support durable learning. This paper addresses this learning–performance paradox by asking how AI systems can be designed to support learning rather than merely produce better outputs. To address this, in this paper, we make three contributions. First, we synthesise current LLM-based study support with...

Ver ficha completa

Tipo: artículo

Metodología: estudio empírico

Temas: inteligencia artificial

Resumen:

Texto completo

Scene description tasks effectively enhance students' English writing skills in contextual settings, facilitating the establishment of authentic situational connections. However, evaluating descriptive quality and providing accurate, level-appropriate feedback present significant challenges. Although Multimodal Large Language Models (MLLMs) have demonstrated strong capabilities in vision-language tasks, their generated feedback for scene description tasks often remains generic. It fails to account for students' educational stages. To address this limitation, we construct a novel level-specific feedback dataset for scene description tasks. This dataset is constructed using GPT-4o with...

Ver ficha completa

Tipo: artículo

Metodología: estudio empírico

Temas: inteligencia artificial

Resumen:

Texto completo

Short open-ended questions represent a central resource in formative and summative assessments both face-to-face and online settings, ranging from elementary to higher education. However, grading these questions remains challenging for instructors, raising attention to the field of Automatic Short Answer Grading (ASAG). While ASAG has yielded valuable contributions to learning analytics, it often faces generalizability issues. Accordingly, the rapid advancement in Large Language Models (LLMs) has motivated their adoption to empower ASAG systems. Despite that, previous research has not investigated whether LLMs are fair graders in the context of ASAG. Therefore, this paper presents an...

Ver ficha completa