Tipo: artículo

Metodología: estudio empírico

Temas: inteligencia artificial

Resumen:

Texto completo

Assessment is a crucial part of education. Traditional marking is a source of inconsistencies and unconscious bias, placing a high cognitive load on the assessors. One approach to address these issues is comparative judgement (CJ). In CJ, the assessor is presented with a pair of items of work, and asked to select the better one. Following a series of comparisons, a rank for any item may be derived using a ranking model, for example, the Bradley-Terry model, based on the pairwise comparisons. While CJ is considered to be a reliable method for conducting marking, there are concerns surrounding its transparency, and the ideal number of pairwise comparisons to generate a reliable estimation of...

Ver ficha completa

Tipo: artículo

Metodología: estudio empírico

Temas: inteligencia artificial

Resumen:

Texto completo

Despite the development of various AI systems to support learning in various domains, AI assistance for art appreciation education has not been extensively explored. Art appreciation, often perceived as an unfamiliar and challenging endeavor for most students, can be more accessible with a generative AI enabled conversation partner that provides tailored questions and encourages the audience to deeply appreciate artwork. This study explores the application of multimodal large language models (MLLMs) in art appreciation education, with a focus on developing LLaVA-Docent, a model designed to serve as a personal tutor for art appreciation. Our approach involved design and development research...

Ver ficha completa

Tipo: artículo

Metodología: estudio empírico

Temas: inteligencia artificial

Resumen:

Texto completo

Writing proficiency is an essential skill for upper secondary students that can be enhanced through effective feedback. Creating feedback on writing tasks, however, is time-intensive and presents a challenge for educators, often resulting in students receiving insufficient or no feedback. The advent of text-generating large language models (LLMs) offers a promising solution, namely, automated evidence-based feedback generation. Yet, empirical evidence from randomized controlled studies about the effectiveness of LLM-generated feedback is missing. To address this issue, the current study compared the effectiveness of LLM-generated feedback to no feedback. A sample of N = 459 upper secondary...

Ver ficha completa

Tipo: artículo

Metodología: estudio empírico

Temas: inteligencia artificial

Resumen:

Texto completo

The majority of AI literacy studies have designed and developed self-reported questionnaires to assess AI learning and understanding. These studies assessed students' perceived AI capability rather than AI literacy because self-perceptions are seldom an accurate account of true measures. International assessment programs that use objective measures to assess science, mathematical, digital, and computational literacy back up this argument. Furthermore, because AI education research is still in its infancy, the current definition of AI literacy in the literature may not meet the needs of young students. Therefore, this study aims to develop and validate an AI literacy test for school students...

Ver ficha completa

Tipo: artículo

Metodología: estudio empírico

Temas: inteligencia artificial

Resumen:

Texto completo

This study explores the integration of generative AI into English as a Foreign Language (EFL) teaching preparation within Indonesian higher education, addressing the growing need to understand how emerging technologies can enhance pedagogical practices in a rapidly evolving educational landscape. By employing the Unified Theory of Acceptance and Use of Technology (UTAUT) and Activity Theory, the research provides a robust analytical framework to examine the factors influencing lecturers' adoption of generative AI. The study is particularly relevant as generative AI offers significant potential to improve teaching efficiency and content personalization, yet its adoption presents challenges...

Ver ficha completa

Tipo: artículo

Metodología: estudio empírico

Temas: inteligencia artificial

Resumen:

Texto completo

El objetivo de esta investigación es analizar las estrategias de actitud crítica de los maestros en formación inicial en el uso de dos herramientas de Inteligencia Artificial Generativa (IAG), ChatGPT y Perplexity, en el proceso de construcción de un texto expositivo académico. Esta investigación deriva de una propuesta didáctica implementada en la Facultad de Educación (Universitat de Barcelona), en la que participaron 26 maestros en formación inicial en el Grado de Educación Infantil. El corpus de datos está constituido por 26 textos expositivos, 74 borradores de proceso y 26 reflexiones sobre su proceso de escritura. El análisis de contenido muestra tres tendencias en la forma en la que...

Ver ficha completa

Tipo: artículo

Metodología: estudio empírico

Temas: inteligencia artificial

Resumen:

Texto completo

The rapid adoption of generative AI tools such as ChatGPT by students has the potential to disrupt the higher education sector, with concerns being raised by academics about potential threats to academic integrity. This paper contributes to the pressing discussion about responses to AI tools by examining students' perceptions and the use of generative AI to assist them with assessments. Based on a survey among 337 Australian university students, this study found that more than a third of students have used a chatbot for assistance with an assessment, and do not necessarily perceive this as a breach of academic integrity. The study further investigated to what extent different psychosocial...

Ver ficha completa

Tipo: artículo

Metodología: estudio empírico

Temas: inteligencia artificial

Resumen:

Texto completo

The present study develops an integrative framework that investigates the relationship between the acceptability of ChatGPT among business students and their attitude, intention to adopt, and performance. This is achieved by examining the moderating role of business students' moral values and religious ethics. Using data collected from 312 university business students in Oman, we show that perceived usefulness (PU), perceived ease of use (PEOU), and perceived convenience (PC) have a positive effect on their attitudes toward ChatGPT. Business students' attitudes toward ChatGPT have a strong positive influence on their adoption intentions. Notably, university business students’ ChatGPT...

Ver ficha completa

Tipo: artículo

Metodología: estudio empírico

Temas: inteligencia artificial

Resumen:

Texto completo

Estudio que compara la corrección de ensayos reflexivos hecha por tutores expertos con la de ChatGPT. Se analizaron 108 reflexiones anonimizadas de estudiantes de ingeniería, ya calificadas por 39 tutores formados con una rúbrica común (profundidad, análisis, lógica y claridad, y feedback); ChatGPT recibió las mismas instrucciones y rúbricas y puntuó los textos de forma independiente.

Resultados: el acuerdo entre ambos evaluadores fue moderado (ICC = 0,728), con diferencias significativas en las puntuaciones medias. ChatGPT se ciñó de forma más estricta a los criterios, mientras que los tutores mostraron más...

Ver ficha completa

Tipo: artículo

Metodología: estudio empírico

Temas: inteligencia artificial

Resumen:

Texto completo

Currently, many generative Artificial Intelligence (AI) tools are being integrated into the educational technology landscape for instructors. Our paper examines the potential and challenges of using Large Language Models (LLMs) to code student-generated content in online discussions based on intended learning outcomes and how instructors could use this to assess the intended and enacted learning design. If instructors were to rely on LLMs as a means of assessment, the reliability of these models to code the data accurately is crucial. Employing a diverse set of LLMs from the GPT family and prompting techniques on an asynchronous online discussion dataset from a blended-learning bachelor-...

Ver ficha completa