Tipo: artículo

Metodología: estudio empírico

Temas: inteligencia artificial chatbots pensamiento computacional

Temas IA: chatbots prompts IA y aprendizaje

Resumen:

Texto completo

The rise of generative AI has increased interest in its application as an intelligent lab assistant in programming education, but concerns persist over its educational value and potential exploitation. While previous work supports using a customized chatbot as an assistant that provides specific guidance rather than allowing students to prompt responses freely, empirical evidence directly comparing these approaches is still lacking. This study evaluates the impact of two chatbot designs, Unrestricted and Assistant, on student learning and behavior in a short Python programming course. Through a controlled experiment involving 42 participants, we found that students using the Assistant...

Ver ficha completa

Tipo: artículo

Metodología: estudio empírico

Temas: inteligencia artificial feedback/retroalimentación grandes modelos de lenguaje

Temas IA: modelos de lenguaje (LLM) prompts IA y evaluación

Resumen:

Texto completo

Relational feedback is increasingly recognised for its crucial role in enhancing student-instructor relationships and promoting the assimilation of feedback. Despite its significance, no studies have tried to develop automated methods to analyse written feedback for properties of relational feedback to promote its use at scale and assist feedback providers with their relational feedback practices. This automated analysis of relational feedback can be performed as a classification task. However, traditional machine and deep learning methods for text classification typically require extensive human labelling and pose a significant challenge for educators and researchers lacking machine...

Ver ficha completa

Tipo: artículo

Metodología: estudio empírico

Temas: inteligencia artificial competencia intercultural creación de materiales

Temas IA: IA y enseñanza-aprendizaje de lenguas IA y creación de materiales chatGPT

Resumen:

Texto completo

Classroom teachers are usually responsible for creating materials to meet students' needs and course requirements. The arrival of generative AI, such as ChatGPT, offers EFL teachers an opportunity to regularly collaborate with AI chatbots to create new source materials. The writing experiments in this study considered how to effectively and ethically work with generative AI to produce culturally appropriate EFL teaching materials. The experiments involved co-producing moral dilemmatic stories with ChatGPT to support a new Chinese EFL curriculum unit on “Morals and Virtues”. We draw on Lo's (2023a, 2023b) CLEAR framework for prompt engineering to generate appropriate stimulus materials. We...

Ver ficha completa

Tipo: artículo

Metodología: estudio empírico

Temas: inteligencia artificial alfabetización en IA educación superior

Temas IA: prompts IA y aprendizaje estudio empírico

Resumen:

Texto completo

Large language models (LLMs) are transforming higher education, yet their learning benefits likely depend on students’ AI literacy and how they prompt and verify AI outputs. This mixed-methods study investigates how AI literacy relates to prompting proficiency and verification behavior, and how these behaviors operate through two mechanisms, trust calibration and extraneous cognitive load, to predict coursework performance across two discipline–institution contexts in Thailand. The author surveyed Design students (n = 221) and Business students (n = 222) and analyzed the data using multigroup structural equation modeling, complemented by thematic analysis of semi-structured interviews....

Ver ficha completa

Tipo: artículo

Metodología: estudio empírico

Temas: inteligencia artificial ChatGPT expresión escrita

Temas IA: IA y enseñanza-aprendizaje de lenguas chatGPT prompts

Resumen:

Texto completo

ChatGPT can be defined as a chatbot powered by OpenAI's GPT language models, which has shown promise in improving English-as-a-foreign-language (EFL) writing knowledge and skills. However, its application to developing EFL argumentative writing logic remains largely unexplored, despite the importance of this area. Moreover, existing studies have highlighted deep learner engagement with ChatGPT-based learning but have not examined how engagement varies between two key components of this learning method: GPT responses (GPT's messages to learners) and learner prompts (learners' messages to GPT). To better understand the mechanisms and efficacy of ChatGPT-based learning for EFL argumentative...

Ver ficha completa

Tipo: artículo

Metodología: estudio empírico

Temas: inteligencia artificial chatbots grandes modelos de lenguaje

Temas IA: chatbots modelos de lenguaje (LLM) prompts

Resumen:

Texto completo

Artificial Intelligence (AI) is rapidly and consistently becoming more integrated in various aspects of our lives. One of the areas where these systems are increasingly used is education. In fact, it is both being incorporated into specific curricula, allowing students the possibility to acquire skills within this field, and more recently AI has been used as a tool to facilitate the teaching and learning process. However, an increased demand and availability of these tools do not imply a successful switch from traditional to AI-supported learning.In this work, ChatGMP, a chatbot leveraging a Large Language Model (LLM) able to conduct an interview exercise in a Master's Degree course taught...

Ver ficha completa

Tipo: artículo

Metodología: estudio empírico

Temas: inteligencia artificial evaluación grandes modelos de lenguaje

Temas IA: IA y evaluación modelos de lenguaje (LLM) prompts

Resumen:

Texto completo

Automated scoring (AS) has become increasingly prevalent in educational measurement. However, applying it to international reading assessments remains challenging, particularly due to the length and complexity of the required prompting, driven by the need to include lengthy reading passages and detailed scoring guides. Processing these lengthy inputs results in high computational costs and may impede the performance of large language models (LLMs). This study explored the potential of optimizing AS with prompt compression using OpenAI's LLM, GPT-4o. Our results show that prompt compression significantly reduces the length of reading passages and scoring guides while maintaining their...

Ver ficha completa

Tipo: artículo

Metodología: estudio empírico

Temas: inteligencia artificial expresión escrita evaluación

Temas IA: IA y enseñanza-aprendizaje de lenguas IA y evaluación modelos de lenguaje (LLM)

Resumen:

Texto completo

This research assesses the effectiveness of state-of-the-art large language models (LLMs), including ChatGPT, Llama, Aya, Jais, and ACEGPT, in the task of Arabic automated essay scoring (AES) using the AR-AES dataset. It explores various evaluation methodologies, including zero-shot, few-shot in context learning, and fine-tuning, and examines the influence of instruction-following capabilities through the inclusion of marking guidelines within the prompts. A mixed-language prompting strategy, integrating English prompts with Arabic content, was implemented to improve model comprehension and performance. Among the models tested, ACEGPT demonstrated the strongest performance across the...

Ver ficha completa

Tipo: artículo

Metodología: estudio empírico

Temas: inteligencia artificial alfabetización en IA grandes modelos de lenguaje

Temas IA: prompts modelos de lenguaje (LLM) IA y educación

Resumen:

Texto completo

Artificial intelligence technologies are rapidly advancing. As part of this development, large language models (LLMs) are increasingly being used when humans interact with systems based on artificial intelligence (AI), posing both new opportunities and challenges. When interacting with LLM-based AI system in a goal-directed manner, prompt engineering has evolved as a skill of formulating precise and well-structured instructions to elicit desired responses or information from the LLM, optimizing the effectiveness of the interaction. However, research on the perspectives of non-experts using LLM-based AI systems through prompt engineering and on how AI literacy affects prompting behavior is...

Ver ficha completa

Tipo: artículo

Metodología: estudio empírico

Temas: inteligencia artificial alfabetización en IA multimodalidad

Temas IA: prompts IA y educación estudio empírico

Resumen:

Texto completo

: As generative artificial intelligence (GenAI) rapidly transforms higher education, critical questions arise about how students engage with these open-ended tools and the implications for learning. This study provides empirical insight into this research gap investigating (1) the prompting strategies students develop when interacting with a university-provided GenAI tool and (2) how engagement in prompt engineering activities shapes their understanding of GenAI and AI literacy. Data were collected in an exploratory workshop with 28 postgraduate students engaged in collaborative multimodal prompting tasks, including the creation of short stories or poems and corresponding images. Students’...

Ver ficha completa