Tipo: artículo

Metodología: estudio empírico

Temas: inteligencia artificial grandes modelos de lenguaje chatbots

Temas IA: análisis de producción de IA modelos de lenguaje (LLM) estudio empírico

Resumen:

Texto completo

Generative Artificial Intelligence (GenAI) chatbots continue to amaze users worldwide with their rapid improvements. These tools possess vast general knowledge and can thus be used in various fields, including education. However, before rolling out these models in pedagogical applications, it is fundamental to understand whether the information provided is reliable and if any of the currently available chatbots are best suited for domain-specific tasks. The objective of this study is to thoroughly investigate these aspects in a specific domain, fermentation, with the overarching goal of providing guidelines to students and teachers to select the best GenAI assistant. To achieve this goal,...

Ver ficha completa

Tipo: artículo

Metodología: estudio empírico

Temas: inteligencia artificial alfabetización en IA educación primaria y secundaria

Temas IA: IA y educación estudio empírico

Resumen:

Texto completo

The advent of artificial intelligence (AI) in the workplace is pressuring employees to learn how to harness this technology. The goal of promoting AI literacy is to equip educated citizens with the readiness to apply AI. The aim of this study is to provide evidence to guide the development of an AI Literacy Framework to prepare educated citizens to participate in future society. We report on a 14-h AI literacy course for senior secondary students, emphasising problem-solving competence development and adopting the project-based learning approach. One hundred and twenty-eight students completed the course, and a mixed-methods analysis was conducted to evaluate the results. A post-course test...

Ver ficha completa

Tipo: artículo

Metodología: estudio empírico

Temas: inteligencia artificial andamiaje/scaffolding chatbots

Temas IA: chatbots IA y aprendizaje estudio empírico

Resumen:

Texto completo

This study examines how generative AI can support middle school scientific inquiry in a rural agriculture-STEM classroom. Using a mixed-methods design with concurrent data collection and sequential analytic integration, we analyzed 42 eighth-grade students, organized into 12 groups, as they used Aspen, a custom AI chatbot, to revise scientific research questions and hypotheses around a sustainable agriculture problem. Data sources included group project journals, AI interaction logs, and peer discussion transcripts. First, a two-dimensional profiling method categorized the 12 groups into four analytic profiles: Struggling, Most Improved, Perfectionists, and High Achievers, based on initial...

Ver ficha completa

Tipo: artículo

Metodología: estudio empírico

Temas: inteligencia artificial alfabetización en IA educación primaria y secundaria

Temas IA: IA y educación estudio empírico

Resumen:

Texto completo

The majority of AI literacy studies have designed and developed self-reported questionnaires to assess AI learning and understanding. These studies assessed students' perceived AI capability rather than AI literacy because self-perceptions are seldom an accurate account of true measures. International assessment programs that use objective measures to assess science, mathematical, digital, and computational literacy back up this argument. Furthermore, because AI education research is still in its infancy, the current definition of AI literacy in the literature may not meet the needs of young students. Therefore, this study aims to develop and validate an AI literacy test for school students...

Ver ficha completa

Tipo: artículo

Metodología: estudio empírico

Temas: inteligencia artificial enseñanza en línea e híbrida creencias y actitudes de los estudiantes

Temas IA: IA y educación estudio empírico

Resumen:

Texto completo

This study investigates the application of machine learning and BERT models to identify topic categories in helpful online course reviews and uncover factors that influence the overall satisfaction of learners in massive open online courses (MOOCs). The research has three main objectives: (1) to assess the effectiveness of machine learning models in classifying review helpfulness, (2) to evaluate the performance of fine-tuned BERT models in identifying review topics, and (3) to explore the factors that influence learner satisfaction across various disciplines. The study uses a MOOC corpus containing 102,184 course reviews from 401 courses across 13 disciplines. The methodology involves...

Ver ficha completa

Tipo: artículo

Metodología: estudio empírico

Temas: inteligencia artificial ChatGPT creencias y actitudes de los profesores

Temas IA: IA y enseñanza-aprendizaje de lenguas chatGPT estudio empírico

Resumen:

Texto completo

Artificial intelligence-based educational technologies, especially ChatGPT-4o, have the potential to revolutionize education, and the adoption of these technologies is closely related to perceptual and emotional status of the users. The present study investigated the factors affecting the adoption of ChatGPT-4o by English language instructors in Turkey using Extended Technology Acceptance Model. Stratified sampling was used to select 30 universities in the “Social Sciences and Humanities-Language and Literature” category, with quality scores between 20 and 60. A total of 480 English Language Instructors employed at the Schools of Foreign Languages at these universities participated in the...

Ver ficha completa

Tipo: artículo

Metodología: estudio empírico

Temas: inteligencia artificial evaluación expresión escrita

Temas IA: IA y evaluación estudio empírico

Resumen:

Texto completo

The use of standardized test formats in the assessment of historical competencies has recently come under severe criticism, especially in the United States, where standardized tests are particularly common. History researchers have argued that open-ended items are more appropriate for assessment. However, providing largescale evaluations of open-ended answers is time consuming and poses challenges regarding the objectivity, validity, and replicability of ratings. To address this issue, we investigated the extent to which computer-based evaluation methods are suitable for evaluating student answers by combining qualitative methods from history education research with quantitative, computer-...

Ver ficha completa

Tipo: artículo

Metodología: estudio empírico

Temas: inteligencia artificial chatbots grandes modelos de lenguaje

Temas IA: chatbots IA y aprendizaje estudio empírico

Resumen:

Texto completo

Student engagement, widely recognised as a key determinant of learning outcomes, warrants greater attention to its antecedent mechanisms for effective learning design. As LLM-based chatbots (hereafter chatbot) are increasingly used to support student learning, understanding what drives student engagement in such environments becomes especially important. Guided by appraisal theory, this study proposes a theoretically grounded model of students' engagement in chatbot-supported learning. Unlike prior studies that focus on isolated antecedents, the model integrates learners’ capacity appraisals, including technology-related (GenAI competency) and task-related (academic self-efficacy)...

Ver ficha completa

Tipo: artículo

Metodología: estudio empírico

Temas: inteligencia artificial feedback/retroalimentación expresión escrita

Temas IA: IA y enseñanza-aprendizaje de lenguas IA y evaluación modelos de lenguaje (LLM)

Resumen:

Texto completo

Writing proficiency is an essential skill for upper secondary students that can be enhanced through effective feedback. Creating feedback on writing tasks, however, is time-intensive and presents a challenge for educators, often resulting in students receiving insufficient or no feedback. The advent of text-generating large language models (LLMs) offers a promising solution, namely, automated evidence-based feedback generation. Yet, empirical evidence from randomized controlled studies about the effectiveness of LLM-generated feedback is missing. To address this issue, the current study compared the effectiveness of LLM-generated feedback to no feedback. A sample of N = 459 upper secondary...

Ver ficha completa

Tipo: artículo

Metodología: estudio empírico

Temas: inteligencia artificial expresión escrita evaluación

Temas IA: IA y enseñanza-aprendizaje de lenguas IA y evaluación modelos de lenguaje (LLM)

Resumen:

Texto completo

Large language models have recently been proposed as tools for automated essay scoring, but their agreement with human grading remains unclear. In this work, we evaluate how LLM-generated scores compare with human grades and analyze the grading behavior of several models from the GPT and Llama families in an out-of-the-box setting, without task-specific training. Our results show that agreement between LLM and human scores remains relatively weak and varies with essay characteristics. In particular, compared to human raters, LLMs tend to assign higher scores to short or underdeveloped essays, while assigning lower scores to longer essays that contain minor grammatical or spelling errors. We...

Ver ficha completa