estudio empírico

Detalles Cerrar ✕

Tipo: artículo

Metodología: estudio empírico

Temas: inteligencia artificial alfabetización en IA educación superior

Temas IA: prompts IA y aprendizaje estudio empírico

Resumen:

Large language models (LLMs) are transforming higher education, yet their learning benefits likely depend on students’ AI literacy and how they prompt and verify AI outputs. This mixed-methods study investigates how AI literacy relates to prompting proficiency and verification behavior, and how these behaviors operate through two mechanisms, trust calibration and extraneous cognitive load, to predict coursework performance across two discipline–institution contexts in Thailand. The author surveyed Design students (n = 221) and Business students (n = 222) and analyzed the data using multigroup structural equation modeling, complemented by thematic analysis of semi-structured interviews....

Student and AI responses to physics problems examined through the lenses of sensemaking and mechanistic reasoning

Amogh Sirnoorkar, Dean Zollman, James T. Laverty (2024)

Detalles Cerrar ✕

Tipo: artículo

Metodología: estudio empírico

Temas: inteligencia artificial grandes modelos de lenguaje cognición y procesamiento

Temas IA: análisis de producción de IA estudio empírico

Resumen:

Several reports in education have called for transforming physics learning environments by promoting sensemaking of real-world scenarios in light of curricular ideas. Recent advancements in Generative-Artificial Intelligence have garnered increasing traction in educators' community by virtue of its potential to transform STEM learning. In this exploratory study, we adopt a mixed-methods approach in comparatively examining student- and AI-generated responses to two different formats of a physics problem through the theoretical lenses of sensemaking and mechanistic reasoning. The student data is derived from think-aloud interviews of introductory students and the AI data comes from ChatGPT's...

AI4Design: A generative AI-based system to improve creativity in design–A field evaluation

Luca Abrusci, Karma Dabaghi, Stefano D'Urso (2025)

Detalles Cerrar ✕

Tipo: artículo

Metodología: estudio empírico

Temas: inteligencia artificial educación superior tecnología educativa

Temas IA: IA y aprendizaje estudio empírico

Resumen:

Chatbots serve as valuable instruments for enhancing students' educational experience and aiding them in their day-to-day academic tasks. Advances in Generative AI (GAI) have ushered in increasingly sophisticated and adaptive chatbots, with ChatGPT and DALL⋅E being prime examples. ChatGPT excels at generating text-based answers across diverse areas of knowledge, while DALL⋅E is adept at converting text-based concepts into visual imagery. These technologies are increasingly used by students across various levels of education. In this study, we introduce AI4Design, a web-based system designed to assist design students with their course projects by acting as an intelligent chatbot. The field...

Effects of adaptive feedback generated by a large language model: A case study in teacher education

Annette Kinder, Fiona J. Briese, Marius Jacobs (2025)

Detalles Cerrar ✕

Tipo: artículo

Metodología: estudio empírico

Temas: inteligencia artificial feedback/retroalimentación grandes modelos de lenguaje

Temas IA: IA y evaluación modelos de lenguaje (LLM) chatGPT

Resumen:

This study investigates the effects of adaptive feedback generated by large language models (LLMs), specifically ChatGPT, on performance in a written diagnostic reasoning task among German pre-service teachers (n = 269). Additionally, the study analyzed user evaluations of the feedback and feedback processing time. Diagnostic reasoning, a critical skill for making informed pedagogical decisions, was assessed through a writing task integrated into a teacher preparation course. Participants were randomly assigned to receive either adaptive feedback generated by ChatGPT or static feedback prepared in advance by a human expert, which was identical for all participants in that condition, before...

Designing a generative AI enabled learning environment for mathematics word problem solving in primary schools: Learning performance, attitudes and interaction

Jingxi Liu, Daner Sun, Jin Sun (2025)

Detalles Cerrar ✕

Tipo: artículo

Metodología: estudio empírico

Temas: inteligencia artificial ChatGPT educación primaria y secundaria

Temas IA: chatGPT IA y aprendizaje estudio empírico

Resumen:

Mathematics word problem solving is a critical component of elementary education, yet many students encounter persistent difficulties in this area due to the combined cognitive demands of linguistic comprehension and mathematical reasoning. While previous studies have explored various pedagogical strategies to enhance problem-solving skills, the integration of generative artificial intelligence (GenAI) in this domain remains underexplored. This study introduces the ChatGPT-supported Mathematics Problem-Solving System (ChatGPT-MPS), a GenAI-enabled learning environment designed to support primary students in developing problem-solving strategies and deepening conceptual understanding. To...

Predictive capability of foundational concepts tests for problem-solving using machine learning concepts: Evaluating project-based learning courses in artificial intelligence literacy education

Siu-Cheung Kong, Chunyu Hou (2025)

Detalles Cerrar ✕

Tipo: artículo

Metodología: estudio empírico

Temas: inteligencia artificial alfabetización en IA aprendizaje basado en proyectos

Temas IA: IA y educación estudio empírico

Resumen:

In the artificial intelligence (AI) era, secondary and university students should be able to apply AI for problem-solving. This study designed and evaluated an AI literacy programme to enhance understanding of machine learning concepts. It also examined how the conceptual understanding from two foundational courses (Courses 1 and 2) affected students' application of these concepts in the subsequent two project-based learning courses (Courses 3 and 4). The regression analysis of data from 566, 566, 470, and 196 student participants enrolled on Courses 1, 2, 3, and 4, respectively, revealed that the post-course concept tests for Courses 1 and 2 accounted for 19.9 % of the variance in the...

An AI-enhanced pattern recognition approach to temporal and spatial analysis of children's embodied interactions

Ceren Ocak, Theodore J. Kopcha, Raunak Dey (2023)

Detalles Cerrar ✕

Tipo: artículo

Metodología: estudio empírico

Temas: inteligencia artificial pensamiento computacional multimodalidad

Temas IA: IA y educación estudio empírico

Resumen:

Multimodal video analysis is a complex and time-consuming process for a researcher; it entails capturing, watching, and re-watching video data to identify which segments best inform or address the questions that drive the research. Modern AI applications can alleviate the challenges that arise during the fine-grained analysis of learners' multimodal interactions captured through video. In this study, we present a supervised approach to training a deep neural network to analyze children's computational thinking (CT) captured through multimodal video data. The approach first uses a set of images extracted from video data to train the AI to map them to labels generated using a priori theory....

Validating AI-generated classroom observations: Reliability, accuracy, and limits of LLM-based pedagogical judgment

Carolina Melo, Javiera de la Maza, Matías Recabarren (2026)

Detalles Cerrar ✕

Tipo: artículo

Metodología: estudio empírico

Temas: inteligencia artificial grandes modelos de lenguaje práctica docente

Temas IA: modelos de lenguaje (LLM) análisis de producción de IA estudio empírico

Resumen:

This study examines the reliability and accuracy of large language models (LLMs) for automated classroom observation using the World Bank's TEACH Primary framework. As education systems increasingly explore AI-based tools to scale teacher feedback and professional development, empirical validation of these systems is critical. Using a corpus of 12 primary classroom videos, we compared 8618 AI-generated evaluations from eight LLM endpoints against consensus-based ratings from certified TEACH experts. To account for model stochasticity, each model produced 10 independent evaluations per video–element pair. Reliability was assessed using variability and inter-rater consistency indicators,...

Reinventing assessments with ChatGPT and other online tools: Opportunities for GenAI-empowered assessment practices

Dennis Foung, Linda Lin, Julia Chen (2024)

Detalles Cerrar ✕

Tipo: artículo

Metodología: estudio empírico

Temas: inteligencia artificial evaluación ChatGPT

Temas IA: IA y enseñanza-aprendizaje de lenguas IA y evaluación chatGPT

Resumen:

The recent emergence of generative artificial intelligence (GenAI) tools, such as ChatGPT, has brought profound changes to higher education. While many studies have examined the potential use of ChatGPT in teaching and learning, few have explored the opportunities to develop assessments that facilitate the use of multiple technological innovations (i.e. traditional AI and GenAI tools). We conducted qualitative research to address this gap. The assessments of an elective English course in Hong Kong were re-designed to incorporate GenAI and other tools. Students were asked to employ and reflect on their use of these tools for their writing assessments. We analyzed the written reflections of...

Fostering student competencies and perceptions through artificial intelligence of things educational platform

Sasithorn Chookaew, Pornchai Kitcharoen, Suppachai Howimanporn (2024)

Detalles Cerrar ✕

Tipo: artículo

Metodología: estudio empírico

Temas: inteligencia artificial alfabetización en IA educación superior

Temas IA: IA y educación estudio empírico

Resumen:

The growing demand for artificial intelligence (AI) skills across various sectors has enhanced AI-focused careers and shaped academic exploration in educational institutions. These institutions have been actively developing teaching methods that enhance practical AI applications, particularly through integrating AI with the Internet of Things (IoT), leading to the emergence of the Artificial Intelligence of Things (AIoT). This convergence promises significant advancements in AI education, addressing gaps in structured learning methods for AIoT. This study explored AIoT's application in Smart Farming (SF) and its potential to enrich AI education and sectoral advancements. The AIoT platform...