Tipo: artículo

Metodología: estudio empírico

Temas: inteligencia artificial

Resumen:

Texto completo

To address the complexity and high costs of developing listening tests for test-takers of varying proficiency levels, this study investigates the capabilities of an OpenAI's large language model, ChatGPT 4, in developing listening assessments. Employing prompt engineering and fine-tuning of prompts, the study specifically focuses on creating listening scripts and test items using ChatGPT 4 for test-takers across a spectrum of proficiency levels (academic, low, intermediate, and advanced). For comparability, the 24 topics of these scripts were selected from topics found in academic listening tests. We conducted two types of analyses to evaluate the quality of the output. First, we performed...

Ver ficha completa

Tipo: artículo

Metodología: estudio empírico

Temas: inteligencia artificial

Resumen:

Texto completo

Integrating mathematical modelling into school curricula is essential for connecting school mathematics with real-world applications. However, teachers often lack the time and resources to design high-quality modelling tasks. While generative artificial intelligence (GenAI) can rapidly produce educational content, existing tools typically generate conventional word problems or routine mathematics exercises rather than resources that foster modelling competencies. This study reports on the design and evaluation of an AI-powered platform that generates mathematical modelling problems and associated pedagogical recommendations grounded in established design principles and retrieval-augmented...

Ver ficha completa

Tipo: artículo

Metodología: estudio empírico

Temas: inteligencia artificial

Resumen:

Texto completo

Not much is known about how LLM-generated questions compare to gold-standard, traditional formative assessments concerning their difficulty and discrimination parameters, which are valued properties in the psychometric measurement field. We follow a rigorous measurement methodology to compare a set of ChatGPT-generated questions, produced from one lesson summary in a textbook, to existing questions from a published Creative Commons textbook. To do this, we collected and analyzed responses from 207 test respondents who answered questions from both item pools and used a linking methodology to compare IRT properties between the two pools. We find that neither the difficulty nor discrimination...

Ver ficha completa

Tipo: artículo

Metodología: trabajo teórico

Temas: inteligencia artificial

Resumen:

Texto completo

Engaging students in creating novel content, also referred to as learnersourcing, is increasingly recognised as an effective approach to promoting higher-order learning, deeply engaging students with course material and developing large repositories of content suitable for personalised learning. Despite these benefits, some common concerns and criticisms are associated with learnersourcing (e.g., the quality of resources created by students, challenges in incentivising engagement and lack of availability of reliable learnersourcing systems), which have limited its adoption. This paper presents a framework that considers the existing learnersourcing literature, the latest insights from the...

Ver ficha completa

Tipo: artículo

Metodología: estudio empírico

Temas: inteligencia artificial

Resumen:

Texto completo

The application of learning sciences with technology has been shown to boost learner interactions, yet the potential of advanced tool, particularly those that leverage Natural Language Processing (NLP), still very much untapped in learning contexts. This paper speaks to this age-old problem of generating quality Multiple-Choice questions (MCQs) – a prevalent but time-consuming mode of assessment – via the suggested comprehensive comparison study of template-based AI solutions. The study contrasts general-purpose Large Language Models (LLMs) with specialized MCQ-focused AI programs. The scientific approach employed was quite stringent, where each of the software applications was benchmarked...

Ver ficha completa

Tipo: artículo

Metodología: estudio empírico

Temas: inteligencia artificial

Resumen:

Texto completo

Classroom teachers are usually responsible for creating materials to meet students' needs and course requirements. The arrival of generative AI, such as ChatGPT, offers EFL teachers an opportunity to regularly collaborate with AI chatbots to create new source materials. The writing experiments in this study considered how to effectively and ethically work with generative AI to produce culturally appropriate EFL teaching materials. The experiments involved co-producing moral dilemmatic stories with ChatGPT to support a new Chinese EFL curriculum unit on “Morals and Virtues”. We draw on Lo's (2023a, 2023b) CLEAR framework for prompt engineering to generate appropriate stimulus materials. We...

Ver ficha completa

Tipo: artículo

Metodología: estudio empírico

Temas: inteligencia artificial

Resumen:

Texto completo

A persistent challenge in drone-based STEM education is the scarcity of teacher-verified, interactive simulations that support both conceptual learning and competency development. Generative AI can accelerate content creation, but its outputs frequently lack pedagogical validity and contextual alignment. This study examines whether simulation-assisted drone instruction, anchored by teacher-AI co-designed simulations, yields superior learning outcomes compared to the same hands-on curriculum delivered without simulations. Using a quasi-experimental pretest–posttest design with 30 secondary students (aged 13 to 17), both groups completed identical drone tasks with the same instructor; however...

Ver ficha completa

Tipo: artículo

Metodología: estudio empírico

Temas: inteligencia artificial

Resumen:

Texto completo

Large language models (LLMs) like ChatGPT have shown promise in generating educational content, including questions. This study evaluates the effectiveness of LLMs in classifying and generating educational-type questions. We assessed ChatGPT's performance using a dataset of 4,959 user-generated questions labeled into ten categories, employing various prompting techniques and aggregating results with a voting method to enhance robustness. Additionally, we evaluated ChatGPT's accuracy in generating type-specific questions from 100 reading sections sourced from five online textbooks, which were manually reviewed by human evaluators. We also generated questions based on learning objectives and...

Ver ficha completa

Tipo: artículo

Metodología: estudio empírico

Temas: inteligencia artificial

Resumen:

Texto completo

English grammar multiple-choice questions (MCQs) can be automatically generated to reduce preparation time. Previous studies have focused on semiautomated methods based on the transformation of human-made sentences/articles into MCQs, owing to which the number of generated questions is dependent on the size of a given text corpus. This study proposes an artificial intelligence-assisted MCQ generation system that increases the number of generable questions using controllable text generation techniques. In this system, the questions for MCQs are generated using a text generation model trained using the Text-to-Text Transfer Transformer (T5) architecture, a powerful deep learning model for...

Ver ficha completa

Tipo: artículo

Metodología: estudio empírico

Temas: inteligencia artificial

Resumen:

Texto completo

As educators begin using Generative AI (GenAI) for lesson planning, they often encounter generated content that fails to consider the classroom's cultural context. In this study, we address this issue by adopting a design science research approach to develop a theory-based prompt grounded in culturally responsive pedagogy (CRP) and using it to customize a Culturally Responsive Lesson Planner (CRLP) GPT. Guided by the CRP framework, the CRLP uses an Interactive Semi-Automated (ISA) prompt architecture that engages teachers in dialogue to collect cultural and contextual details before generating a lesson plan. To evaluate the CRLP's effectiveness, we asked two expert reviewers to compare...

Ver ficha completa