Tipo: artículo

Metodología: estudio empírico

Temas: inteligencia artificial

Resumen:

Texto completo

Researchers have sought for decades to automate holistic essay scoring. Over the years, these programs have improved significantly. However, accuracy requires significant amounts of training on human-scored texts—reducing the expediency and usefulness of such programs for routine uses by teachers across the nation on non-standardized prompts. This study analyzes the output of multiple versions of ChatGPT scoring of secondary student essays from three extant corpora and compares it to quality human ratings. We find that the current iteration of ChatGPT scoring is not statistically significantly different from human scoring; substantial agreement with humans is achievable and may be...

Ver ficha completa

Tipo: artículo

Metodología: revisión bibliográfica

Temas: inteligencia artificial

Resumen:

Texto completo

ChatGPT has gained substantial attention in the field of higher education, particularly for its potential to enhance undergraduate students' learning outcomes. To better understand ChatGPT's impact, we conducted a meta-analysis evaluating the effects of ChatGPT applications on undergraduate students' learning outcomes, with data collected from studies published between January 1st, 2023, and May 31st, 2025. Our search across nine academic databases identified 5555 potential studies, of which 66 met the pre-defined inclusion criteria and were selected for meta-analysis. The meta-analysis incorporated 129 effect sizes, allowing us to estimate the overall impact of ChatGPT on undergraduate...

Ver ficha completa

Tipo: artículo

Metodología: estudio empírico

Temas: inteligencia artificial

Resumen:

Texto completo

In recent months, Artificial Intelligence (AI) has had, and will continue to have, a dramatic impact on Higher Education (HE). A study conducted by researchers at a leading university in Australia surveyed 30 of their teaching staff, drawn predominantly from their teaching academy, and interviewed eight of them regarding the impact of AI on HE. Data were analyzed using the procedures of Inductive Thematic Analysis and revealed a lack of any homogenous sentiment around AI in HE and much ambiguity regarding best practice regarding recent technological developments. The results indicate concerns exist around concepts relating to academic integrity, however, these concerns may be exaggerated....

Ver ficha completa

Tipo: artículo

Metodología: estudio empírico

Temas: inteligencia artificial

Resumen:

Texto completo

As educators begin using Generative AI (GenAI) for lesson planning, they often encounter generated content that fails to consider the classroom's cultural context. In this study, we address this issue by adopting a design science research approach to develop a theory-based prompt grounded in culturally responsive pedagogy (CRP) and using it to customize a Culturally Responsive Lesson Planner (CRLP) GPT. Guided by the CRP framework, the CRLP uses an Interactive Semi-Automated (ISA) prompt architecture that engages teachers in dialogue to collect cultural and contextual details before generating a lesson plan. To evaluate the CRLP's effectiveness, we asked two expert reviewers to compare...

Ver ficha completa

Tipo: artículo

Metodología: estudio empírico

Temas: inteligencia artificial

Resumen:

Texto completo

Personality traits and educational technology may affect how well students utilise their abilities and strategies to achieve their learning objectives and potential. As generative artificial intelligence (GenAI) is creating new learning experiences, understanding the impact of five representative personality traits on students' self-regulated learning (SRL) while learning with GenAI tools can help to predict which personality traits indicate better self-regulation when learning with this innovative educational technology. Such a prediction can help educators to design effective learning activities by providing educational experiences that cater to students' different personality traits for...

Ver ficha completa

Tipo: artículo

Metodología: estudio empírico

Temas: inteligencia artificial

Resumen:

Texto completo

Not much is known about how LLM-generated questions compare to gold-standard, traditional formative assessments concerning their difficulty and discrimination parameters, which are valued properties in the psychometric measurement field. We follow a rigorous measurement methodology to compare a set of ChatGPT-generated questions, produced from one lesson summary in a textbook, to existing questions from a published Creative Commons textbook. To do this, we collected and analyzed responses from 207 test respondents who answered questions from both item pools and used a linking methodology to compare IRT properties between the two pools. We find that neither the difficulty nor discrimination...

Ver ficha completa

Tipo: artículo

Metodología: estudio empírico

Temas: inteligencia artificial

Resumen:

Texto completo

The public release of ChatGPT in November 2022 ignited an intense debate about the effects generative AI (GAI) tools will have on language teaching. The advanced capability of GAI tools and their rapid uptake by students has brought both challenges and opportunities to language teachers. This qualitative study, using in-depth individual and group interviews with ten beginning teachers and seventeen first-year English language teachers, explored their readiness for using GAI tools in their professional work and their perceptions of GAI in language teaching. The study found that first-year teachers were generally ready for the use of GAI tools and could recognize its potential to support...

Ver ficha completa

Tipo: artículo

Metodología: estudio empírico

Temas: inteligencia artificial

Resumen:

Texto completo

Students and researchers are increasingly relying on ChatGPT as a tool to search for information, generate content, make translations and offer research support. This study employs nine variables derived from the Technology Acceptance Model to evaluate whether the variables can predict ChatGPT use among university students in the Philippines. To achieve this, a survey was carried out. Data was collected from 340 students across various faculties of a university. The data were analyzed with structural equation modeling (SEM). The model predicts that the nine variables that reflect students' perceptions towards ChatGPT, are indirectly or directly related to the students' use of ChatGPT. The...

Ver ficha completa

Tipo: artículo

Metodología: estudio empírico

Temas: inteligencia artificial

Resumen:

Texto completo

AI tools such as ChatGPT are used in the higher education increasingly yet the limited empirical evidence explains how the students incorporate these tools into their academic work. This study examines how students’ perceptions and demographic characteristics relate to their intended use of ChatGPT academically. The study focuses on understanding the educational meaning rather than maximizing the algorithmic performance. The survey data were collected from 166 university students for this purpose. It is analyzed to identify the key learning related constructs associated with ChatGPT use. An exploratory machine learning (ML) framework was applied to examine the relationships among these...

Ver ficha completa

Tipo: artículo

Metodología: estudio empírico

Temas: inteligencia artificial

Resumen:

Texto completo

Background: ChatGPT, a powerful artificial intelligence chatbot, has great potential for active learning because of its ability to generate instant responses to academic inquiries and foster spontaneous interactions. Purpose: This exploratory study investigated the roles of intrinsic motivation and factors of the technology acceptance model that influence ChatGPT acceptance for active learning among undergraduates in Hong Kong. Method: Using a structural equation modeling approach, we examined the extended technology acceptance model in the context of higher education. Using self-report questionnaires, we obtained useful responses from 473 undergraduate students in Hong Kong in July 2023....

Ver ficha completa