Tipo: artículo

Metodología: estudio empírico

Temas: inteligencia artificial integridad académica evaluación

Temas IA: IA y evaluación análisis de producción de IA ética de la IA

Resumen:

Texto completo

GPT detectors frequently misclassify non-native English writing as AI generated, raising concerns about fairness and robustness. Addressing the biases in these detectors is crucial to prevent the marginalization of non-native English speakers in evaluative and educational settings and to create a more equitable digital landscape.

El estudio comparó siete detectores de texto generado por IA con redacciones de estudiantes nativos y no nativos de inglés. Los detectores clasificaron como generadas por máquina más de la mitad de las redacciones del TOEFL escritas por estudiantes no nativos, mientras que acertaron casi siempre con las de estudiantes nativos. La causa es la menor «...

Ver ficha completa

Tipo: artículo

Metodología: estudio empírico

Temas: inteligencia artificial ChatGPT integridad académica

Temas IA: chatGPT IA y evaluación estudio empírico

Resumen:

This study investigates student responses to allegations of cheating using ChatGPT, a popular software platform capable of generating coherent text on various topics. Data comprising 49 Reddit posts and discussions between December 2022 and June 2023 were collected. Students shared their experiences, often asserting false accusations, and discussed strategies to navigate these situations. Thematic analysis identified five key themes: adopting a legalistic stance with argumentation and evidence; higher education's role as a societal gatekeeper; vicissitudes of trust in students vs. technology; questions of what constitutes cheating; and the need to rethink assessment. These findings will aid educators and institutions in crafting more meaningful assessments in the age of AI and establishing guidelines for student usage of ChatGPT and...

Ver ficha completa

Tipo: artículo

Metodología: estudio empírico

Temas: inteligencia artificial ChatGPT expresión escrita

Temas IA: chatGPT IA y aprendizaje estudio empírico

Resumen:

Texto completo

This study explores the neural and behavioral consequences of LLM-assisted essay writing. Participants were divided into three groups: LLM, Search Engine, and Brain-only (no tools). Each completed three sessions under the same condition. In a fourth session, LLM users were reassigned to Brain-only group (LLM-to-Brain), and Brain-only users were reassigned to LLM condition (Brain-to-LLM). A total of 54 participants took part in Sessions 1-3, with 18 completing session 4. We used electroencephalography (EEG) to assess cognitive load during essay writing, and analyzed essays using NLP, as well as scoring essays with the help from human teachers and an AI judge. Across groups, NERs, n-gram patterns, and topic ontology showed...

Ver ficha completa

Tipo: artículo

Metodología: estudio empírico

Temas: inteligencia artificial integridad académica evaluación

Temas IA: IA y evaluación análisis de producción de IA estudio empírico

Resumen:

Texto completo

This study investigates the efficacy of six major Generative AI (GenAI) text detectors when confronted with machine-generated content that has been modified using techniques designed to evade detection by these tools (n=805). The results demonstrate that the detectors' already low accuracy rates (39.5%) show major reductions in accuracy (17.4%) when faced with manipulated content, with some techniques proving more effective than others in evading detection. The accuracy limitations and the potential for false accusations demonstrate that these tools cannot currently be recommended for determining whether violations of academic integrity have occurred, underscoring the challenges educators face in maintaining inclusive and...

Ver ficha completa

Tipo: artículo

Metodología: estudio empírico

Temas: inteligencia artificial ética inclusión y equidad

Temas IA: ética de la IA IA y educación estudio empírico

Resumen:

Texto completo

While Artificial Intelligence in Education (AIED) research has at its core the desire to support student learning, experience from other AI domains suggest that such ethical intentions are not by themselves sufficient. There is also the need to consider explicitly issues such as fairness, accountability, transparency, bias, autonomy, agency, and inclusion. At a more general level, there is also a need to differentiate between doing ethical things and doing things ethically, to understand and to make pedagogical choices that are ethical, and to account for the ever-present possibility of unintended consequences. However, addressing these and related questions is far from trivial. As a first...

Ver ficha completa

Tipo: capítulo

Metodología: estudio empírico

Temas: inteligencia artificial feedback/retroalimentación metacognición

Temas IA: IA y evaluación IA y aprendizaje estudio empírico

Resumen:

Texto completo

Providing personalized, detailed feedback at scale in large undergraduate STEM courses remains a persistent challenge. We present an empirically evaluated practice exam system that integrates AI generated feedback with targeted textbook references, deployed in a large introductory biology course. Our system specifically aims to encourage metacognitive behavior by asking students to explain their answers and declare their confidence. It uses OpenAI's GPT-4o to generate personalized feedback based on this information, while directing them to relevant textbook sections. Through detailed interaction logs from consenting participants across three midterms (541, 342, and 413 students respectively), totaling 28,313 question-student...

Ver ficha completa

Tipo: artículo

Metodología: estudio empírico

Temas: inteligencia artificial formación de profesores creencias y actitudes de los profesores

Temas IA: IA y educación estudio empírico

Resumen:

Texto completo

The release of ChatGPT in November 2022 has sparked discussions about integrating Generative Artificial Intelligence (GenAI) into teacher education. Teacher educators, as key facilitators of pre-service teachers, play a critical role in determining the successful adoption of GenAI. Their perceptions guide curriculum redesign, define best practices, and shape pre-service teachers’ experiences with GenAI, potentially multiplying its impact across future classrooms. This mixed-methods study explored Danish teacher educators’ perceptions of GenAI (n = 91), focusing on its transformative potential, challenges, and the knowledge pre-service teachers need to acquire. The study employed innovative methods, including GenAI-enhanced...

Ver ficha completa

Tipo: artículo

Metodología: estudio empírico

Temas: inteligencia artificial ética creencias y actitudes de los profesores

Temas IA: ética de la IA estudio empírico

Resumen:

Texto completo

This study explores university educators’ perspectives on their alignment with artificial intelligence (AI) ethics, considering activity theory (AT), which forms the theoretical underpinning of this study. To do so, 37 educators from a higher education institution were selected to write their metaphors about AI ethics alignment, out of which 11 attended semi-structured interviews, in which they answered some questions about their AI ethics alignment and narrated some experiences. The study reveals diverse and often contradictory perspectives on AI ethics, highlighting a general lack of awareness and inconsistent application of ethical principles. Some educators...

Ver ficha completa

Tipo: artículo

Metodología: estudio empírico

Temas: inteligencia artificial ChatGPT expresión escrita

Temas IA: chatGPT IA y aprendizaje estudio empírico

Resumen:

Texto completo

The aim of this study is to uncover how students’ practices of writing in higher education are being impacted by ChatGPT. The use of ChatGPT and other generative AI needs to be set in the context of a longer-term process of the digitisation of writing, where many tools are being employed by students to support writing because it is a complex iterative process. Generative AI appears to have had a large impact on how students write, and we propose a model of generative AI literacy to assess their capabilities in doing so. Semi-structured interviews and observation data were collected at a British University with 23 students from diverse backgrounds, including the UK, USA, China, Japan, and Saudi Arabia....

Ver ficha completa

Tipo: artículo

Metodología: estudio empírico

Temas: inteligencia artificial integridad académica evaluación

Temas IA: IA y evaluación análisis de producción de IA estudio empírico

Resumen:

Texto completo

Recent advances in generative pre-trained transformer large language models have emphasised the potential risks of unfair use of artificial intelligence (AI) generated content in an academic environment and intensified efforts in searching for solutions to detect such content. The paper examines the general functionality of detection tools for AI-generated text and evaluates them based on accuracy and error type analysis. Specifically, the study seeks to answer research questions about whether existing detection tools can reliably differentiate between human-written text and ChatGPT-generated text, and whether machine translation and content obfuscation techniques affect the...

Ver ficha completa