Tipo: artículo

Metodología: estudio empírico

Temas: inteligencia artificial integridad académica evaluación

Temas IA: IA y evaluación análisis de producción de IA ética de la IA

Resumen:

Texto completo

GPT detectors frequently misclassify non-native English writing as AI generated, raising concerns about fairness and robustness. Addressing the biases in these detectors is crucial to prevent the marginalization of non-native English speakers in evaluative and educational settings and to create a more equitable digital landscape.

El estudio comparó siete detectores de texto generado por IA con redacciones de estudiantes nativos y no nativos de inglés. Los detectores clasificaron como generadas por máquina más de la mitad de las redacciones del TOEFL escritas por estudiantes no nativos, mientras que acertaron casi siempre con las de estudiantes nativos. La causa es la menor «...

Ver ficha completa

Tipo: artículo

Metodología: estudio empírico

Temas: inteligencia artificial integridad académica evaluación

Temas IA: IA y evaluación análisis de producción de IA estudio empírico

Resumen:

Texto completo

This study investigates the efficacy of six major Generative AI (GenAI) text detectors when confronted with machine-generated content that has been modified using techniques designed to evade detection by these tools (n=805). The results demonstrate that the detectors' already low accuracy rates (39.5%) show major reductions in accuracy (17.4%) when faced with manipulated content, with some techniques proving more effective than others in evading detection. The accuracy limitations and the potential for false accusations demonstrate that these tools cannot currently be recommended for determining whether violations of academic integrity have occurred, underscoring the challenges educators face in maintaining inclusive and...

Ver ficha completa

Tipo: artículo

Metodología: estudio empírico

Temas: inteligencia artificial integridad académica evaluación

Temas IA: IA y evaluación análisis de producción de IA estudio empírico

Resumen:

Texto completo

Recent advances in generative pre-trained transformer large language models have emphasised the potential risks of unfair use of artificial intelligence (AI) generated content in an academic environment and intensified efforts in searching for solutions to detect such content. The paper examines the general functionality of detection tools for AI-generated text and evaluates them based on accuracy and error type analysis. Specifically, the study seeks to answer research questions about whether existing detection tools can reliably differentiate between human-written text and ChatGPT-generated text, and whether machine translation and content obfuscation techniques affect the...

Ver ficha completa

Tipo: artículo

Metodología: trabajo teórico

Temas: inteligencia artificial metodología de investigación ética

Temas IA: análisis de producción de IA guía ética de la IA

Resumen:

Texto completo

El autor abre con una escena: un investigador comparte un audio o vídeo de siete minutos generado por IA sobre su último artículo; suena convincente y profesional, pero en esa narración fluida la IA ha convertido silenciosamente un «puede sugerir» en «demuestra», ha suprimido limitaciones cruciales y ha ampliado las conclusiones del estudio más allá de lo que sostienen los datos.

A partir de ahí propone dos listas de comprobación sencillas —una para público académico, con diez ítems, y otra para público general, con seis— que permiten al investigador verificar la exactitud de los resúmenes generados con IA antes de difundirlos, y dar a la audiencia transparencia...

Ver ficha completa

Tipo: artículo

Metodología: estudio empírico

Temas: inteligencia artificial metodología de investigación educación superior

Temas IA: análisis de producción de IA chatGPT ética de la IA

Resumen:

An analysis of academic citations and references generated by the ChatGPT artificial intelligence (AI) chatbot reveals the citations and references are in fact, fake. They are clearly generated by a predictive process rather than known facts. This suggests that early optimism regarding this technology for assisting in research could be misplaced, and that student misuse of the chatbot can be detected by the identification of fake citations and references. Despite these problems, the technology could have application in the writing of course materials for lower level undergraduate courses that do not necessarily require references. Subject matter expertise is required, however, to identify and remove incorrect information. The need to identify incorrect information provided by an AI chatbot is a skill that students...

Ver ficha completa

Tipo: artículo

Metodología: revisión bibliográfica

Temas: inteligencia artificial enseñanza/aprendizaje de lenguas adquisición de segundas lenguas

Temas IA: IA y enseñanza-aprendizaje de lenguas modelos de lenguaje (LLM) análisis de producción de IA

Resumen:

Texto completo

There are obvious benefits to integrating generative AI into language learning and teaching: using AI as a language tutor, creating learning materials, or assessing learner output. However, due to how AI systems understand human language —based on a mathematical model using statistical probability— they lack the lived experience to use language with the same social awareness as humans. Additionally, there are built-in linguistic and cultural biases based on training data which is mostly in English and predominantly from Western sources. Studies have clearly shown that systems such as ChatGPT often do not produce language that is pragmatically appropriate.

Ver ficha completa

Tipo: artículo

Metodología: estudio empírico

Temas: inteligencia artificial escritura académica expresión escrita

Temas IA: análisis de producción de IA chatGPT IA y enseñanza-aprendizaje de lenguas

Resumen:

ChatGPT has created considerable anxiety among teachers concerned that students might turn to large language models (LLMs) to write their assignments. Many of these models are able to create grammatically accurate and coherent texts, thus potentially enabling cheating and undermining literacy and critical thinking skills. This study seeks to explore the extent LLMs can mimic human-produced texts by comparing essays by ChatGPT and student writers. By analyzing 145 essays from each group, we focus on the way writers relate to their readers with respect to the positions they advance in their texts by examining the frequency and types of engagement markers. The findings reveal that student essays are significantly richer in the quantity and variety of engagement features, producing a more interactive and persuasive discourse. The ChatGPT-...

Ver ficha completa

Tipo: artículo

Metodología: estudio empírico

Temas: inteligencia artificial escritura académica expresión escrita

Temas IA: análisis de producción de IA chatGPT IA y enseñanza-aprendizaje de lenguas

Resumen:

The ability of ChatGPT to create grammatically accurate and coherent texts has generated considerable anxiety among those concerned that students might use such large language models (LLMs) to write their assignments. The extent to which LLMs can mimic human writers is starting to be explored, but we know little about their ability to use nominal resources to create effective academic texts. This study investigates metadiscursive nouns in argumentative essays, comparing how ChatGPT and university students employ these devices to organise text, express stance, and construct persuasive arguments. By analysing 145 essays from each source, we examine the syntactic patterns, interactive functions, and interactional uses of metadiscursive nouns. The analysis reveals that while overall frequencies were similar, ChatGPT has distinct...

Ver ficha completa

Tipo: artículo

Metodología: estudio empírico

Temas: inteligencia artificial escritura académica expresión escrita

Temas IA: análisis de producción de IA chatGPT IA y enseñanza-aprendizaje de lenguas

Resumen:

The rapid rise of ChatGPT has generated considerable anxiety among teachers concerned that students might turn to large language models to write their assignments. This AI-powered language model is able to create grammatically accurate and coherent texts, thus potentially enabling cheating and undermining literacy and critical thinking skills. While research has begun to examine linguistic and rhetorical differences between AI-generated and human-authored texts, far less is known about how large language models construct authorial stance, a central component of argumentative writing and a key indicator of academic literacy. This study compares stance markers in argumentative essays written by British undergraduates with those generated by ChatGPT on the same topics. Using a corpus-based approach grounded in an established stance...

Ver ficha completa

Tipo: artículo

Metodología: estudio empírico

Temas: inteligencia artificial escritura académica expresión escrita

Temas IA: IA y enseñanza-aprendizaje de lenguas análisis de producción de IA estudio empírico

Resumen:

Texto completo

The role of generative artificial intelligence (AI) in education has expanded significantly over recent years. AI-based text generators such as ChatGPT provide an accessible and effective tool for learners, particularly in academic writing. While revision is considered an essential part of both individual and collaborative writing, research on the revision of AI-generated texts remains limited. However, with the growing adoption of generative AI in education, learners’ ability to effectively revise AI-generated content is likely to become increasingly important in the future. The aim of this study was to investigate whether learners exhibit different revision behaviors when presented with...

Ver ficha completa