While definitively determining if content was generated by a human or an AI, there are trends in AI writing that can suggest a paper was written using ChatGPT or other generative AI software:
Language Patterns and Style: AI-generated content might exhibit certain language patterns, style, or inconsistencies that are unusual for human authors. Look for unnatural phrasing, lack of personal experiences, or overly coherent and incoherent language.
Inadequate Citations and References: AI-generated papers may lack proper citations or references to existing literature. They might reference obscure sources or mix up unrelated concepts.
Unusual References: Check for references to non-existent authors or publications that don't align with the field's established literature.
Inconsistent Argumentation: AI-generated content might present arguments that are not well-connected or logically consistent. It might lack depth and critical thinking.
Sudden Changes in Style or Tone: AI models can sometimes produce text that abruptly changes in style, tone, or level of expertise.
Use of Niche Jargon: AI-generated content might misuse or overuse field-specific jargon in an attempt to appear knowledgeable.
Use of Uncommon Topics: Sometimes AI-generated content might focus on topics that are uncommon or unrelated to the field, suggesting a lack of contextual understanding.
Plagiarism Detection Tools: Some AI-generated content might be derived from existing human-written papers or sources. Using plagiarism detection tools can help identify such instances.
Overall, AI-generated content often gives an impression of someone who wrote very confidently about a topic that they just didn't get.
Your strongest tools is your relationship with your students. Speak with your students about their writing habits.
Here are some popular tools used to detect AI and their limitations:
Since Many of the automated AI detection tools are prone to false positives, consider teaching some of the following options to help your students protect themselves in the event of a false positive.