Demo of TurnItIn - New AI Detection Tool

Sarah Moore, Ph.D.
4 Apr 202303:12

TLDRDr. Moore from the University of Texas at Dallas discusses Turnitin's new AI detection tool. He tests the tool by having Chat GPT write a memo on AI writers, which Turnitin flags as 100% AI-written. The tool also provides a similarity score of 45%, indicating matches with previously uploaded content. Dr. Moore highlights the importance of reviewing sources and warns that using AI to complete assignments is considered cheating at his university. He suggests that educators may need to adapt their rubrics and assignments to address this new challenge.

Takeaways

  • 📚 Dr. Moore from the University of Texas at Dallas discusses Turnitin's new AI detection tool.
  • 🔍 Dr. Moore tested the AI tool by having Chat GPT write a memo comparing AI writers.
  • 📄 The memo created by Chat GPT was uploaded to Turnitin and received a similarity score of 45%.
  • 🔎 Turnitin did not flag the memo as problematic, indicating a match with previously uploaded content.
  • 🚨 Turnitin introduced an 'AI 100' flag, warning that the similarity score may not indicate academic misconduct and review is required.
  • 📝 The AI-written essay was correctly identified as 100% AI-generated by Turnitin.
  • 🔍 The AI tool did not flag the sources included in the memo, but it did flag other phrases.
  • 📈 Turnitin's new AI detection seems effective and may change how faculty approach grading and assignment design.
  • 🚫 At the University of Texas at Dallas, using Chat GPT to complete assignments is considered unauthorized and could be seen as cheating.
  • 📝 Dr. Moore suggests that students' original writing is generally better and more interesting than AI-generated content.
  • 🎥 The video aims to inform faculty and students about the capabilities and implications of Turnitin's AI detection tool.

Q & A

  • What is the main topic of Dr. Moore's video?

    -The main topic is Turnitin's new AI detection tool and its effectiveness in identifying AI-generated content in student assignments.

  • How did Dr. Moore simulate a student's use of AI writers?

    -Dr. Moore used a standard essay assignment prompt, asked Chat GPT to write a memo comparing three AI writers, and included sources as instructed.

  • What was the similarity score given by Turnitin for the AI-generated memo?

    -The similarity score given by Turnitin for the AI-generated memo was 45.

  • What does the 45 similarity score represent?

    -The 45 score represents the match in the document to things already uploaded to Turnitin, not necessarily indicating academic misconduct.

  • What new feature did Turnitin introduce to flag AI-generated content?

    -Turnitin introduced an 'AI 100' flag with a caution message stating that the percentage may not indicate academic misconduct and that a review is required.

  • How did Turnitin handle the sources included in the AI-generated memo?

    -Turnitin did not flag the sources included in the AI-generated memo, but it did flag other phrases, indicating new and different content.

  • What is the significance of the 'AI 100' flag in Turnitin's report?

    -The 'AI 100' flag indicates that the content is entirely AI-generated, and it prompts faculty to review the document for potential academic misconduct.

  • What is the policy of the University of Texas at Dallas regarding the use of AI writers for assignments?

    -The use of AI writers like Chat GPT is considered unauthorized and can be treated as cheating if reported.

  • What does Dr. Moore suggest about the quality of the AI-generated essay?

    -Dr. Moore suggests that the AI-generated essay lacks quality, does not include a conclusion, and is generally not as good as what students could write themselves.

  • What advice does Dr. Moore give to faculty regarding the new AI detection tool?

    -Dr. Moore advises faculty to be aware of the tool's capabilities, consider changing rubrics and assignments, and remain vigilant about the quality of student writing.

  • How can faculty use Turnitin's new AI detection tool effectively?

    -Faculty should use the tool to identify AI-generated content, review flagged documents, and adapt their teaching strategies to encourage original student work.

Outlines

00:00

📚 Introduction to Turnitin's AI Detection Tool

Dr. Moore introduces Turnitin's new AI detection tool and shares his experience as a faculty member at the University of Texas at Dallas. He describes how he used the tool by imagining himself as a student in need and utilizing Chat GPT to write a memo comparing AI writers. He explains the process of uploading the generated memo to Turnitin and the resulting similarity score of 45, which indicates a match with previously uploaded content.

🔍 Turnitin's AI Detection Process and Results

Dr. Moore delves into the details of Turnitin's AI detection process, highlighting the tool's ability to identify AI-generated content. He notes that the tool flagged his memo as 100% AI-written, which is a new feature that differentiates it from traditional similarity scores. He also mentions that the sources included in the memo were not flagged, but other phrases were, indicating areas of concern for academic misconduct. Dr. Moore emphasizes the importance of reviewing these flagged areas and adjusting grading strategies accordingly.

🚨 Implications for Faculty and Students

Dr. Moore discusses the implications of the AI detection tool for faculty and students. He warns that using Chat GPT to complete assignments is considered unauthorized at his university and could be treated as cheating. He advises students to focus on improving their own writing skills, as the AI-generated essay lacks the quality and depth expected in academic writing. Dr. Moore concludes by expressing his hope that the video was helpful and wishes his audience good luck.

Mindmap

Keywords

💡Turnitin

Turnitin is a plagiarism detection software widely used in academic institutions to check the originality of student submissions. In the video, it is highlighted as a tool that has been updated with AI detection capabilities to identify essays potentially written by AI writers. The script mentions Turnitin's new feature that flags documents with a high similarity score, indicating potential academic misconduct.

💡AI Detection Tool

This refers to the advanced feature in Turnitin that uses artificial intelligence to detect and flag essays that may have been generated by AI writers. The video demonstrates how this tool can identify content that is 100% AI-written, which is a significant advancement in combating academic dishonesty. The AI detection tool is shown to be effective in identifying essays copied from chat GPT, a hypothetical AI writing service mentioned in the script.

💡Chat GPT

Chat GPT is mentioned as a hypothetical AI writing service that can generate essays. In the context of the video, it represents the kind of technology that students might use to complete assignments, which could be considered cheating. The video's narrator uses Chat GPT to create a memo for a test, which is then analyzed by Turnitin's AI detection tool.

💡Plagiarism

Plagiarism is the act of using someone else's work, ideas, or words without giving proper credit or permission. In the video, the concern is that students might use AI writing tools like Chat GPT to produce essays, which would be a form of plagiarism. The video emphasizes the importance of original work and the potential consequences of academic dishonesty.

💡Academic Misconduct

Academic misconduct refers to any form of dishonesty or unethical behavior in an academic setting, such as cheating, plagiarism, or fabrication. The video discusses how Turnitin's AI detection tool can help identify instances of academic misconduct by flagging essays that are entirely AI-generated, which is considered unauthorized assistance in completing assignments.

💡Rubrics

Rubrics are assessment tools used by educators to evaluate student work against a set of criteria or standards. The video suggests that faculty might need to reconsider or modify their rubrics in light of the new AI detection capabilities to ensure that assignments remain challenging and promote original thinking and writing skills.

💡Assignments

Assignments are tasks given to students by educators to assess their understanding and application of course material. The video implies that the use of AI writing tools may necessitate changes in the types of assignments given to students to prevent cheating and encourage genuine academic engagement.

💡Memo

A memo, or memorandum, is a written communication typically used in a business or organizational context. In the video, the narrator uses Chat GPT to generate a memo comparing AI writers, which serves as an example of how AI can be misused to complete academic assignments.

💡Sources

In academic writing, sources are the materials or references used to support arguments or provide information. The video mentions that Turnitin flagged the AI-generated memo for its sources, indicating that the tool can also identify potential issues with the credibility of cited materials.

💡Cheating

Cheating in an academic context refers to the act of attempting to achieve better grades or results through dishonest means. The video warns that using AI writing tools to complete assignments is considered cheating at the narrator's university and could lead to disciplinary action.

💡Writing Skills

Writing skills encompass the abilities to effectively communicate ideas in written form. The video emphasizes the importance of developing and showcasing students' own writing skills, rather than relying on AI-generated content, to produce high-quality, original work.

Highlights

Dr. Moore from the University of Texas at Dallas discusses Turnitin's new AI detection tool.

The AI tool can detect essays written by AI writers like Chat GPT.

Dr. Moore tested the tool by having Chat GPT write a memo comparing AI writers.

Turnitin gave the AI-written memo a similarity score of 45%.

The 45% score represents matches to previously uploaded content.

Turnitin flagged the memo with a caution, indicating a 100% AI-written content.

The tool did not flag the actual sources used in the memo.

At the university, using Chat GPT to complete assignments is considered unauthorized and can be seen as cheating.

The AI-written essay lacked a conclusion and was not as engaging as student-written work.

Dr. Moore suggests that faculty may need to adjust their rubrics and assignments in response to AI writing tools.

The video aims to inform faculty about the capabilities of Turnitin's AI detection tool.

The tool is expected to catch instances of academic dishonesty that Turnitin has not caught before.

Dr. Moore emphasizes the importance of original student writing over AI-generated content.

The video serves as a guide for faculty on how to use Turnitin's new AI detection feature effectively.