Evaluating AI Writers With Originality.ai - An Accurate GPT-3 Detector

Table of Contents

• Introduction - Originality.ai Claims Accurate GPT-3 Detection
• Running My Own Experiments With Originality.ai
• The Implications - An Important New Metric
• Try Out Originality.ai Yourself
• Conclusion - An Exciting New Tool for AI Analysis

Introduction - Originality.ai Claims Accurate GPT-3 Detection

I was about to go to bed when I received a surprising email about a new software called Originality.ai that claims to accurately detect GPT-3 generated content. As someone who evaluates different AI writers against metrics like SEO, word count, and plagiarism, I was instantly intrigued by the ability to now test for GPT-3 as well.

Originality.ai seems to leverage advanced deep learning models to analyze text and determine the probability it was generated by GPT-3. Since GPT-3 powers many popular AI writing tools today, this could be a game-changer for my research.

The Origin Story - An Unexpected Email

The email I received out of the blue introduced Originality.ai and its purported GPT-3 detection capabilities. My interest was instantly piqued, given my work analyzing AI writing quality. I signed up for Originality.ai to get first-hand experience with their analysis and see if it lives up to its claims.

Taking a Closer Look at Originality.ai

Originality.ai seems to use advanced deep learning and NLP models to analyze text and estimate the probability it was generated by GPT-3. They provide detailed information on their methodology, including an academic paper outlining their approach and experiments.

Research Shows Different AI Probability Scores

Originality.ai's research shows different AI writers have varying GPT-3 probability scores based on their analysis. For example, Jasper scored around 80%, while competitors like Rytr and Article Forge scored 99-100%. Having tangible GPT-3 probability metrics could really enhance my ongoing AI quality research, which currently relies on more manual analysis.

Running My Own Experiments With Originality.ai

Intrigued by their claims, I decided to run my own experiments with Originality.ai to see how well it detected GPT-3 content.

The results seemed very accurate based on passages I knew were 100% human-written or straight GPT-3 generated.

Testing Unedited AI Content - 98% GPT-3 Detected

The first passage I tested was raw GPT-3 output that I did not edit at all. Originality.ai correctly detected a 98% probability it was AI-generated. This gave me confidence in its ability to identify unmodified GPT-3 content.

Edited AI Content - 34% GPT-3 Detected

I then tested content that had significant human editing of the original GPT-3 draft. Here, Originality.ai detected a 34% GPT-3 probability. The lower score aligns with my manual assessment that the content was now more human-like after editing.

100% Original Human-Written Content - 1% GPT-3

As a final test, I analyzed 100% human-written content from my site that did not utilize AI. Here, Originality.ai correctly scored just a 1% GPT-3 probability. This gave me further confidence in its accuracy at distinguishing human vs. AI writing.

The Implications - An Important New Metric

Based on my initial experiments, incorporating GPT-3 probability scores from Originality.ai could really enhance my broader AI analysis and benchmarks.

It provides an important new metric beyond just subjective quality analysis to quantify AI content.

Incorporating AI Detection Into My Research

Moving forward, I plan to run all content through Originality.ai to generate GPT-3 probability scores. I can then factor this into my overall benchmarks and ratings for different AI writing tools.

The Future - GPT-4 and Beyond

While the focus now is on detecting GPT-3, advances like GPT-4 are around the corner. However, capabilities like Originality.ai's will likely adapt to identify new AI models as well. For now, having GPT-3 detection provides a huge head start on quantifying AI content vs human writing.

Try Out Originality.ai Yourself

If you're interested to try out Originality.ai's GPT-3 detection capabilities yourself, they currently have promotional credits available to get started affordably.

I'm also happy to run any content through Originality.ai and share the results if you'd like additional datapoints.

Cheap Credits Available Now

Originality.ai seems to be running a promotion currently where you can get 2,000 analysis credits for just $5 to try it out. Given the typical cost, it's a great way to experiment with GPT-3 detection at a low price.

Have Me Test Any AI Outputs

If you have any AI-generated content you'd like analyzed through Originality.ai, I'm happy to run it through and share the results. Just reach out and I can provide GPT-3 probability scores to enhance your understanding of the content.

Conclusion - An Exciting New Tool for AI Analysis

In conclusion, Originality.ai seems to provide an important new metric for quantifying and benchmarking AI writing quality.

I'm excited to incorporate GPT-3 probability scores into my broader research and believe capabilities like this will only grow in importance as AI generators continue advancing.

FAQ

Q: What is Originality.ai?
A: Originality.ai is a new software that claims to accurately detect GPT-3 generated content.

Q: How does Originality.ai work?
A: It uses advanced machine learning models to analyze text and determine the probability it was generated by GPT-3.

Q: How accurate is Originality.ai?
A: Based on tests with content I wrote myself, it seems very accurate at detecting GPT-3 generated text.

Q: What are the implications of GPT-3 detection?
A: Accurately detecting GPT-3 content could help identify AI-written text, important for SEO and other applications.

Q: Can Originality.ai detect future AI like GPT-4?
A: While it's focused on GPT-3 now, Originality.ai's technology could likely be retrained to detect next-gen AI models like GPT-4.

Q: How can I try Originality.ai?
A: You can sign up on their website for cheap credits to test GPT-3 detection on your own content.

Q: How much does Originality.ai cost?
A: Currently they offer 2,000 credits for $5 during a limited sale period.

Q: Can you test my AI content with Originality.ai?
A: Yes, if you have any AI-generated text you want me to run through Originality.ai, let me know in the comments!

Q: Will you add GPT-3 detection to your AI analysis?
A: Yes, I plan to incorporate Originality.ai's GPT-3 probabilities into my robust AI writer evaluations moving forward.

Q: What's next for AI text detection?
A: As new AI models like GPT-4 emerge, detection technology will need to continuously evolve to identify the latest generation of AI writing.