This Tool Detects Articles Written by ChatGPT

It can detect fake term papers and blog posts, too

Thomas Smith


Photos courtesy the author.

Since OpenAI opened up their ChatGPT service to the general public, it’s now nearly impossible to know if the text you’re reading online was written by a human or by an AI system pretending to be one.

Several tools help to detect text written by systems like ChatGPT, but all of them were trained on previous systems like GPT-2.

Originality AI is a new tool that can detect if text was written by ChatGPT, GPT-3, or the new GPT-3.5. Because the tool was specifically trained on output from these systems, it’s better than previously-available tools at detecting both AI-written text and run-of-the-mill plagiarism.

I tested Originality AI out with both human-written and machine-generated text. This article walks through my results.

Want to try Originality AI? Sign up with my link and use code UWriterReferral50 to get a special discount for readers of our blog.

How Originality AI Works

When AI-text generation systems write words, they’re essentially starting with a single word, and then predicting what the next word should be. They’re basically like very complex versions of your phone’s autocorrect.

That makes them good at fooling humans. But because they’re always predicting the next word, it also means they follow predictable patterns. Their text feels original to human readers. But a well-trained AI system can detect their telltale patterns, identifying AI written text.

Amusingly, it takes an AI system to catch an AI system!

To work well, though, the AI detection system needs to be trained on lots of output from the AI writing system it’s trying to detect. Originality AI trained their system on output from GPT-2, GPT-J, GPT-NEO, GPT-3, and ChatGPT, so it’s specifically tuned to ferret out text from those systems.

Signing Up for the Service

Signing up for Originality AI is easy. Head to the Originality AI site, and sign up for an account. Again, you can use our special code UWriterReferral50 to get a discount.