An AI detector just flagged 46% of the Pope’s new encyclical as AI-written. The encyclical is about AI ethics. It was written in a prose tradition over a thousand years old. The same detector rated other paragraphs of the same document at essentially 0%. Same author. Same document.

I ran a similar experiment on myself. I asked ChatGPT to review my personal blog from 2008-2017 and identify posts that read as AI-written. It identified 35% of them as having structured arguments, clean frameworks, numbered examples, and tidy conclusions. None of them were AI-assisted. None of them could have been. ChatGPT didn’t exist yet.

The three worst offenders: a 2009 post about Twitter with definitions and numbered use cases. A 2010 business case for mobile websites with data and a strategic conclusion. A 2014 incident postmortem with a failure chain and lessons learned. Those aren’t AI patterns. Those are writing patterns. Humans have been organizing their thoughts like this for centuries.

A year ago these same tools were being sold to help you write more clearly. Now writing clearly is the evidence you used them.

Even the article covering this story hedges: “practitioners should treat single-detector outputs as suggestive and seek multi-method forensic work before drawing firm conclusions.” Here’s a conclusion that doesn’t require forensic work: if a writing tradition predates electricity, maybe weight the patina of the source before you let an algorithm accuse it of being a machine.

#AIDetection #FalsePositive #WritingIsNotACrime #AIEthics #ContentAuthenticity