Substack Adds AI Detector to Flag Bot-Written Posts

Substack is introducing an AI detection tool that allows readers to determine if a post, note, reply, or comment is written by a human or generated by AI. This is a first for a major newsletter platform.

The feature comes from a collaboration with Pangram Labs, an AI detection company. It scans the text and provides an estimate of how much of it might be AI-generated or heavily assisted by AI. Think of it as a plagiarism checker, but instead of flagging copied content, it highlights text that a human might not have authored.

How It Works

According to a Substack blog post, you’ll find this tool directly on the platform. It can be used for posts, notes, replies, and comments. Pangram’s technology evaluates writing patterns, including sentence structure, word choice, and stylistic consistency. These elements often differ between human writers and large language models, which are AI systems trained on vast amounts of text to generate human-like responses.

The result is a percentage estimate. Instead of a simple yes-or-no answer, readers will see something like “74% likely AI-generated.” This gives them a general idea rather than a definite conclusion.

This distinction is important. AI detection isn’t perfect. Tools in this space often misidentify human writing as AI-generated, especially when the writing is polished or formulaic. Substack and Pangram haven’t shared the tool’s accuracy rate yet.

Why Substack Is Doing This Now

Substack aims to be a platform for genuine, independent writers, positioning itself against anonymous and automated content farms. However, as AI writing tools like ChatGPT have become affordable and user-friendly, some creators are leaning on them heavily. In some cases, they’re publishing nearly all AI-generated content without telling their subscribers.

This raises trust issues. Readers who pay $5, $10, or $20 a month for a newsletter expect a human touch. If that human mostly hits “generate” in ChatGPT and copies the output, that’s not what most subscribers signed up for.

Instead of banning AI writing outright, Substack is empowering readers with information. This approach emphasizes transparency rather than enforcement.

What This Means for Everyday Readers

If you subscribe to any Substack newsletter, this tool gives you a quick gut-check before you take what you’re reading too seriously. A finance newsletter forecasting market moves, a health writer offering medical advice, or a political commentator analyzing legislation — all of these carry more weight when backed by a real expert. An AI can string those sentences together, but it lacks the accountability of a human writer.

For free newsletters, the financial stakes are lower, but trust still matters. If you find out a post is 80% AI-generated, it might influence how you view its advice.

For writers, the situation is different. Creators who use AI as a light editing tool or research assistant but do most of the thinking and writing themselves might get flagged unfairly. This risk arises from current AI detection technology, which could create challenges for legitimate writers who naturally write in a clean, structured style.

Community Reaction

“Finally. I’ve been suspicious of like three newsletters I subscribe to for months. They all started posting way more frequently, and the writing got weirdly… smooth.”

“The false positive problem is real though. My writing professor got flagged by one of these tools last semester and almost failed a student who wrote everything herself. These detectors aren’t reliable enough yet.”

The Bigger Picture

Substack isn’t the only platform grappling with this issue. Sites like LinkedIn, Medium, and academic publishers have been trying to navigate AI-generated content since ChatGPT made it easy to produce convincing text at scale in late 2022. Many have opted for one of two strategies: outright bans, which are tough to enforce, or disclosure requirements that rely on creator honesty.

Substack’s approach — providing a detection tool instead of policing creators directly — offers a third option. It shifts responsibility to the audience, aligning with the platform’s philosophy of letting subscribers decide what works.

Whether AI detection technology is accurate enough to make this approach effective remains uncertain. Pangram Labs hasn’t publicly shared independent accuracy benchmarks for its tool yet.

Sources: The Verge, Engadget

What To Watch

• Accuracy data: Keep an eye out for Pangram Labs or Substack to release real-world accuracy and false-positive rates once the tool is available to more users.
• Creator pushback: Writers who get flagged incorrectly may speak out publicly — such backlash could prompt Substack to adjust or clarify how the tool is presented.
• Platform copycats: If this feature gains traction, expect Ghost, Beehiiv, and Medium to consider similar partnerships with detection companies.
• Regulatory context: The EU’s AI Act includes rules about AI-generated content labeling, taking full effect in 2026. Substack’s move might be a way to prepare for compliance.