Researchers Develop IdeaLens: Detecting AI by Core Ideas, Not Style, Cuts False Positives on Edited Text
A new tool called IdeaLens strips text to its argument outline before detection. In tests on human writing lightly edited by AI, it correctly identified 95% as human-authored, compared to 44% for traditional tools like Pangram.
Researchers from the University of Maryland, Google DeepMind, and Simon Fraser University have developed IdeaLens, a new AI detection tool that analyzes the core arguments of a document rather than its stylistic features. By stripping away original wording and reducing texts to their essential outlines, the system aims to determine whether ideas originated from humans or machines, regardless of who wrote the final draft.
According to TechNews, the team trained IdeaLens on approximately one million labeled documents. On purely AI-generated or purely human-written texts, IdeaLens achieved 91% accuracy in identifying AI content with a 0.6% false-positive rate for human writing. However, this performance still lags behind established tools like Pangram on clean inputs.
The significant advantage appears in mixed scenarios. When human writing was lightly edited by AI, IdeaLens correctly classified 95% of such documents as human-authored, whereas Pangram averaged only 44%. Conversely, when AI generated text based on detailed human outlines, traditional tools flagged 92% as AI-involved, while IdeaLens marked only 7%, recognizing the human origin of the ideas.
The researchers note that human ideas typically include specific details, verifiable sources, and acknowledgments of limitations, while AI-generated ideas tend to be vague, contain unverifiable numbers, or offer suspiciously perfect answers. Despite these promising results, the team acknowledges that IdeaLens struggles with some newer AI models and requires further testing before widespread adoption in academic or professional settings.