Acoustic Analyst Quoraishee Self-Tests Voice Cloning: Noise Masks Jitter Differences, Quietness Exposes Insufficient Background Noise
Shafik Quoraishee used his background in acoustic analysis to clone his own voice and compare detection metrics. Under background noise conditions, the cloned voice's jitter (micro-variations in cycle length) was statistically indistinguishable from a real human voice, but its shimmer (micro-variations in peak height) was more stable; in quiet environments, the cloned voice instead betrayed itself due to insufficient background noise. Sarah Barrington, a doctoral candidate at the University of California, Berkeley, points out that no single measurement metric can determine whether a recording is genuine or fake, and detection capabilities are not universal across different cloning tools.
Voice cloning detection faces a fundamental difficulty: no single acoustic metric can independently determine whether a recording is genuine or fake. Shafik Quoraishee, who has a background in acoustic analysis, conducted a controlled experiment on himself, the results of which illustrate exactly why this problem is so thorny. He recorded twenty-four sentences, cloned the same content using a free open-source tool, and then compared the jitter (tiny variations in the length of vocal fold vibration cycles) and shimmer (tiny variations in the height of vibration peaks) of the two sets of audio.
Sentences recorded in a room with a heater running showed that the cloned version's jitter was statistically indistinguishable from his real recordings, but its shimmer was steadier than the real voice. In a quiet environment, however, the cloned voice actually betrayed itself due to having too little background noise—all twelve sentences displayed signal characteristics cleaner than the real voice, even after undergoing degradation simulating a telephone call. In other words, background noise happened to mask the differences in jitter between the clone and the real voice, while the quiet environment exposed the clone's flaw of lacking background noise. Each condition leaked different information, but no single metric could cover all situations simultaneously.