US Mass General Brigham Team Develops AI Model That Predicts Cancer Death Risk from Face Photos
Researchers at Mass General Brigham in the United States recently published a new study in The Lancet Digital Health introducing FAHR-Face, an artificial intelligence model capable of predicting a cancer patient's risk of dying from a single facial photograph. Led by radiation oncologist Ray Mak and his colleagues, the study aims to address the subjectivity inherent in traditional clinical assessments.
Mak noted that medical students are trained to form an impression of a patient's health by observing them, a 'clinical intuition' that directly influences treatment plans such as surgery, chemotherapy, or radiation. However, this assessment is inherently subjective. FAHR-Face attempts to convert this subjective impression into objective data. The team first allowed the algorithm to 'learn' from 40 million facial images without a specific task, then fine-tuned it to perform two functions: estimating biological age and predicting survival odds for cancer patients.
Test results revealed surprising accuracy. In a test group of 3,820 cancer patients, 64 out of the 122 individuals with the highest risk scores died within 90 days of having their photo taken, accounting for more than half. In a larger separate test group of over 38,000 cancer patients, those who appeared older than their chronological age also had a higher risk of dying. The researchers stated this is the first report of an AI algorithm that can directly predict cancer patient survival from a simple face photograph.
To understand how the AI makes these judgments, the team used 'attention mapping' to track where the algorithm focused during analysis. For age prediction, the AI primarily looked at areas like the nasolabial folds (the crease between the nose and mouth) and parts of the forehead. For death risk prediction, it tended to focus on the bridge of the nose and areas below the eyes. While it remains unclear why these specific areas correlate with death risk, the model appears to pick up on facial changes associated with known health risks like smoking and alcohol use. For instance, smokers and heavy drinkers often look older than their actual age. Expressions, makeup, and lighting had little effect on age predictions, but plastic surgery was an exception: people who had rhinoplasty were rated as slightly older in post-surgery photos compared to pre-surgery ones.
Despite its promise, FAHR-Face is not yet ready for clinical use. A major limitation is that the cancer survival model was trained on a Boston-area population that was majority white. The research team is working to expand their training sets to include a wider diversity of faces. Mass General Brigham has filed a patent for the face health algorithms.
The technology also raises ethical questions. Matthew Liao, a professor and director of the Center for Bioethics at New York University, commented that while such tools could help identify patients needing extra care, there is a risk of misidentification, potentially leading to withheld care for those who actually need it. Liao also expressed concern that insurance companies might use this technology to grant or deny coverage, or employers might use it to screen for 'healthier' job candidates. He argued that society must think through the implications before further development.
Fuentes:scientificamerican.com