According to an accepted manuscript published in the American Journal of Roentgenology (AJR), certain reasons for artificial intelligence (AI) tool failure relating to technical factors may be largely preventable through proper acquisition and reconstruction protocols.

“The automated AI body composition tools had high technical adequacy rates in a heterogeneous sample of external CT examinations, supporting the tools’ generalizability and potential for broad use,” concludes head researcher B. Dustin Pooler, MD, a clinical assistant professor in the community division at the University of Wisconsin Department of Radiology in Madison. 

This AJR-accepted manuscript included 8,949 patients (mean age, 55.5 years; 4,256 men, 4,693 women) who underwent abdominal CT—performed at different institutions on different scanners from different manufacturers—subsequently transferred to the local PACS for clinical purposes. Deploying three independent automated AI tools to assess body composition via bone attenuation, muscle amount and attenuation, as well as visceral and subcutaneous fat amounts, one axial series per examination was evaluated.

Ultimately, three fully automated AI tools for measuring body composition (vertebral bone, body wall musculature, and visceral and subcutaneous abdominal fat) had technical adequacy rates of 97.8%- 99.1% on Pooler and his coauthors’ sample of 11,699 external abdominal CT examinations—performed at 777 different external institutions using 82 different scanner models from 6 different manufacturers. 

Noting that reasons for failure also included factors inherent to patients that are more challenging to control, “explainability and an understanding of reasons for failure can help build trust in AI tools and increase acceptance among radiologists and other physicians,” the study authors add.