Institute of Fundamental Technological Research

Objectives - To develop and evaluate deep learning models devised for liver fat assessment based on ultrasound (US) images acquired from four different liver views: transverse plane (hepatic veins at the confluence with the inferior vena cava, right portal vein, right posterior portal vein) and sagittal plane (liver/kidney). Methods - US images (four separate views) were acquired from 135 participants with known or suspected nonalcoholic fatty liver disease. Proton density fat fraction (PDFF) values derived from chemical shift-encoded magnetic resonance imaging served as ground truth. Transfer learning with a deep convolutional neural network (CNN) was applied to develop models for diagnosis of fatty liver (PDFF ≥ 5%), diagnosis of advanced steatosis (PDFF ≥ 10%), and PDFF quantification for each liver view separately. In addition, an ensemble model based on all four liver view models was investigated. Diagnostic performance was assessed using the area under the receiver operating characteristics curve (AUC), and quantification was assessed using the Spearman correlation coefficient (SCC). Results - The most accurate single view was the right posterior portal vein, with an SCC of 0.78 for quantifying PDFF and AUC values of 0.90 (PDFF ≥ 5%) and 0.79 (PDFF ≥ 10%). The ensemble of models achieved an SCC of 0.81 and AUCs of 0.91 (PDFF ≥ 5%) and 0.86 (PDFF ≥ 10%). Conclusion - Deep learning-based analysis of US images from different liver views can help assess liver fat.

attention mechanism, convolutional neural networks, deep learning, nonalcoholic fatty liver disease, proton density fat fraction, ultrasound images

Qualitative sonography is used to assess nonalcoholic fatty liver disease (NAFLD), an important health issue worldwide. We used B-mode image deep-learning to objectively assess NAFLD in 4 views of the liver (hepatic veins at confluence with inferior vena cava, right portal vein, right posterior portal vein and liver/kidney) in 135 patients with known or suspected NAFLD. Transfer learning with a deep convolutional neural network (CNN) was applied for quantifying fat fraction and diagnosing fatty liver (≥ 5%) using contemporaneous MRI-PDFF as ground truth. Single and multi-view learning approaches were compared. Class activation mapping generated attention maps to highlight regions important for deep learning-based recognition. The most accurate single view was hepatic veins, with area under the receiver operating characteristic curve (AUC) of 0.86 and Spearman’s rank correlation coefficient of 0.65. A multi-view ensemble of deep-learning models trained for each view separately improved AUC (0.93) and correlation coefficient (0.76). Attention maps highlighted regions known to be used by radiologists in their qualitative assessment, e.g., hepatic vein-parenchyma interface and liver-kidney interface. Machine learning of four liver views can automatically and objectively assess liver fat. Class activation mapping suggests that the CNN focuses on similar features as radiologists. [No. R01DK106419.]