
Introduction
As one of the worldwide most taken X-ray procedures, chest X-ray (CXR) is one of the most important
and also most demanding modalities in daily medical imaging. Due to its accessibility and fast
acquisition, chest radiographs are frequently used as a first diagnostic step, deciding on further patient
treatment [1,2]. During normal working times there is a high workload for every radiologist with a
certain risk of volatile errors, missed diagnosis, misinterpretation, and late diagnosis. While most of the
research assessing AI-based clinical decision support systems is focused on quantitative evaluations in a
retrospective and synthetic environment [3,4], this abstract is focused on the implementation of an AI-
based chest evaluation system in a real-world clinical setup. Therefore, we deployed an AI system,
capable of analysing CXR, in a large clinical setup including 10 clinical sites and qualitatively assess the
benefits of such a system to the clinicians and radiologists.
Material and methods
We installed an AI-based CXR reading support in clinical routine in a German multi-site medical supply
centre (MVZ Uhlenbrock and Partner). The MVZ for radiology connects 14 institutions including hospitals
and private practices. 10 of these institutions produce CXR images in a clinical routine set-up 24/7. All
acquired posterior anterior (PA) images from stationary X-ray systems of different vendors (Siemens
Healthineers, Carestream Health, Oehm und Rehbein GmbH, Philips) are sent to a central server where
they are uploaded to the cloud for evaluation. We use the AI Rad Companion Chest X-ray from Siemens
Healthineers (Figure 1) [5]. The AI system identifies five pre-specified findings on CXRs (p.a. view):
Pneumothorax, Pleural Effusion, Pulmonary Lesions, Consolidation, and Atelectasis. To assess the impact
of the deployed AI system we retrospectively analysed the AI-detected findings, and we conducted
several interviews with radiologists and connected physicians (e.g. surgeons and internal doctors) about
the benefits.
Results
Within one month about 1400 frontal images, received from the 10 institutions, were analysed. Figure 2
shows the percentage of CXR images with one or more findings. Depending on the institution the images
containing radiographic findings vary between 22% and 53% (Figure 3). The radiologists at the respective
sites reassured that those numbers are realistic and are due to the different patient population that are
treated (out-patient vs hospital). Network performance did not slow down the clinical flow of reading
and the AI result matches the physician’s opinion in 8 out of 10 cases. Due to missing ground-truth, a
quantitative evaluation is currently not possible. Quality improvement by a kind of second read and
diagnostic support during extra hours (e.g. nightshifts) were mentioned as the most important benefits
during the interviews. The AI was considered especially helpful by the radiologists, if it detects difficult
findings, e.g., as depicted in Figure 4, where the AI highlights a lesion behind the heart, which was
confirmed later by a CT scan as shown in Figure 5. We received mixed feedback about preferred positive
predictive value (PPV) and negative predictive value (NPV), with a slight tendency towards high NPV for
radiologists and high PPV for clinicians. Finally, we learnt that training and communication of how to use
the AI in daily routine by the users is an important success factor.
Discussion and Conclusion