corresponding images would be compared. When new measurements or new algorithms to extract measurements are proposed,
they would be studied the same way. As this is not feasible for various imaging modalities, such as Computed Tomography
(CT) due to the radiation exposure of patients in these studies, anthropomorphic printed phantoms have been proposed for CT
variability studies20–22.
Phantom studies have been successfully used for various imaging modalities. Especially for CT, advances in 3D printing
technologies allow printing volumetric patient images using materials with attenuation properties comparable to human tissue.
Recent work reported variability studies using such phantoms23–25.
While phantoms make it possible to study variability without imaging cohorts, they still require acquiring and imaging
phantoms. This can be costly as well as resource and time consuming. In this work, we study whether sensitivity analysis using
advanced in-silico CT simulators can yield similar results to real phantom imaging studies. To this end, a CT-scan simulator
environment was set up using the publicly available
26,27
ASTRA toolbox (www.astra-toolbox.com). Using a high-dose
CT-image as input, the simulator outputs raw projections, which can be manipulated accordingly. For example, stationary and
uncorrelated noise can be added. Additionally, the simulator allows for some freedom in geometrical parameters such as the
number of projections, slice thickness, and distances. The CT-image can be reconstructed with a variety of algorithm choices,
e.g. filtered back-projection and simultaneous iterative reconstruction technique.
The method is compared with an empirical anthropomorphic phantom variability study published in
23
. In this unique setup,
the simulated phantom study is performed using the same original image from which the anthropomorphic phantom was printed
and the study in
23
conducted. In a sense, this can be viewed as the theoretical replication. The simulator environment was
implemented to reconstruct images at different noise levels, reconstruction algorithms, and number of projections. To mimic
repetition and introduce variability, each simulation parameter set was repeated via a variation of the Poisson noise random
seed. For the simulated images, radiomics features were extracted and analysed. As the same source image is used for both the
empirical phantom study and this work, direct comparison of the results of sensitivity analyses is possible.
The next section describes the CT simulator environment method including a brief introduction of the anthropomorphic
phantom and the phantom study. In the results section a comprehensive validation and comparison of the simulator with respect
to the phantom study is presented. Furthermore, a stability and discriminative power analysis and discussions can be found in
the same section. The paper is summarised in the conclusions section.
2 Method
First, we introduce the details of the novel anthropomorphic phantom created for the tandem phantom study
23
. A high dose
CT-scan of this phantom is used as the simulator input. Second, the extracted radiomics features, the principal component
analysis and the simulator environment are described in detail.
2.1 Anthropomorphic phantom and phantom CT acquisitions
Here, we provide brief details of the anthropomorphic phantom study presented in
23
for completeness. For further details, we
refer the reader to the original publication.
A realistic radio-opaque three-dimensional phantom was designed from real patient CT data. Namely, the compilation
of a half-mirrored lung including a tumor and an abdominal liver section with a metastasis from a colon carcinoma
23
. The
phantom was manufactured via stacking sheets of printed aqueous potassium iodide solution on paper
28
. The lung tumor section
is a replication of a publicly available patient data set for radiomics phantoms, from the Image Biomarker Standardization
Initiative
29
. The lung section was neither used in this work nor the tandem phantom CT study. Tissue equivalent attenuation at
a defined energy spectrum was calibrated at 120 kVp. The contrast resolution of the printing technique in the phantom goes
from -100 to 1000 Hounsfield units (HU). Overall, no structures can be represented whose HU is below this paper-induced
threshold. To test the contrast resolution, a circular intensity ramp was printed in the phantom running through an HU range of
0 to 1000. A reliable resolution of 2 HU difference was achieved. Consequently the abdominal region was adequately depicted
for a quantitative analysis within the printed HU range.
The phantom was imaged with a Siemens SOMATOM Definition Edge CT scanner (SSDE). To define the acquisition and
image reconstruction parameters, a survey of clinical CT protocols was performed including 9 radiological institutes. All the
CT scans in that study were acquired with the same acquisition parameters, which resulted in an approximate CT dose index of
10mGy. Namely, a tube voltage of 120 kVp, a helical pitch factor of 1.0, a 0.5 second rotation time, and a tube current time
product of 147 mAs. No automatic tube current modulation was used.
Typical reconstruction parameter settings for clinical protocols in thoracic and abdominal oncology were varied for
the phantom study as follows: Reconstruction algorithm, iterative reconstruction (IR) or filtered back projection (FBP);
reconstruction kernel, 2 standard soft tissue kernels per algorithm; slice thickness in millimeter, 1, 1.5, 2, 3; and slice spacing
in millimeter, 0.75, 1, and 2. Series reconstructed with an IR algorithm used an ADMIRE (advanced modeled iterative
reconstruction) at strength level 3. In total, 8 groups of parameter variations were selected for the phantom study to assess
2/12