eanm-logo eanm-logo
European Nuclear Medicine Guide
eanm-logo eanm-logo
European Nuclear Medicine Guide
Chapter 19

Principles of multimodality imaging: PET/MR

Up to now, we saw the multiple advantages of combining molecular imaging with the superior high resolution structural imaging provided by CT. However, since CT also has its limitations in imaging and differentiating between soft tissues, soon after the advent of PET/CT in the clinical arena, it was the aim of technical developments to investigate on the combination of PET and MRI. The combination of those two modalities opened the field of cross-modality imaging to the marriage of the well-known functional PET imaging with the superior soft tissue signal that MRI is able to add. PET and MRI have been in the clinical molecular tomographic imaging arena more than three decades each. While MRI originally aimed at imaging soft tissue structures, PET primarily aimed at imaging physiologic and pathophysiologic processes to image oncologic, neurologic, cardiologic, infectious and inflammatory diseases. After the proof of the operability of specific light detectors such as avalanche photo diodes (APD) and silicon photo multipliers (SiPM) under the conditions of a strong static and changing gradient magnetic fields, the way of combining PET and MRI to hybrid systems was paved. First, PET-detector inserts for preclinical [1–7] and clinical MRI-systems [8,9] were developed to further prove the feasibility of combining the two imaging modalities without intolerably impairing the qualitative and quantitative imaging results of the other. In parallel, by using systems employing one and the same patient handling system/table/bed, the clinical utility of having the image data of the involved modalities inherently co-registered to each other was thoroughly investigated [10–13]. Using existing imaging systems, GE introduced a two-room-setup, a clinical PET/CT- and a MRI-System were installed in rooms right next to each other and a unique patient handling system designed connectable to the patient ports/-bores of both of the systems [14,15]. PHILIPS came up with a comparable design but having the two systems in the same room and using a bi-planar rotating patient table [16,17]. The first system fully integrating the avalanche photodiode (APD) based PET detector system was manufactured by SIEMENS Healthineers and reached market maturity in 2011. Offering the option of a true simultaneous whole-body measurement of PET- and MR-signals, the limited timing resolution of the APDs, however, did not allow for time of flight (TOF) PET measurements as well known and utilized in photomultiplier based PET-detector systems in hybrid PET/CT systems[18,19]. In 2014, GE healthcare introduced a TOF-PET-capable fully integrated whole-body PET/MRI-systems employing SiPMs as light detectors in the PET-detector system. In a comprehensive overview, Quick and Boellaard summarized the performance parameters of the three PET/MRI-systems available for clinical use [20]. Recently, SiPM based PET detector systems are also used in digital PET detector systems that are employed in hybrid PET/CT to further increase timing resolution and reduce the influence of noise by analogue-digital conversion. “Digital” in this context means, that each photon of visible light, generated in the scintillator material (-crystal) is detected by the SiPM and directly converted into a binary output signal (i.e., output=1 → visible light photon detected, output=0 → no light photon detected). This is enabled by the dimensions of the microcells of the SiPM. So, a considerable number of SiPM-microcells read out the scintillation light of one particular detector crystal. Now each individual crystal can be read out individually, and this eliminates the need for localization arrays, -electronics, and arithmetic within a detector block as was widely implemented in state-of-the-art clinical PET/CT systems. The energy discrimination – i.e., determining the energy of the gamma ray causing the light pulse in the crystal material – is achieved by determining the intensity of the scintillation light. As the number of light photons in a pulse represents the light intensity, counting the number of detected photons of visible light – i.e., “fired” SiPM cells with output=1 – enables the determination of the energy of the gamma ray. As there is no analogue to digital signal conversion involved in this process, and a photon of visible light leads to a binary output of a SiPM cell, this method can be called digital photon counting (DPC). More technical details and performance characteristics can be found in the articles by Seifert[21] or Lecomte[22].

For the quantitative validity of the PET measurements, it is essential that the concentrations of activity in respective lesions, volumes, and sub-volumes (Bq/ccm) are determined as accurate as possible. Therefore, the energy degradation of the 511keV photons, as they travel through tissue until they reach the detector system, needs to be involved in the reconstruction of the emission data set. This attenuation and scatter of photons are mainly determined by the electron density of the material through which they travel through and interact. This electron density can be directly obtained by obtaining transmission measurements either of 511keV radioactive sources or the X-rays as emitted by the tubes of CT systems. The reconstructed transmission volume data sets can be used directly if obtained from 511keV transmission measurements or after a (bi-linear) calibration/scaling of the linear attenuation coefficients (LAC) at X-ray energies to those at 511keV, the energy of the photons as emitted after annihilation of a positron with an electron. In contrast, a MR-signal represents the proton density in a tissue[23–25]. This is by no means representative for the attenuation behaviour of material against gamma radiation. Thus, several approaches have been established to identify the different tissue classes using the MR signal. These tissue classes are fat, soft tissue, air, and lung. Depending on imaging circumstances (i.e., the imaged body part, position of the patient in the system, patient comfort, preparation, etc.) the segmentation of these tissue classes succeeds – or not. 

The segmented tissue classes are assigned a constant linear attenuation coefficient, and the so constituted segmented µ-map is used for attenuation correction of the emission data. Still, these algorithms suffer from being not sufficient enough to detect bone and air. In their recent implementations, most vendors use ultrashort- and zero echo time MR sequences to detect bone and, thus, improve the performance of the tissue class segmentation. These methods are combined with methods of µ-map generation from MR data that use structural (i.e., T1- or T2 weighted) MR data sets in combination with CT-atlas based information of a particular part of the body to generate a more realistic map of linear attenuation coefficients including bone[26–29]. As anatomical atlases are the basis for the assignment of LACs, those methods start to fail if the anatomy of the particular subject under investigation differs from the circumstances in the atlas. Recently, Ladefoged presented a method called RESOLUTE[30]. The method was extensively validated for the head and neck region and proved to be very stable in comparison with the CT as a ground truth[31]. It’s accurate performance could also be shown under more difficult anatomic circumstances and alterations as might be present after surgical interventions [32]. In recent research settings, neuronal network approaches are employed to train algorithms using CT and 511keV data to learn generating continues valued maps of LACs on the basis of structural MR data sets. The newest of this kind are utilizing convolutional neuronal network based deep learning algorithms [33–36]. A more indepth view about what artificial intelligence is basically about and what are the potential benefits in the area of Nuclear Medicine will be given in the chapter. 

Using the aforementioned methods and depending on the body part under investigation, the accuracy of the PET measurement in hybrid PET/MRI settings reach the order of accuracy of that in PET/CT settings. Moreover, all the hardware in the path of the gamma rays needs to be taken into account, because it also degrades/attenuates the PET signal. The (flexible or rigid) MR signal receiver coils and the patient table are either implemented by CT-measured maps of LACs or designed so that the attenuation of the PET signal by this material is negligible. Most of the harmonization procedures of quantitative PET as known from PET/CT are based on the measurement of known phantom structures filled with watery solutions of radioactivity containing different fillable sub-volumes and, thereby, representing known activity concentrations in volumes of different sizes in an either cold or hot background. Firstly, being constructed mainly of plastic, the structure of those phantoms cannot be sufficiently detected by MRI. Secondly, larger volumes of pure water in the MRI field of view causes major distortions of the MR signal. This topic has been addressed by searching for alternative liquids to fill the phantom [37]. Current approaches to use activity fillable phantoms in hybrid PET/MRI, however, employ the implementation of CT-generated µ-maps of the particular phantom to account for the attenuation of the PET signal. Thus, inter-system quantitative comparisons give the comparability of just the quantitative performance of the PET detector system. If the clinical settings for attenuation correction – i.e., the MR-based µ-map – is used for attenuation correction of phantom measurements considerable deviations of accuracy of the PET measurement is found[38,39].

The latest generation of hybrid PET/MRI systems is capable of Time Of Flight (TOF) PET signal detection[40]. This information can be used for simultaneous reconstruction of Activity and Attenuation[41].

Depending on the legislation and organizational requirements and settings, PET/MRI systems should usually be installed in and managed by nuclear medicine, radiology, or a combination of the both departments. If it is integrated in a full hybrid imaging molecular imaging PET centre including a radiopharmaceutical production site with a cyclotron on site, the system should be located in close proximity to this facility. However, satellite PET/MRI units can also be installed at specialized clinical sites such as paediatric, psychiatric, or neurology departments if the aforementioned staffing level is available.

Further Information, not only on PET/MRI (Sattler 2021), can be found in a comprehensive Series of textbooks, the Handbook of nuclear medicine and molecular imaging for physicists.

 

References

1.    Pichler BJ, Swann BK, Rochelle J, Nutt RE, Cherry SR, Siegel SB. Lutetium oxyorthosilicate block detector readout by avalanche photodiode arrays for high resolution animal PET. Physics in Medicine and Biology 2004;49:4305–19.

2.    Pichler BJ, Judenhofer MS, Catana C, Walton JH, Kneilling M, Nutt RE, et al. Performance test of an LSO-APD detector in a 7-T MRI scanner for simultaneous PET/MRI. Journal of Nuclear Medicine : Official Publication, Society of Nuclear Medicine 2006;47:639–47.

3.     Pichler BJ, Wehrl HF, Kolb A, Judenhofer MS. Positron Emission Tomography/Magnetic Resonance Imaging: The Next Generation of Multimodality Imaging? Seminars in Nuclear Medicine 2008;38:199–208. https://doi.org/10.1053/j.semnuclmed.2008.02.001.

4.    Pichler BJ, Kolb A, Nagele T, Schlemmer H-P. PET/MRI: Paving the Way for the Next Generation of Clinical Multimodality Imaging Applications. Journal of Nuclear Medicine 2010;51:333–336. https://doi.org/10.2967/jnumed.109.061853.

5.     Judenhofer MS, Wehrl HF, Newport DF, Catana C, Siegel SB, Becker M, et al. Simultaneous PET-MRI: a new approach for functional and morphological imaging. Nat Med 2008;14:459–65. https://doi.org/10.1038/nm1700.

6.     Judenhofer MS, Catana C, Swann BK, Siegel SB, Jung W-I, Nutt RE, et al. PET/MR images acquired with a compact MR-compatible PET detector in a 7-T magnet. Radiology 2007;244:807–14. https://doi.org/10.1148/radiol.2443061756.

7.     Ziegler SI, Pichler BJ, Boening G, Rafecas M, Pimpl W, Lorenz E, et al. A prototype high-resolution animal positron tomograph with avalanche photodiode arrays and LSO crystals. European Journal of Nuclear Medicine 2001;28:136–143. https://doi.org/10.1007/s002590000438.

8.     Schlemmer H-PW, Pichler BJ, Schmand M, Burbar Z, Michel C, Ladebeck R, et al. Simultaneous MR/PET Imaging of the Human Brain: Feasibility Study. Radiology 2008;248:1028–1035. https://doi.org/10.1148/radiol.2483071927.

9.     Kolb A, Wehrl HF, Hofmann M, Judenhofer MS, Eriksson L, Ladebeck R, et al. Technical performance evaluation of a human brain PET/MRI system. European Radiology 2012;22:1776–1788. https://doi.org/10.1007/s00330-012-2415-4.

10.     Bailey DL, Antoch G, Bartenstein P, Barthel H, Beer AJ, Bisdas S, et al. Combined PET/MR: The Real Work Has Just Started. Summary Report of the Third International Workshop on PET/MR Imaging; February 17-21, 2014, Tübingen, Germany. Mol Imaging Biol 2015;17:297–312. https://doi.org/10.1007/s11307-014-0818-0.

11.     Bailey DL, Pichler BJ, Gückel B, Barthel H, Beer AJ, Bremerich J, et al. Combined PET/MRI: Multi-modality Multi-parametric Imaging Is Here: Summary Report of the 4th International Workshop on PET/MR Imaging; February 23-27, 2015, Tübingen, Germany. Mol Imaging Biol 2015;17:595–608. https://doi.org/10.1007/s11307-015-0886-9.

12.     Bailey DL, Pichler BJ, Gückel B, Barthel H, Beer AJ, Botnar R, et al. Combined PET/MRI: from Status Quo to Status Go. Summary Report of the Fifth International Workshop on PET/MR Imaging; February 15-19, 2016; Tübingen, Germany. Molecular Imaging and Biology : MIB : The Official Publication of the Academy of Molecular Imaging 2016;18:637–50. https://doi.org/10.1007/s11307-016-0993-2.

13.     Bailey DL, Pichler BJ, Gückel B, Antoch G, Barthel H, Bhujwalla ZM, et al. Combined PET/MRI: Global Warming—Summary Report of the 6th International Workshop on PET/MRI, March 27–29, 2017, Tübingen, Germany. Mol Imaging Biol 2018;20:4–20. https://doi.org/10.1007/s11307-017-1123-5.

14.     Veit-Haibach P, Kuhn FP, Wiesinger F, Delso G, von Schulthess G. PET–MR imaging using a tri-modality PET/CT–MR system with a dedicated shuttle in clinical routine. Magnetic Resonance Materials in Physics, Biology and Medicine 2013;26:25–35. https://doi.org/10.1007/s10334-012-0344-5.

15.    von Schulthess GK. Why buy a PET/MR for high end research? Journal of Magnetic Resonance Imaging 2014;40:283–284. https://doi.org/10.1002/jmri.24426.

16.     Boellaard R, Delgado-Bolton R, Oyen WJG, Giammarile F, Tatsch K, Eschner W, et al. FDG PET/CT: EANM procedure guidelines for tumour imaging: version 2.0. European Journal of Nuclear Medicine and Molecular Imaging 2015;42:328–54. https://doi.org/10.1007/s00259-014-2961-x.

17.     Rausch I, Rischka L, Ladefoged CN, Furtner J, Fenchel M, Hahn A, et al. PET/MRI for Oncologic Brain Imaging: A Comparison of Standard MR-Based Attenuation Corrections with a Model-Based Approach for the Siemens mMR PET/MR System. Journal of Nuclear Medicine : Official Publication, Society of Nuclear Medicine 2017;58:1519–1525. https://doi.org/10.2967/jnumed.116.186148.

18.     Delso G, Furst S, Jakoby B, Ladebeck R, Ganter C, Nekolla SG, et al. Performance Measurements of the Siemens mMR Integrated Whole-Body PET/MR Scanner. Journal of Nuclear Medicine 2011;52:1914–1922. https://doi.org/10.2967/jnumed.111.092726.

19.     Parker JA, Christian P, Jadvar H, Sattler B, Wallis JW. The SNMMI and EANM Practice Guideline for Tele-Nuclear Medicine 2.0. Journal of Nuclear Medicine Technology 2014;42:15–19. https://doi.org/10.2967/jnmt.113.133231.

20.     Boellaard R, Rausch I, Beyer T, Delso G, Yaqub M, Quick HH, et al. Quality control for quantitative multicenter whole-body PET/MR studies: A NEMA image quality phantom study with three current PET/MR systems. Medical Physics 2015;42:5961–5969. https://doi.org/10.1118/1.4930962.

21.     Seifert S, van der Lei G, van Dam HT, Schaart DR. First characterization of a digital SiPM based time-of-flight PET detector with 1 mm spatial resolution. Physics in Medicine and Biology 2013;58:3061–3074. https://doi.org/10.1088/0031-9155/58/9/3061.

22.     Lecomte R. Novel detector technology for clinical PET. Eur J Nucl Med Mol Imaging 2009;36 Suppl 1:S69-85. https://doi.org/10.1007/s00259-008-1054-0.

23.     Burger C, Goerres G, Schoenes S, Buck A, Lonn A, von Schulthess G. PET attenuation coefficients from CT images: experimental evaluation of the transformation of CT into PET 511-keV attenuation coefficients. European Journal of Nuclear Medicine and Molecular Imaging 2002;29:922–927. https://doi.org/10.1007/s00259-002-0796-3.

24.      Carney JPJ, Townsend DW, Rappoport V, Bendriem B. Method for transforming CT images for attenuation correction in PET/CT imaging. Medical Physics 2006;33:976–983. https://doi.org/10.1118/1.2174132.

25.     Teimourian B, Ay MR, Zafarghandi MS, Ghafarian P, Ghadiri H, Zaidi H. A novel energy mapping approach for CT-based attenuation correction in PET. Medical Physics 2012;39:2078–2089. https://doi.org/10.1118/1.3694108.

26.     Sekine T, Buck A, Delso G, ter Voert EEGW, Huellner M, Veit-Haibach P, et al. Evaluation of Atlas-Based Attenuation Correction for Integrated PET/MR in Human Brain: Application of a Head Atlas and Comparison to True CT-Based Attenuation Correction. Journal of Nuclear Medicine 2016;57:215–220. https://doi.org/10.2967/jnumed.115.159228.

27.     Yang J, Jian Y, Jenkins N, Behr SC, Hope TA, Larson PEZ, et al. Quantitative Evaluation of Atlas-based Attenuation Correction for Brain PET in an Integrated Time-of-Flight PET/MR Imaging System. Radiology 2017;284:169–179. https://doi.org/10.1148/radiol.2017161603.

28.     Burgos N, Cardoso MJ, Thielemans K, Modat M, Dickson J, Schott JM, et al. Multi-contrast attenuation map synthesis for PET/MR scanners: assessment on FDG and Florbetapir PET tracers. European Journal of Nuclear Medicine and Molecular Imaging 2015;42:1447–58. https://doi.org/10.1007/s00259-015-3082-x.

29.     Paulus DH, Quick HH, Geppert C, Fenchel M, Zhan Y, Hermosillo G, et al. Whole-Body PET/MR Imaging: Quantitative Evaluation of a Novel Model-Based MR Attenuation Correction Method Including Bone. Journal of Nuclear Medicine : Official Publication, Society of Nuclear Medicine 2015;56:1061–6. https://doi.org/10.2967/jnumed.115.156000.

30.     Ladefoged CN, Benoit D, Law I, Holm S, Kj\a er A, Højgaard L, et al. Region specific optimization of continuous linear attenuation coefficients based on UTE (RESOLUTE): application to PET/MR brain imaging. Physics in Medicine and Biology 2015;60:8047–8065. https://doi.org/10.1088/0031-9155/60/20/8047.

31.     Ladefoged CN, Law I, Anazodo U, St. Lawrence K, Izquierdo-Garcia D, Catana C, et al. A multi-centre evaluation of eleven clinically feasible brain PET/MRI attenuation correction techniques using a large cohort of patients. NeuroImage 2017;147:346–359. https://doi.org/10.1016/J.NEUROIMAGE.2016.12.010.

32.     Ladefoged CN, Andersen FL, Kj\a er A, Højgaard L, Law I. RESOLUTE PET/MRI Attenuation Correction for O-(2-18F-fluoroethyl)-L-tyrosine (FET) in Brain Tumor Patients with Metal Implants. Frontiers in Neuroscience 2017;11:453. https://doi.org/10.3389/fnins.2017.00453.

33.     Han X. MR-based synthetic CT generation using a deep convolutional neural network method. Med Phys 2017;44:1408–19. https://doi.org/10.1002/mp.12155.

34.     Leynes AP, Yang J, Wiesinger F, Kaushik SS, Shanbhag DD, Seo Y, et al. Zero-Echo-Time and Dixon Deep Pseudo-CT (ZeDD CT): Direct Generation of Pseudo-CT Images for Pelvic PET/MRI Attenuation Correction Using Deep Convolutional Neural Networks with Multiparametric MRI. J Nucl Med 2018;59:852–8. https://doi.org/10.2967/jnumed.117.198051.

35.     Gong K, Yang J, Kim K, Fakhri GE, Seo Y, Li Q. Attenuation Correction for Brain PET Imaging Using Deep Neural Network Based on Dixon and ZTE MR Images. Phys Med Biol 2018;63:125011. https://doi.org/10.1088/1361-6560/aac763.

36.     Ladefoged CN, Marner L, Hindsholm A, Law I, Højgaard L, Andersen FL. Deep Learning Based Attenuation Correction of PET/MRI in Pediatric Brain Tumor Patients: Evaluation in a Clinical Setting. Front Neurosci 2018;12:1005. https://doi.org/10.3389/fnins.2018.01005.

37.     Ziegler S, Braun H, Ritt P, Hocke C, Kuwert T, Quick HH. Systematic evaluation of phantom fluids for simultaneous PET/MR hybrid imaging. Journal of Nuclear Medicine : Official Publication, Society of Nuclear Medicine 2013;54:1464–71. https://doi.org/10.2967/jnumed.112.116376.

38.     Boellaard R, Hofman MBM, Hoekstra OS, Lammertsma AA. Accurate PET/MR Quantification Using Time of Flight MLAA Image Reconstruction. Molecular Imaging and Biology 2014;16:469–477. https://doi.org/10.1007/s11307-013-0716-x.

39.     Beyer T, Lassen ML, Boellaard R, Delso G, Yaqub M, Sattler B, et al. Investigating the state-of-the-art in whole-body MR-based attenuation correction: an intra-individual, inter-system, inventory study on three clinical PET/MR systems. Magnetic Resonance Materials in Physics, Biology and Medicine 2016;29:75–87. https://doi.org/10.1007/s10334-015-0505-4.

40.     Grant AM, Deller TW, Khalighi MM, Maramraju SH, Delso G, Levin CS. NEMA NU 2-2012 performance studies for the SiPM-based ToF-PET component of the GE SIGNA PET/MR system. Medical Physics 2016;43:2334–2343. https://doi.org/10.1118/1.4945416.

41.     Nuyts J, Dupont P, Stroobants S, Benninck R, Mortelmans L, Suetens P. Simultaneous maximum a posteriori reconstruction of attenuation and activity distributions from emission sinograms. IEEE Transactions on Medical Imaging 1999;18:393–403. https://doi.org/10.1109/42.774167.