Ultrasound + MRI Hybrid Imaging

The use of sensors of various types, to gather extra infor- mation that can be incorporated into the image reconstruction, is a growing trend especially in MRI. We develop ultrasound-based organ-configuration motion (OCM) sensors that provide a signature of organ motion in real-time. These are small single-element US transducers, which can be essentially as easy to fix on the body as ECG leads. OCM sensors do not create images, but rather they provide signals that capture organ motion and deformation. We have applied OCM sensors to respiratory imaging of the liver, where the temporal resolution was increased from 2 images per second to up to 150, using machine learning techniques. The following movie shows this in more detail:

OCM sensors may become an integral part of many MRI systems, to help handle physiological motion. Apart from the above application, we are investigating the use of OCM sensors in cardiac imaging, MR thermometry and PET-CT imaging.
 

Publications

  1. F Preiswerk, M Toews, C-C Cheng, Jr-y Chiou, C-S Mei, LF Schaefer, WS Hoge, B Schwartz, LP Panych, and B Madore. “Hybrid MRI ultrasound acquisitions, and scannerless real-time imaging.” Winner of the 2017 YIA Cum Laude Award of the ISMRM. Magn Reson Med 2017; 78: 897-908. PMCID: PMC5391319
  2. Preiswerk F, Toews M, Hoge WS, Chiou J-yG, Panych LP, Wells III WM, Madore B. Hybrid ultrasound and MRI acquisitions for high-speed imaging of respiratory organ motion. In: Navab N, Hornegger J, Wells W, Frangi A, editors. Medical Image Computing and Computer-Assisted Intervention – MICCAI: Springer International Publishing, 2015:315-322. NIHMSID:NIHMS765239

  3. Preiswerk F, Cheng C-C, Luo J, Madore B. Synthesizing dynamic MRI using long-term recurrent convolutional networks. Conf. on Machine Learning in Medical Imaging 2018

Invited presentations

2019: Montréal, Québec, Canada. Motion correction with external sensors. Educational session at the 2019 ISMRM meeting.

2019: Boston, MA, USA. Ultrasound-based sensors for enhanced medical imaging performance. World Medical Innovation Forum.

2018: NYU, New York, NY, USA. Hybrid MRI-ultrasound acquisitions. ISMRM-sponsored workshop ‘i2i from innovation to implementation in imaging’.

2018: Boston, MA. Sensors to track the 3D position and orientation of US imaging probes. NCIGT workshop on Image-Guided Therapy.

2018: Proctor Academy in Andover, NH, USA. The instrumented scanner. Gordon Research Conference on In Vivo Magnetic Resonance.

2018: Paris, France. Concurrent MRI: Imaging of real-time events. Educational session at the 2018 ISMRM meeting.

Abstracts

  1. B Madore, C-C Cheng, and F Preiswerk. “Combining MR and ultrasound imaging, through sensor-based probe tracking.” Proceedings of the International Society of Magnetic Resonance in Medicine 2019. Montréal, Québec, Canada.
  2. P-H Wu, C-C Cheng, F Preiswerk, and B Madore. “Application of hybrid MR-ultrasound imaging to multi-baseline thermometry.” Proceedings of the International Society of Magnetic Resonance in Medicine 2018. Paris, France: p. 1493.
  3. B Madore, C-C Cheng, and F Preiswerk. 2018. “Ultrasound-based sensors, for enhanced medical imaging.” Proceedings of the fourteenth annual retreat of the Broad Institute 2018. Boston, MA, USA.
  4. C-C Cheng, G Belsey, SC Moore, F Preiswerk, P-H Wu, M Foley Kijewski, L Campbell, MF DiCarli, and B Madore. “Ultrasound-based sensors for motion correction of PET data.” Proceedings of the Society of Nuclear Medicine and Molecular Imaging 2018. Philadelphia, PA, USA.
  5. B Madore, C-C Cheng, and F Preiswerk. “Ultrasound-based sensors for physiological motion monitoring.” Proceedings of the International Society of Magnetic Resonance in Medicine 2018. Paris, France: p. 1004.
  6. F Preiswerk, M Toews, C-C Cheng, Jr-y Chiou, C-S Mei, L Schaefer, WS Hoge, B Schwartz, LP Panych, and B Madore. 2017. “Hybrid MRI-Ultrasound Acquisitions, and Scannerless Real-Time Imaging.” Proceedings of the International Society of Magnetic Resonance in Medicine 2017. Honolulu, USA: p. 0033.
  7. P-H Wu, F Preiswerk, C-C Cheng, B Madore. “Hybrid MR-ultrasound acquisition for multi-baseline thermometry.” Proceedings of the International Society of Magnetic Resonance in Medicine 2017. Honolulu, USA, p. 2587.
  8. F Preiswerk, J Cai, C-C Cheng, WS Hoge, P-H Wu, LP Panych, B Madore. “RF-sensing for Trigger-based Synchronization of Auxiliary Devices, and Pulse-sequence Debugging.” Proceedings of the International Society of Magnetic Resonance in Medicine 2017. Honolulu, USA, p. 4444.
  9. WS Hoge, F Preiswerk, JR Polimeni, SS Yengul, P Aksit Ciris, B Madore. “Ultrasound Monitoring of a Respiratory Phantom for the Development and Validation of Segmented EPI Reconstruction Methods.” Proceedings of the International Society of Magnetic Resonance in Medicine 2017. Honolulu, USA, p. 1307.
  10. F Preiswerk, C-C Cheng, P-H Wu, LP Panych, B Madore. “Ultrasound-based cardiac gating for MRI.” Proceedings of the International Society of Magnetic Resonance in Medicine 2017. Honolulu, USA, p. 4443.
  11. F Preiswerk, C-C Cheng, SS Yengul, LP Panych, and B Madore. “Scanner-less real-time MRI.” Proceedings of the International Society of Magnetic Resonance in Medicine 2016. Singapore: p. 2393.
  12. F Preiswerk, WS Hoge, M Toews, Jr-y Chiou, L Chauvin, LP Panych, B Madore. “Speeding-up MR acquisitions using ultrasound signals, and scanner-less real-time MR imaging.” Proceedings of the International Society of Magnetic Resonance in Medicine 2015. Toronto, Canada: p. 0863.
  13. M Toews, C-S Mei, R Chu, WS Hoge, LP Panych, and B Madore. “Detecting rapid organ motion using a hybrid MR-ultrasound setup and Bayesian data processing.” Proceedings of the International Society of Magnetic Resonance in Medicine 2014. Milan, Italy: p. 0681.
  14. M Toews, C-S Mei, R Chu, WS Hoge, BM Schwartz, G Wang, LP Panych, B Madore. “Novel target-tracking strategy for MR-guided procedures.” Proceedings of the International Society of Magnetic Resonance in Medicine 2013. Salt Lake City, UT, USA: p. 0478.