Meeting Banner
Abstract #5126

Accurate, markerless optical tracking of head pose for motion correction: A dual-camera simulation with deep learning

Marina Silic1,2 and Simon J Graham1,2
1Medical Biophysics, University of Toronto, Toronto, ON, Canada, 2Sunnybrook Research Institute, Toronto, ON, Canada

Synopsis

Keywords: Motion Correction, Motion Correction, optical tracking, head pose estimation, brain

Motivation: Deep learning methods for head pose estimation may enable accurate, markerless optical tracking (OT), overcoming practical limitations of OT for motion correction in clinical MRI.

Goal(s): To compare the ability of three neural networks to track incremental changes in head pose in 6 degrees of freedom (6DOF) with sub-millimetre/sub-degree accuracy.

Approach: We generated a dataset of 20 heads in a simulated MRI environment with in-bore, dual-camera markerless OT and pre-trained the networks prior to training on a real-world dataset.

Results: The twin neural network had the lowest test loss (0.13 mm/° across all 6DOF) showing merit in the approach.

Impact: Accurate, markerless OT is feasible in simulations with two in-bore cameras and deep learning. Pre-training of a twin neural network was successful (mean RMSE = 0.13 mm/degrees) motivating additional development in the real world, towards motion correction in MRI.

How to access this content:

For one year after publication, abstracts and videos are only open to registrants of this annual meeting. Registrants should use their existing login information. Non-registrant access can be purchased via the ISMRM E-Library.

After one year, current ISMRM & ISMRT members get free access to both the abstracts and videos. Non-members and non-registrants must purchase access via the ISMRM E-Library.

After two years, the meeting proceedings (abstracts) are opened to the public and require no login information. Videos remain behind password for access by members, registrants and E-Library customers.

Click here for more information on becoming a member.

Keywords