Project Week 25/Intra-operative deformable registration based on dense point cloud reconstruction

From NAMIC Wiki
Revision as of 13:28, 20 June 2017 by Marianna (talk | contribs)
Jump to: navigation, search
Home < Project Week 25 < Intra-operative deformable registration based on dense point cloud reconstruction


Back to Projects List

Key Investigators

Project Description

Objective Approach and Plan Progress and Next Steps

In this project, we aim at developing a feasibility study of a context-aware augmented-reality system for laparoscopic applications. The system combines confident intra-operative multi organ semantic segmentation and 3D reconstruction to automatize intra-operative registration of pre-operative organ models.

  • Starting from:
    • Intra-operative multi organ semantic segmentation
    • Dense tissue reconstruction [1]
  • The plan is to develop:
    • A module for deformable registration of the pre-operative tissue models with the reconstructed intra-operative semantic point cloud.

Illustrations

Background and References

Laparoscopy allows performing surgery through few small incisions, reducing patient’s trauma and improving the surgical outcome. Despite the recognized medical benefits, it suffers from some limitations, which include limited maneuverability, reduced haptic, and limited field of view of the surgical scene [1]. Augmented Reality (AR) systems can attenuate some of these issues by providing an enhanced view of the surgical site. One of the main open technical challenges in this field is the initial cross-modality registration between the pre-operative planning (obtained with CT or MRI) and the intra-operative surgical scenario [2]. Dense 3D image reconstruction and image semantic analysis can be exploited to establish the cross-modality correspondences by automatically detecting and localizing organs in the 3D endoscope field of view. Deformable registration can be then performed to register the pre-operative model into the reconstructed surgical scene.

  1. V. Penza, J. Ortiz, L. S. Mattos, A. Forgione, E. De Momi, "Dense soft tissue 3D reconstruction refined with super- pixel segmentation for robotic abdominal surgery." International journal of computer assisted radiology and surgery. 2016; 11(2):197-206.
  2. G. Taylor, J. Barrie, A. Hood, P. Culmer, A. Neville, and D. Jayne, “Surgical innovations: Addressing the technology gaps in minimally invasive surgery,” Trends in Anaesthesia and Critical Care. 2013; 3(2):56–61.
  3. S. Bernhardt, S. A. Nicolau, L. Soler, C. Doignon, (2017). “The status of augmented reality in laparoscopic surgery as of 2016”, Medical image analysis. 2017; 37: 66-90.
Retrieved from "https://www.na-mic.org/w/index.php?title=Project_Week_25/Intra-operative_deformable_registration_based_on_dense_point_cloud_reconstruction&oldid=96534"