A novel augmented reality to visualize the hidden organs and internal structure in surgeries

Background: Augmented reality (AR) is still a primarily theoretical concept in areas such as bowel, liver, gallbladder, and jaw surgeries because of the limitation of visualization accuracy of hidden organs and internal structures. This paper aims to improve the cutting accuracy, visualizing accuracy, and processing time of the augmented video. Methodology: The proposed system consists of an enhanced block-matching algorithm (BMA) with ghosting map technique. Results: Results proved that proposed system reduced the visualization error, which ranges from 1.48 to 1.83 mm against the existing system visualization error 1.67 to 2.0. Similarly, the processing time also improved 59 to 72 ms/frame over the 50 to 58 ms/frame. Conclusion: This study showed the improvement and solved the problem soft tissue reconstruction and visualization on the AR video that used in bowel and gallbladder surgeries.