Researchers at Brigham and Women’s Hospital are exploring a powerful paradigm shift in minimally invasive surgery by combining 3D vision, computer vision, and surgical navigation. Their work aims to turn the endoscope from a simple visualization device into an active spatial intelligence system.

In skull-base surgery, a thin wall of bone is often all that separates a surgeon from critical structures like the internal carotid artery or optic nerve. Because traditional endoscopes only show what is directly inside their visual field, surgeons must constantly mentally integrate camera views with separate preoperative CT and MRI navigation data. New research published in JAMA Otolaryngology–Head & Neck Surgery investigates how to bridge that gap.

Key Technological Milestones

By blending stereoscopic 3D video with simultaneous localization and mapping (SLAM) algorithms and patient-specific imaging models, the research team demonstrated a pathway toward trackerless navigation. Highlights include:

• Trackerless 3D Reconstruction: Researchers successfully reconstructed exposed posterior sphenoid sinus anatomy from stereoscopic video and registered it to 3D CT models, achieving encouraging mean localization and registration errors in deceased-donor specimens.
• Retrospective Validation: Testing on surgical video from a patient undergoing endoscopic endonasal surgery for a tubercular meningioma demonstrated technical feasibility in mapping live video to preoperative models.
• Moving Toward "Antitargets": Future iterations aim to integrate machine learning to recognize critical anatomy and establish safety boundaries, helping surgeons identify structures they must actively avoid.

The Challenge of Dynamic Environments

While technical feasibility has been established, real-world surgery introduces bleeding, tissue deformation, and progressive bone removal that can cause static preoperative maps to drift. The ultimate frontier of surgical intelligence may not just be building a more accurate map, but enabling the system to recognize when its map can no longer be trusted.

Read more on the Surgery Gets Smarter substack to explore the complete methodology, technical frameworks, and the future of spatial awareness in the operating room.