Fraunhofer Institute for Machine Tools and Forming TechnologyFirst European Spatial Computing Healthcare Summit, June 25–27 in Leipzig
Smart glasses and robotic systems are revolutionizing “keyhole surgery”
In areas of the body where space is extremely limited and delicate nerve or vascular structures must be preserved, so‑called minimally invasive surgery is required. Robotic systems that translate a surgeon’s movements with high precision, in real time, and with millimeter accuracy – while also filtering out even the slightest tremor – are already being used successfully in clinical practice. Now, combining this technology with smart glasses promises a further leap in innovation. In spatial computing, these devices visualize information directly within the surgeon’s field of view, displaying what cannot be seen from the outside. Precise, high-resolution patient imaging data – such as MRI scans – serve as the basis for guiding the path to the target area.
Robotic systems like Da Vinci (Intuitive Surgical) and smart glasses reach their full potential particularly in urology. The underlying platform technology was developed in the neurosurgery department of Leipzig University Hospital (LUH) and at the Fraunhofer IWU. On the way to – and once at – the target area, sensitive tissue structures should be preserved whenever possible. If instruments feature tiny, fully articulated “wrists” at their tips with additional degrees of freedom, they achieve a flexibility far beyond that of the human hand. This enables surgeons to operate precisely, even in extremely confined spaces. In urology, for example, during prostate removal, highly targeted procedures help protect the delicate nerves responsible for continence and potency.
Procedures in the oral and maxillofacial region are also likely to benefit from navigation support in the future, beginning with minimally invasive access through the jaw. The system overlays patient data directly onto the real anatomy; instruments are displayed in real time within the anatomical environment. The position of nerves such as the inferior alveolar nerve, the course of tooth roots, or tumors becomes clearly visible, which can assist in planning drilling directions. Real-time instrument tracking would facilitate safe implant drilling and navigation during tumor removal. Intuitive operation through a “learned” user logic and visualization limited to essential information further simplifies complex 3D orientation. Extremely tight target regions limit the use of robotics, depending on the access route. However, spatial computing remains valuable even in such cases: additional imaging information – such as exact access paths and the precise location of a tumor – provides critical guidance when blood and tissue dominate the surgeon’s direct view.
In tumor orthopedics, researchers led by PD Dr. habil. Ronny Grunert, a research scientist at Fraunhofer IWU (Zittau) and head of the “LEGEND” research group at the Department of Neurosurgery at Leipzig University, also sees valuable applications for both technologies. In removing growths from the extremities, the principle of “remove as much as necessary, but as little as possible” can be implemented more effectively. Tumor boundaries are often not directly visible, and safety margins (so-called resection margins) must be maintained, while preserving as much healthy tissue as possible. When a tumor lies deep and close to nerves or vessels, precise access, accurate micro-movements, and stable cuts can be decisive for surgical success.
Linking MRI data and smart glasses: an app from IWU and LUH
As a result of many years of research and development, an app developed by Fraunhofer IWU and Leipzig University Hospital (LEGEND research group) has been available for just over a year. It is designed for use with standard smart glasses such as the Apple Vision Pro. This significantly reduces system costs and makes spatial computing accessible even to clinics and hospitals with smaller budgets.
Over the past 18 months, Leipzig and the Southwest Saxony region have attracted international attention through this app, even Apple’s attention.
First European Spatial Computing Healthcare Summit: June 25–27, 2026, in Leipzig I State Minister Gemkow banks on new partnerships
Premiere: Fraunhofer IWU is hosting the first European conference dedicated to medical applications of spatial computing. The summit brings together practicing surgeons and operating room leaders, and also targets stakeholders from medical technology, industry, clinical practice, and applied research. The event partner is Leipzig University Hospital, renowned for its expertise in neurosurgery. Real-world use cases from clinical practice and research will be presented, along with the technical and regulatory framework for spatial computing in medicine. The goal is to rapidly translate medical innovations into practice across various surgical disciplines. The long-term vision is to establish a European center for spatial computing (in medicine) in Saxony.
Sebastian Gemkow, the Saxon State Minister for Science, emphasizes: “Saxony brings together internationally recognized excellence in biomedical research, medical technology, and knowledge transfer—across universities, university hospitals, and numerous research institutions. This creates an environment in which innovations can move rapidly from discovery into patient care. However, innovation ecosystems do not emerge overnight; they require trust, openness, talent, and long-term commitment, as well as people willing to build bridges between disciplines that have not always worked closely together. I hope that this summit will spark new partnerships, new ideas, and perhaps even new institutions that will help shape the future of medicine in Europe.”
Spatial Computing Navigation Explained
Spatial computing navigation refers to orientation and movement within a fused environment of digital and physical worlds.
Unlike traditional navigation, spatial computing dynamically recognizes position, surroundings, and objects, and derives interactive visual or auditory guidance from this information. This creates an “intelligent, spatially anchored” form of navigation that not only shows directions but understands and responds to the environment – such as in medicine, robotics, or autonomous vehicles.
