Augmented Reality for Ultrasound Guided Surgical Interventions by Raj Shekar at the 2019 MAVRIC Conf

The applications of augmented reality (AR) in medicine continue to be explored. The ever-increasing computational power is now making real-time fusion of live images possible enabling surgical applications. Ultrasound guidance for surgical applications is especially common and ranges from simple procedures such as vascular access to complex surgical procedures. The focus of this talk is two ultrasound-guided surgical AR systems we have developed. Laparoscopic surgery is an attractive alternative to conventional open surgery and is known to improve outcomes, cause less scarring, and lead to significantly faster patient recovery. Standard laparoscopy cannot visualize anatomy beyond what is present in front of the laparoscope. Conventional laparoscopic ultrasound imaging provides information on subsurface anatomy, but can only be integrated with the laparoscopic images in the surgeon’s mind. Additionally, focus is distracted from the laparoscopy screen to look at ultrasound images on a separate screen. We have developed an AR system that fuses real-time ultrasound images with live laparoscopic video, allowing explicit visualization of subsurface structures (blood vessels, bile ducts, tumors, etc.) in the surgical field of view. Potential applications of this system include laparoscopic partial hepatectomy (liver resection) and laparoscopic radiofrequency ablation of liver cancer. A first-generation prototype was tested on 13 human cases at Children’s National, the results of which led to the development of a second-generation prototype that is being tested preclinically and will be evaluated clinically at Children’s National and University of Pittsburgh Medical Center. Using ultrasound guidance during interventions generally involves the clinician splitting their attention between examining the ultrasound screen and paying attention to the patient while also advancing a needle or another instrument into the body. The needed hand-eye coordination is a skill that requires years of training. Overlaying live ultrasound on the clinician’s view has numerous advantages including potentially reducing complications and shortening the learning curve. Using Microsoft Hololens as the wearable AR platform, we have developed an app that allows the user to project the ultrasound image directly onto the part of the body being imaged, giving the user a real-time view of the anatomical structures. Additional features allow making various enhancements to the image using voice activation. This system, whether used for education or in actual procedures, enhances precision, efficiency and user experience. User studies are underway to quantify these AR-enabled benefits.

CAE HPSN World 2019 “Augmented Reality in Healthcare” Panel

Presenting the future of #mixedreality in healthcare simulation during #hpsnworld19 with Eric Kamont of #Microsoft followed by a discussion on Microsoft #HoloLens in healthcare training. Panelists include Jay Reid of Medtronic, Dr. Davinder Ramsingh of Loma Linda University, Dr. Jared Staab of University of Kansas Medical Center and Eric Kamont with moderator Devin Johns of CAE Healthcare.

CAE and Microsoft – Improving Safety with Innovative Training Technology

CAE offers virtual-to-live, simulation-based training solutions that assess human performance and help improve overall safety from healthcare and civil aviation, to defense and security operations. In working with Microsoft, #CAEHealthcare uses advanced #healthcaresimulation and #augmentedreality technology (Microsoft HoloLens) to train clinicians and health care providers to improve #patientsafety. Learn more at

JJRR Ep37 Re-inventing medical school education – Augmented reality applications for HoloLens -…

Jeff Mlakar is a technologist who's found his dream job developing cutting edge applications in augmented reality.  Listen to Ep37 as Jeff describes how he first discovered Microsoft's HoloLens and how now he's helping Case Western Reserve University and the Cleveland Clinic reinvent medical school education. Through the Interactive Commons at CWRU, Jeff and his team are eliminating the need for a physical cadaver lab for the new med school and replacing it with  a shared augmented reality curriculum. 03:56s Reinvention of medical school education as we know it 06:58s The interdisciplinary center at Case Western Reserve University 08:45s The 20th century classroom experience 10:30s Jeff’s background in technology and discovering Microsoft’s Hololens 13:02s Teaching gross anatomy without the use of a cadaver laboratory 15:40s Microsoft’s mixed reality headset, the Hololens 20:40s Cleveland Clinic and CWRU leading Hololens application development 23:15s Biomedical illustrators and 3D animators from Cleveland Institute of Art 26:58s Building scalable infrastructure / software platforms 29:48s Virtual reality vs augmented reality and the value of shared experiences 32:35s Demoing an architecture 3d model application and using existing 3d content 37:45s Controlling and experiencing virtual images with Hololens 41:45s Sharing experiences with others over the internet with wifi 45:15s Having remote meetings but sharing space with avatars i.e. “Jedi Council” 53:32s Trying things and seeing what works, exploring applications 55:53s Shifting mindset from no to let’s try it 57:38s Realizing how much fear has been ingrained with the old learning process “This is the next revolution of how we interact with technology” “If we don’t have that physical co-presence with each other, it’s really difficult to have a full, really impactful educational experience. That’s why the Hololens is a game changer for us.” Enjoy this episode? Share it with friends! Click Subscribe in iTunes!

Hololens In-Action at Cleveland Clinic

Cleveland Clinic, Case Western Reserve University and Microsoft are transforming healthcare with the augmented reality system known as Hololens. Using the system for educating the next generation of caregivers and studying ways to take it from the classroom to the exam room and ultimately the operation room, researchers are ushering in a new generation of medicine.

Where augmented reality meets healthcare | Nadine Hachach-Haram | TEDxCoventGardenWomen

In this highly inspiring talk, Nadine Haram Hachach illustrates how technological innovations are reshaping healthcare and medical services. By sharing her journey developing an augmented reality collaborative platform combining the power of telecommunication and augmented reality, she demonstrates how technology can become an unstoppable force for good. This talk was given at a TEDx event using the TED conference format but independently organized by a local community. Learn more at

Medical Applications of VR and AR Technology | #SVVR2017

Medical Applications of VR and AR Technology | #SVVR2017

Walter Greenleaf, PhD, Stanford University Medicine and health care will be one of the largest and deepest markets for virtual reality and augmented reality technology. This workshop will bring together the leading research scientists, clinicians, and entrepreneurs to discuss the opportunities and challenges of developing clinical and wellness products that leverage VR/AR. Examples will be provided demonstrating how VR/AR technology is being used to improve clinical assessments, promote wellness, revolutionize medical treatments, and revamp medical training. ------------------------------------------------------------------------- ▼ Visit our page for more info ▼ ------------------------------------------------------------------------- ▼ Connect with Us ▼ ▷ Twitter → ▷ Meetup → ▷ Facebook → ▷ Snapchat → ▷ Instagram → -------------------------------------------------------------------------

Scroll to top

By continuing to use the site, you agree to the use of cookies. more information

The cookie settings on this website are set to "allow cookies" to give you the best browsing experience possible. If you continue to use this website without changing your cookie settings or you click "Accept" below then you are consenting to this.