MRConsultation
An asymmetric mixed reality teleconsultation system that lets patients communicate pre-surgical queries to their doctors spatially, using AI-synthesized 3D organ models built from CT imaging data.
HCI Lab, IIITS MRConsultation pairs a native Meta Quest 3 app, where patients spatially annotate their case, with a web-based portal for specialists, currently in active development, where they'll review and respond asynchronously. A medical imaging-to-3D pipeline turns diffusion-synthesized CT scans into realistic organ digital twins, segmented and optimized through TotalSegmentator and Blender for real-time rendering on Quest 3.
At its core is an interactive spatial annotation engine: patients use hand tracking to anchor text notes and recorded voice messages directly onto the organ mesh for specialist review. A usability pilot has been completed, and its findings are shaping a follow-up study targeting IEEE VR / ACM CHI.
