female radiologist analyzing an MRI image of the head

Project MAIRA

Multimodal AI for Radiology Applications

Project MAIRA is a research project from Microsoft Health Futures that builds innovative, multimodal AI technology to assist radiologists in delivering effective patient care and to empower them in their work. The goal of the project is to leverage rich healthcare data – including medical domain knowledge, temporal sequences of medical images and corresponding radiology reports, and other clinical context information – as inputs to developing multimodal frontier models that can be scaled and fine-tuned to many different radiology applications.

Schematic illustration of multimodal healthcare data as input to the MAIRA foundation model which enables multiple different user applications such as draft report generation, disease classification or error detection.

New approaches combining various data modalities and their temporal connections enable AI tasks such as: detecting reporting errors; auto-generating draft reports; or improving disease progression assessments and their quantification over time. Such innovations will play a crucial role in detecting missed clinical observations; improving reporting capacity in an already heavily over-burdened radiology workforce; and assisting reporting consistency, accuracy and equity – all of which serve to reduce shortcomings in existing imaging workflows and to increase patient safety and care quality.  

To advance this work requires a human-centred, responsible approach to AI development that places clinical utility and careful workflow integration at its core. This involves close stakeholder engagements and clinical collaborations within real-world healthcare contexts; the creation of a new research frontier in evaluating large multimodal models in a clinically relevant manner; and an overall drive to move from technical AI innovation towards successful healthcare delivery.