MMCTAgent: Enabling multimodal reasoning over large video and image collections
| Akshay Nambi, Kavyansh Chourasia, and Tanuja Ganu
MMCTAgent enables dynamic multimodal reasoning with iterative planning and reflection. Built on Microsoft’s AutoGen framework, it integrates language, vision, and temporal understanding for complex tasks like long video and image analysis.
AI tools can perform poorly in non-Western languages and lack critical cultural context for many populations. Project Gecko uses small language models to bring vital expertise to farmers in underserved areas using local languages and multi-modal content.
In the news | AI Ireland
E204 ‘Multilingual Innovation and AI’ with Microsoft’s Kalika Bali
Today’s guest is Kalika Bali, Senior Principal Researcher at Microsoft Research India. In the episode, Kalika talks about her intriguing journey and impactful work, as well as peeling back the layers of how accidental moments can shape careers and how…
From childbirth to chronic disease, India’s rural healthcare workers face it all. Now, they have a tool that listens—and answers—in the languages they use every day.
In the news | CNBC
How Microsoft, Physics Wallah are bringing AI-driven learning to Indian classrooms
As part of its broader $3 billion AI and cloud investment in India, Microsoft is deepening its focus on education through a collaboration with edtech company Physics Wallah, aimed at improving learning outcomes using AI-powered tools and personalised academic support.
Research Focus: Week of May 7, 2025
In this issue: New research on compound AI systems and causal verification of the Confidential Consortium Framework; release of Phi-4-reasoning; enriching tabular data with semantic structure, and more.
Research Focus: Week of April 21, 2025
In this issue: our CHI 2025 & ICLR 2025 contributions, plus research on causal reasoning & LLMs; countering LLM jailbreak attacks; and how people use AI vs. AI-alone. Also, SVP of Microsoft Health Jim Weinstein talks rural healthcare innovation.
LLMs for safe low-level programming
Aseem Rastogi and Pantazis Deligiannis talk about two technical results from ICSE 2025 on using large language models (LLMs) for safe low-level programming. The results demonstrate LLMs inferring machine-checkable memory safety invariants in legacy C code and how LLMs assist…
Microsoft Research and Physics Wallah team up to enhance AI-based tutoring
| Chris Stetkiewicz
Limited resources, geography, and economic factors present barriers to quality education for many students in India. Learn how Microsoft Research is collaborating with Physics Wallah to make AI-based tutoring more accurate, reliable, and affordable.