Google shows AMIE doing real-time medical video consultations

Google Research and Google DeepMind have shown a new version of AMIE, their research medical AI system, that can handle real-time clinical video consultations. Built on Gemini and Project Astra with a multi-agent architecture, AMIE can interpret visual and audio cues, guide parts of a virtual physical exam and reason through diagnoses during a live simulated encounter.

Google says the system was tested in randomized simulated consultations with patient actors and primary-care physicians. Clinical evaluators rated AMIE favorably on history-taking, diagnostic accuracy, management appropriateness and communication quality, and patient actors preferred the video experience over text chat.

The caveat is essential: AMIE is still a research system, not a clinical product. Google says more research is needed before responsible real-world deployment. Even so, the work is notable because medical AI is moving from answering health questions in text toward multimodal consultations that can observe, ask follow-up questions and reason in real time.