The Google AI Blog reports that AMIE, Google's medical AI system, has demonstrated potential in managing long-term health conditions, matching primary care doctors in overall reasoning and outperforming them in guideline alignment. However, the study's use of patient actors rather than real-world scenarios may limit its applicability. In our view, the real test will be how AMIE performs in clinical settings, where variability and complexity are far greater. The success of such AI systems will likely hinge on their ability to integrate seamlessly into existing workflows and gain the trust of both physicians and patients.