CaBot-Live
An open-source voice-and-video AI physician for primary care telehealth visits, with a background Supervisor that checks the visit against clinical guidelines.
Draft note: Repository link placeholder.
Draft note: NHS 111 Cabot is a spin-off of CaBot-Live. No NHS affiliation or endorsement is claimed. Repository link placeholder: add once public. Paper link to add on publication.
Problem
Real-time voice and video AI is fast but can be unsafe, and it is unclear whether such systems truly see the patient or infer findings from the conversation.
Intended users
To add: Who was this for? Distinguish intended users from people who have used it.
My contribution
I am a co-first author of the CaBot-Live paper from the Manrai Lab at Harvard Medical School. I worked on the physical-examination red-teaming, the physician interactions in the evaluation, and the technical design and development of the system.
Implementation
A Realtime model wraps a frontier reasoning model in streaming speech-to-text and text-to-speech. A Supervisor model re-reads the visit each turn and retrieves from a library of clinical practice guidelines.
Important tradeoffs
To add: Describe a decision, the alternatives and why you chose this approach.
Verification
To add: What did you test, review or observe? Add evidence and limitations.
Outcomes
Paper under review. I will link it here on publication.
Relevant links
Draft note: Add repository, demo and supporting evidence only when supplied or verified.