Align eCare
Align eCare / Press & media / Articles

Article · November 17, 2026 · Karolyn Law, Founder

Ontario’s Auditor General Tested 20 Approved AI Scribes. The Results Should Worry Every Clinic.

Nine fabricated information that was never said. Twelve recorded a different drug than the one prescribed. Seventeen missed mental-health details that were right there in the conversation.

Analysis
Request a pilot How it works

Those are not numbers from a vendor’s competitor slide, a preprint, or a conference talk. They are findings of the Office of the Auditor General of Ontario, in its Special Report Use of Artificial Intelligence in the Ontario Government, released May 12, 2026. Auditor General Shelley Spence’s team examined how the province’s 20 approved AI scribe systems performed when Supply Ontario’s procurement evaluators ran simulated doctor-patient recordings through them before the systems were made available to physicians.

Every category of error a clinician fears was in there:

The approval process did not stop them. The Auditor General found that 11 of the 20 approved vendors submitted no third-party audit reports, SOC reports or ISO 27001 certification, and five did not submit the threat risk assessments and privacy impact assessments the process required. They were approved anyway.

The province’s response, fairly stated

Ontario’s answer deserves a place in this article, because it is partly right. The errors were found during procurement testing on simulated recordings, not in live patient care. OntarioMD issued guidelines asking doctors to review the generated notes before relying on them. And the province has said it is not aware of patient harm among the more than 5,000 Ontario physicians now using these tools.

All of that can be true, and the report still matters. Here is why.

What the report actually proves

The report does not prove that AI has no place in a clinic. It proves something more specific and more useful: the safety of these systems rests on a habit, not a mechanism.

“The physician reviews the note” is the whole safety model. It depends on a tired doctor, at the end of a long day, catching a fabricated referral or a wrong drug in a fluent, confident draft that reads exactly like the thousand correct drafts before it. The Auditor General made the same point in plainer terms: doctors were not required to attest, through a sign-off in the system, that they had verified the generated notes, and the report recommends that systems enforce that attestation. That is a design gap, not a doctor gap.

The second lesson is about procurement. Twenty vendors were approved largely on their own reported data and self-attestations, some without the required independent assessments on file. When a health system buys AI on trust, it gets the accuracy it inspected for. The Auditor General made 10 recommendations to strengthen how AI is evaluated and governed. The Ministry of Health agreed with all five addressed to it; Supply Ontario agreed with four of its five and partially agreed with the fifth.

Why we are building the layer after the note

Align eCare does not write the clinical note, and this report is one reason why. Scribes write notes. Align eCare is being developed to execute the paperwork that follows the visit, and to prove it: the forms, the referral, the prescription paperwork and the billing evidence, prepared from the encounter and from sources that can be shown, not generated from a model’s confidence.

Our design responds to the Auditor General’s findings point by point:

None of this makes any AI system infallible, including ours, and this article would not deserve your trust if it claimed otherwise. The aim is to make errors visible, checkable, and stopped at a gate a named clinician controls, which is the standard the Auditor General’s report implicitly sets.

The work continues in New Brunswick

Align eCare is being built in New Brunswick, for the teams working to attach the patients who need care most: people relying on remote care, rural patients, unattached patients and seniors. Align eCare is in development, and a measured pilot is how we intend to put numbers on the table, in a clinic’s own results, before anyone is asked to believe a claim, ours included. If your team is evaluating AI tools this year, the Auditor General’s report is the right place to start, and the questions it raises are the right ones to ask every vendor, including us.

Sources

Share this article

LinkedIn · X · Email