← All use cases

Canada Revenue Agency · Ottawa, ON

Failure: Auditor General finds CRA's 'Charlie' chatbot answered only 2 of 6 tax questions correctly

Failure / lessonTaxCustomer Support

2/6 correct

What was done

As part of a 2025 audit of CRA contact centres, the Auditor General tested CRA's public chatbot, Charlie, on general tax questions.

Outcome

Charlie answered 2 of 6 general tax questions accurately, while other public AI tools tested got 5 of 6. The audit also found low accuracy among phone agents. The takeaway for Canadian businesses is to double-check tax answers from any bot against CRA guidance.

Evidence: Auditor General report / news. Figures are as reported by the source and have not been independently audited by AgentsNorth.

Prompt Reconstructed by AgentsNorth

The source didn't publish its prompt. This is our reconstruction of a starting prompt for a similar workflow, not the company's actual prompt.

Answer this Canadian tax question, then list the specific CRA page or Income Tax Act section supporting each claim. If guidance changed in the last two years or depends on facts you don't have, say so clearly. Question: [question]

Related use cases

Get new Canadian AI agent use cases each week

New use cases, one prompt to steal and one failure to avoid. Free. Unsubscribe anytime.