A UK building-supplies distributor ran an AI pilot on its accounts-payable inbox. It read invoices accurately enough that the finance team stopped checking. Then a supplier's “new bank details” letter went through like any other invoice, and only the bank's payee check stopped the payment.
The pilot was switched off. The finance director still wanted the hours back, and nobody wanted to be the person who switched AI on again.
- Every field earns its own thresholdEngineers scored 600 past invoices field by field. Amounts and dates cleared the bar. Bank details never would, so they never post on their own.
- A change is a different jobA new IBAN, payee or remittance address becomes a change request, compared with the supplier record and sent to a named approver with both versions side by side.
- Prove it on last yearBefore go-live the system re-read twelve months of invoices. Every disagreement with what finance had actually paid was explained or fixed.
- Switched on by the person accountableThe finance director approved go-live after reading the evaluation report.
{ "supplier": "Hallam Timber Ltd", "invoice_total": { "value": 18420.60, "confidence": 0.99 }, "due_date": { "value": "2026-12-04", "confidence": 0.98 }, "iban": { "value": "GB29 NWBK 6016 1331 9268 19", "confidence": 0.97 }, "iban_on_file": "GB82 WEST 1234 5698 7654 32", "route": "approval_required"}- AI extractionIBAN read with 0.97 confidence. It does not match the account on file for this supplier.
- EngineerRule: any change to payee or bank details goes to a person, whatever the score.
- Your finance approverCalled the supplier on the number in our records. Change confirmed, payment released.