Every Monday I open the bank balance and hope.
Story · Case study
Controls testing that stopped being a spreadsheet
Sample selection, testing evidence and the exceptions list lived in one workbook that one person understood.
The company
- Company
- Sanderson Group
- Industry
- Financial services
The starting point
Sanderson Group's controls testing lived in a forty-tab workbook: the sample selection, the testing evidence, the exceptions, and a set of formulas that decided which of a population of transactions got tested. It worked. It had worked for six years.
The finding that started this was not about the workbook's accuracy. It was that one person could open it, and that the head of internal audit could not describe, in a meeting, how a sample had been selected — she could only show that it had been.
What changed
What they described
The description was written by two people: the audit lead and a control owner. It set out what a control population is, how a sample is drawn from it and with what seed, what evidence a tested control has to carry, and what makes an exception an exception rather than a note.
The seed clause is the one worth repeating. A sample that cannot be redrawn identically is a sample that has to be defended by trust; the description says how the draw is reproduced, and the application implements that rather than a random selection nobody can repeat.
The results
What the audit lead says
That the point was never speed. Five weeks instead of nine is welcome and it is not why the change was approved. It was approved because the method is now written down somewhere other than in one person's head, and can be described in a meeting by anybody who runs it.
Controls tested per cycle
146
Exceptions raised
9
each one owned before the cycle closes
Weeks per testing cycle
5 wks
from nine
People who can open the work
7
previously one
“The workbook was not the risk. The one person who could open it was the risk.”
— Amara Osei, Head of internal audit, Sanderson Group (an example business)
The apps
Connected to this story
Read next
Why: Day in the role, with an example app you can try today
Tell me when it's ready
What happens next
Thank you. We will write once, when it's ready.