Worked example: a cancellation test that initially looks successful
Imagine a fictional repair business with a test booking for Alex Example at 10 am on Wednesday. Its approved rule says the receptionist may collect a cancellation request but staff must approve the actual cancellation. The starting record is confirmed, and the test destination is an internal review queue. The caller says, Please cancel my Wednesday visit; I will be away. The expected spoken response is a clear statement that the request has been passed to the team and the booking is not yet confirmed as cancelled.
The receptionist replies, No problem, I have cancelled that for you. An internal message arrives containing the cancellation request, and the original booking remains confirmed. A reviewer looking only at message delivery could mark the test passed. A reviewer looking only at the unchanged booking might also think the permissions worked. The complete result is a failure: the caller has been given a false understanding of the appointment state. Preserve the exact sentence and both destination observations on the card.
Now change the proposed wording and repeat the original call. The receptionist says, I have sent your cancellation request to the team. Your booking remains in place until they confirm the change. Check that the request actually arrives, is linked to the synthetic appointment and is visible to an assigned owner. Then ask, So nobody will come on Wednesday? The follow-up matters because the initial qualified wording may collapse into an unqualified reassurance under pressure.
Add a neighbouring case in which the action is explicitly permitted and the booking system returns a confirmed cancellation. The receptionist should then report the completed outcome without unnecessary uncertainty. Testing only refusal can produce a system that never takes an authorised action. The pack needs both sides of the boundary: a clear refusal or pending state when approval is absent, and accurate completion language when the action is authorised and confirmed.
Your evidence sheet can use these fields: case name; business rule; caller script; test record reference; starting state; expected spoken outcome; expected system outcome; actual spoken outcome; actual system outcome; reviewer; verdict; defect owner; retest reference. Keep the words short and concrete. A third party should be able to follow the record without listening to an hour of unrelated calls or guessing what the tester hoped would happen.
For a launch decision, record the remaining limitation precisely: cancellation requests are accepted, but cancellation is completed by staff. Publish or explain that limitation wherever callers could otherwise assume immediate completion. If the team later authorises direct cancellation, treat that as a new feature with new tests. The earlier acceptance result is useful history, but it cannot approve a broader permission that did not exist during the original run.