Chapter 6 resources

The Data Leak

Check whether the numbers you use are complete, consistent, and connected to decisions someone actually makes.

About this chapter

Make the numbers usable in a decision.

Start with a decision the business needs to make, such as where to spend advertising money or where customer requests are being delayed. Then identify the records needed to make that decision.

Compare definitions across systems. A form submission, a qualified inquiry, a booked appointment, and a sale describe different events. Reports become confusing when those events share one label or are counted more than once.

What to check

Questions worth reviewing.

Definitions

Write down what each reported number includes and excludes.

Completeness

Look for missing records, duplicate events, and disconnected reporting periods.

Connections

Check whether marketing, customer, and sales records can be matched appropriately.

Access and responsibility

Confirm who maintains the data and who can use it, with suitable permissions and privacy controls.

Chapter resources

Request The Data Health Check.

Your request goes to the Caboodle team. Please leave out private financial or customer records.

After the review

Choose what to change first.

01

Choose a few useful measures

Select numbers tied to a decision you make regularly.

02

Check a sample against the records

Trace a few reported results back to the original events.

03

Set a review schedule

Assign someone to maintain the definitions and investigate unexpected changes.