Hours saved, error rate, and revenue per call. The three measurement frameworks that hold up to a CFO. Plus the two that do not.
CFOs do not care about token cost. They care about three things: hours saved (measurable), error rate (measurable), and revenue per touch (measurable). Below are the three ROI frameworks that hold up to a CFO, plus the two that do not. What we would do differently next time Looking back at the last six deployments in this category, three things we would do differently: Start the eval harness on day zero. We have always said this and we have always slipped it.
The first time we shipped without a regression eval, we caught a prompt change that silently degraded conversion by 11 percent for two weeks before anyone noticed. Now we treat the eval harness as the first deliverable, before the first prompt. Get the executive sponsor in the first user-acceptance session. Not the project manager, not the ops lead. The owner or the C-suite person whose name is on the budget.
Hours saved, error rate, and revenue per call. The three measurement frameworks that hold up to a CFO. Plus the two that do not. It is filed under AI Strategy because that is where operators looking for this problem actually start, and it is written from production work rather than from a content calendar.