Why Most Companies Can’t Answer “Is AI Working?”
Most companies can tell you how many AI licences they bought. Far fewer can tell you what changed because of them.
Every quarter, the same conversation happens. A board member asks about AI. The person responsible, could be the CTO, the COO, a VP of Engineering, whoever drew the short straw, says the team is exploring it. The board nods. Next quarter, same question, same answer.
I’ve been in that room. I’ve watched this loop across multiple companies now. The problem isn’t the tools. It’s that nobody treats AI adoption the way they’d treat any other organizational change. There’s no diagnosis. No clear owner. No numbers.
Where It Breaks Down
The first gap is between access and adoption. Companies buy licenses, announce the rollout, maybe run a training session. Then they check the dashboard and see logins. But logins aren’t adoption. Adoption means a workflow actually changed. Someone stopped doing something the old way and started doing it differently, not during a workshop, but on a Tuesday morning when nobody’s watching. Most companies never get past this stage. People try something, it’s interesting, they go back to what they were doing. A license doesn’t change how someone works. That takes more than a rollout email.
The second gap is between usage and impact. Even when people use the tools regularly, that doesn’t mean the business got anything from it. “The team is getting comfortable with AI” is not something you say to a board. Impact means you can point at a specific workflow and say: this is different now, and here’s what it saved us. If you can’t do that, you have activity, not results.
The third gap is ownership. AI adoption gets treated as a shared responsibility. Engineering is exploring it. Product is curious. Marketing tried it for some copy. Everyone is doing something. Nobody is tracking any of it. Six months pass, nothing has moved, and the whole thing becomes background noise.
What I Keep Hearing From Other Leaders
I moderated a roundtable and ran a webinar on this recently. Two things kept coming up.
ROI is hard to measure. Most companies I talked to can’t put a clean number on what AI adoption has done for them. Everyone feels behind on this. Almost nobody has figured it out yet.
But the companies making progress all had one thing in common. Someone owned it. Not a working group. Not a Slack channel. One person who tracked what was happening, reported on it, and could answer the question “did anything change?” That came up in almost every conversation. Nothing else was even close.
The Board Question You Should Prepare For
Board questions about AI are getting sharper. It used to be “what’s your AI strategy?” Now it’s closer to “you bought licenses for the whole company, what has the company gotten back for it?”
You need numbers for that. You need to show that something changed, not just that people tried things and had opinions about them. If you can’t answer it yet, most people can’t. But start working on it. That gap doesn’t stay invisible for long.
A Starting Point
I built an open-source framework for this. The AI Adoption Playbook runs inside Claude Code and it’s built for anyone responsible for AI adoption, founders, CTOs, CAIOs, VPs of Engineering, COOs. It walks you through a diagnosis: where is adoption stuck, why, and what to do about it. Then it helps you build a 90-day plan with actual owners and milestones. There’s also a board narrative coach that plays the skeptical board member so you can practice before the real thing.
It won’t solve everything. But it forces the conversations most teams keep avoiding. And if you’re in this phase and want to think it through with someone who’s seen it a few times, I’m happy to talk.