AI adoption doesn’t fail because the technology doesn’t work. It fails because people don’t trust it, understand it, or know what to do with its outputs. Copilots are a perfect case study. They are technically impressive, broadly accessible, and create a deceptively simple user experience. Type a prompt. Get a response. The interface feels familiar. The risk is invisible.
That risk sits in several places simultaneously: users overtrust outputs without verification, avoid the tool entirely because they don’t know when it is safe to use, use it enthusiastically for low-stakes tasks while ignoring higher-value applications, expose data they shouldn’t, or produce outputs that look plausible but contain subtle errors that propagate into business decisions.
Why AI copilots create a new kind of adoption problem
Traditional software adoption has a clear pattern: users must learn the tool to complete their work. AI copilots break that pattern. The tool can be completely avoided without anyone noticing because users can continue working the old way. Or it can be overused because the output looks authoritative even when wrong. Neither outcome is visible in login metrics.
There is a precise way to describe what has changed. In IEEE Transactions on Systems, Man, and Cybernetics, Raja Parasuraman, Thomas Sheridan and Christopher Wickens set out a model of four information-processing stages that automation can take over: information acquisition, information analysis, decision and action selection, and action implementation. A copilot automates the first two and hands the last two back to a person.
That is why copilot readiness is unlike ERP readiness. The system is not doing the work; it is producing raw material for a judgement that a human still has to make, often quickly, and usually without any indication of how confident the system was. The competence being asked for is evaluative, and nobody was trained for it.
What “safe to use” actually means
Users repeatedly ask a version of the same question: when can I rely on this? The honest answer is that it depends on the task, and there is good evidence for how sharply it depends.
In a preregistered randomised experiment with 758 management consultants at Boston Consulting Group, Fabrizio Dell’Acqua and colleagues found that on eighteen tasks inside the model’s capability frontier, AI users completed 12.2% more tasks, 25.1% faster, at higher quality. On a complex managerial task chosen to sit outside that frontier, AI users were 19% less likely to reach a correct solution than colleagues working without the tool.
The frontier is real, it is uneven, and it is invisible from the interface. This is the single most important thing to communicate to copilot users, and almost no deployment communicates it. Telling people “AI can make mistakes” is not the same as telling them which of their tasks it is reliably good at and which it quietly is not.
Two failure populations, not one
Most organisations have two distinct copilot problems at once and treat them as a single adoption number.
Human factors research has named both. In their 1997 Human Factors paper Humans and Automation: Use, Misuse, Disuse, Abuse, Parasuraman and Riley describe misuse as over-reliance producing failures of monitoring and decision bias — and note that monitoring degrades exactly when the system is usually right and workload is high, which is the standard copilot condition. They describe disuse as neglect or underuse, classically triggered by an early false alarm: the person who caught it inventing a reference once and has not opened it since.
These look like opposite problems and are the same missing competency. Neither group can judge this output on this task; both have substituted a fixed global attitude for a per-task judgement. And disuse is invisible in adoption dashboards, which count active users rather than the people who actively stopped.
How to measure AI copilot adoption differently
Measuring AI adoption requires looking beyond login counts and feature usage. The better questions are: Are people using AI inside the work that matters, or only for peripheral tasks? Are outputs being reviewed before they enter business processes? Are review standards clear and applied consistently? Are managers encouraging responsible experimentation? Are employees confident enough to use the tool but sceptical enough to verify?
There is also a measurement trap worth knowing about. Microsoft and LinkedIn’s 2024 Work Trend Index, surveying 31,000 knowledge workers across 31 countries, found that 52% of people who use AI at work are reluctant to admit using it for their most important tasks, and 53% worry that doing so makes them look replaceable. Self-reported usage is therefore understated, and understated most severely for high-value work — which is the work you most need to understand. Usage data flatters, and it conceals the two findings that matter.
Workflow integration→
Output reviewed→
Trust calibrated→
Responsible adoption
Example: AI copilot adoption succeeds when trust is calibrated, outputs are reviewed, and tools are integrated into work that matters.
How to build AI readiness before deployment
AI readiness requires clarity on several fronts: use cases (what is the tool for and not for), review standards (who checks outputs and how), manager expectations (are teams encouraged, required, or free to experiment), data governance (what can and cannot be shared), error handling (what happens when an output is wrong), and capability development (do people know how to prompt effectively and critically evaluate responses). Without clarity on these dimensions, AI adoption will be uneven, risky, and difficult to govern.
The review standard is the one most often left vague, and “verify the output” is not actionable. A workable standard is tiered by stakes rather than by diligence:
- Internal drafts — read once for sense.
- Anything containing a number — check every number against source. Models are confident about arithmetic they have not performed.
- Anything leaving the organisation — a named second reader.
Stating it as a property of the task removes the implication that careful people check and careless people don’t, which is what makes checking standards socially survivable.
Common mistakes in AI copilot adoption
The most common mistake is treating AI like any other software deployment. AI requires a fundamentally different relationship between user, tool, and output. A second mistake is measuring adoption by access or login rates—an AI tool can be widely accessed and still not be adopted effectively. A third mistake is allowing ungoverned experimentation without clear standards for what success looks like. A fourth mistake is ignoring the trust dimension: employees who do not trust the tool, the organisation’s intent, or their own ability to judge outputs will not adopt, regardless of training.
A fifth, less obvious mistake is treating capability as a prompting problem. Prompt technique makes people faster at getting output; it does nothing for the judgement that decides whether the output is usable. The two are different curricula, and only one of them survives the next model release.
The demand changes again when the system stops suggesting and starts acting. Once a tool can complete a task rather than draft one, the human review step that currently absorbs most of the risk disappears — which raises a distinct set of readiness questions about authorisation, reversibility and oversight.
For related material on preparing people for AI-assisted work, explore the AI adoption readiness resources, or use the AI Adoption Readiness Assessment to establish where your organisation actually stands.
