The AI Integration Test
Figure 1 separates technical implementation from organisational integration. Figure 2 gives seven questions for a bounded rollout decision. Both are editorial decision aids, not validated maturity scores.
Illustrative vignette: The opening shop-floor scenario is constructed to show the distinction, not a reported case.
The production plan looked excellent at 8.15 on Monday morning.
A twenty-four-year-old analyst had built it with one of the company's most capable models. The system had read the order book, machine run rates, staffing rota and transport windows. It produced a clean sequence, identified a likely bottleneck and proposed a schedule that appeared to recover several lost hours.
By 10.30, the plant supervisor had bypassed it.
One line had lost time after a wash-down. Maintenance had borrowed two fitters. The ERP system showed a batch as available, but an experienced operator knew it was under informal quarantine. A strategic customer would accept a late delivery, but only if the account manager called before 11.00. None of these conditions was hidden from the people doing the work. They were hidden from the model.
The prompt had not been obviously poor. The system had solved the documented factory. The supervisor was operating the real one.
That is the integration problem. Advanced prompting can produce a better answer to an incomplete description of reality.
This is not an argument for seniority. The veteran alone may preserve an inefficient process, distrust useful evidence or miss a genuinely new capability. The analyst alone may optimise a fiction. The management task is to combine what each knows, decide what should change and create a work system that can absorb the technology without losing the context that makes the work succeed.
Prompting is no longer the whole problem
Kunwar Apoorva Singh's book "AI Manager: Stop Prompting. Start Leading", argues that organisations should move from prompting to managing, and describes the emerging AI manager as a systems integrator. The book's initiating contrast between digitally fluent juniors and operationally experienced veterans is useful because it identifies a real organisational fracture.1
A related Harvard Business Review article by Amanda Pratt and Melissa Valentine makes a similar move. Prompt and context engineering are only part of adoption. Employees also need to identify valuable workflow problems, evaluate possible solutions, experiment and integrate new practices sustainably into day-to-day work.2
Both arguments point in the right direction. But integration begins where the prompt ends.
An AI answer can be accurate in isolation and still be unusable. It may arrive too late in the process. It may rely on information that is not maintained. It may remove a judgement that no one authorised the system to make. It may shift ten minutes of production work into forty minutes of checking. It may violate a customer relationship that the formal rule never recorded. It may have no safe fallback when the exceptional case arrives.
The hidden failure is not necessarily model quality. It is a mismatch between the output and the system expected to receive it.
That is why buying a stronger model, improving the prompt or increasing the IT budget can leave the real constraint untouched. The problem has moved from generating a plausible answer to making that answer safe, useful and repeatable inside an organisation.
The organisation has an undocumented operating system
The formal organisation is visible. It is represented in process maps, standard operating procedures, job descriptions, software fields, policy documents and reporting lines.
The working organisation is larger. It includes negotiated exceptions, unofficial sequences, trusted relationships, early warning signs, local definitions of quality and the practical judgements people use when the rulebook stops being sufficient.
Michael Polanyi's work on tacit knowledge is helpful here. Some knowledge is carried in practice, experience and inherited ways of doing things rather than fully expressed as rules.6 On a shop floor, in a hospital, inside a sales team or across a professional-services workflow, experienced people often notice patterns they would struggle to translate into a neat field in a database.
Tacit knowledge is not automatically correct. It can contain habit, prejudice, obsolete workarounds and local power. Integration should not romanticise it. It should surface it, test it and decide what deserves to be preserved, made explicit, redesigned or removed.
This matters because many AI projects begin with the information that is easiest to collect rather than the information that actually governs the outcome. The model sees the recorded process. The operator sees the conditions under which that process ceases to be reliable.
The veteran therefore holds part of the organisation's undocumented operating system. Treating that person as a late-stage reviewer wastes the knowledge the project most needs.
Implementation and integration use different units of analysis
Implementation is essential. The system must connect, run, meet security requirements and perform its bounded task. But implementation can be technically complete while integration has barely begun.
On a narrow screen, each row is shown as a separate card.
| IMPLEMENTATION CHECK | INTEGRATION CHECK |
|---|---|
| Can the model complete the task? | Does completing the task improve the real organisational outcome? |
| Does the output meet a benchmark? | Can users recognise when it should be trusted, challenged or ignored? |
| Can the system connect to the software? | Does information reach the right people at the right moment in the actual workflow? |
| Has a user been trained? | Do roles, workload, incentives and authority support the new way of working? |
| Is a human in the loop? | Is human decision authority explicit, competent and accountable? |
| Can the pilot run? | Can the organisation learn from exceptions, monitor effects and disengage safely? |
NIST's voluntary AI Risk Management Framework makes the same systems point from a risk perspective. It calls for clear roles and communication, diverse disciplines and experience, feedback from people outside the development team, consultation with domain experts and continued monitoring in the deployment context. It also warns that decisions and conditions later in the AI lifecycle can undermine good intentions established earlier.4
That is not a compliance recipe for every AI project. It is a useful reminder that the model is one component inside an interdependent human and organisational system.
Why domain experts cannot be a sign-off stage
Many organisations involve experienced staff too late. A vendor has been selected, a pilot designed and a workflow demonstrated. The domain expert is then invited to validate the result.
That is not integration. It is a request for retrospective blessing.
A recent Harvard Business Review article argues that organisational AI experiments require domain experts to commit time and energy to working out how the technology should be used.3 The practical implication is easy to underestimate. Domain expertise is not a free comment supplied around someone's normal workload. It is a project resource.
If the strongest operators are not given time, status and a genuine design role, the AI team learns from available data and occasional meetings. Experienced staff wait for the project to collide with conditions they already recognise. When it does, the organisation may conclude that the technology failed, when the more precise conclusion is that the work system was never fully represented.
The correct response is not a committee around every prompt. It is named integration ownership and early collaboration between the people who understand the capability, the work, the consequences and the authority structure.
The young analyst and the veteran hold different halves of the solution
The twenty-four-year-old is not a convenient villain. AI fluency is a real organisational asset. It can reveal capability that experienced managers do not yet know exists, build prototypes quickly, generate alternative scenarios and reduce the cost of testing an idea.
The veteran is not a ceremonial guardian of the old way. Operational wisdom can reveal the conditions under which an apparently rational solution fails: the exception that changes the decision, the customer promise that outranks the schedule, the quality cue that has never been digitised, the informal dependency that keeps work moving and the consequence that looks small in a dashboard but serious in practice.
Experience without AI fluency can defend yesterday's process. AI fluency without operational knowledge can automate a fiction.
Integration does not average the two. It gives each form of knowledge authority where it is strongest and forces disagreement to appear before deployment rather than after failure.
Leadership supplies the third component. Someone must define the organisational outcome, decide which judgement may be delegated, pay the cost of capturing context, resolve conflicts between speed and control, align incentives and own the result. The system integrator is therefore not simply the most technical person in the room. It is the person or team responsible for fitting capability to consequences.
Individual AI use is not organisational adoption
The gap is visible even where people already use generative AI enthusiastically. A CHI 2026 study based on 27 interviews with newsroom managers, editors and journalists in China found frequent individual use, but weak connection to shared team workflows. Structural barriers, informal practice and reluctance to share methods hindered collaborative integration.5
That is one qualitative study in one professional and national setting, not a universal measurement of adoption. Its value is the mechanism it exposes: individual productivity does not automatically become collective capability. The organisation must create shared routines, standards, feedback and coordination around the use.
The same point is echoed in recent HBR discussion of the hidden realities of AI adoption: redesigning work, building trust, developing talent and protecting human judgement matter as much as the technology itself.7
Seven gates stand between an AI output and organisational capability
Integration can be treated as seven connected management gates. They are not a once-only implementation sequence. A weak answer at any gate should send the work back to a bounded test.
The seven gates below are an Andrew's Intel editorial framework, not a validated maturity instrument.
- Outcome. What useful result must improve? A faster output is not enough if the downstream decision, service or customer outcome does not change.
- Real workflow. What actually happens now, including workarounds, handovers and unofficial sequences? The formal process map is evidence, not the whole truth.
- Context. Which data, relationships, tacit cues and local assumptions shape the judgement? Decide what can be made explicit and what must remain with an accountable person.
- Exceptions and fallback. Which rare or high-consequence cases break the normal pattern? Define escalation, override and a workable non-AI route before scale.
- Authority and accountability. Who may accept, reject or overrule the output? Who explains the decision and owns the consequence when the system is wrong?
- Roles, workload and incentives. Whose work becomes easier, harder, more visible or less valued? A workflow will be bypassed if the people carrying the checking burden are rewarded only for speed.
- Learning. How will field evidence, overrides, complaints and unexpected effects change the model, workflow or policy? Integration continues after launch.
The AI Integration Test
Before approving a broader rollout, take the proposed workflow through these seven questions. The test is decision support, not certification. Its purpose is to expose the work the model demonstration leaves out.
On a narrow screen, each row is shown as a separate card.
| GATE | TEST QUESTION | WHAT A GOOD ANSWER SHOULD EXPOSE |
|---|---|---|
| 1. Outcome | What useful result must improve, and what is the current baseline? | The organisational purpose, trade-offs and evidence of improvement before the technology is judged. |
| 2. Real workflow | What happens in practice from trigger to outcome, including informal handovers and workarounds? | The whole unit of work, not the isolated task selected for automation. |
| 3. Context | What do experienced people use to judge the situation that the system cannot currently see? | Tacit cues, relationship knowledge, data gaps and assumptions that must be encoded, retained or redesigned. |
| 4. Exceptions | Which cases cause the normal rule to fail, and what happens then? | Failure limits, escalation, human intervention, fallback and the cost of being wrong. |
| 5. Authority | Who can accept, challenge, override or stop the output, and who owns the decision? | Explicit decision rights and accountable human authority rather than nominal human presence. |
| 6. Roles | Whose workload, incentives, status, learning path or performance target changes? | The adoption conditions and hidden verification burden that determine whether the workflow will be used. |
| 7. Learning | How will field evidence change the system, process or decision rule after deployment? | Monitoring, feedback, exception logs, review cadence, improvement responsibility and a safe exit route. |
What leaders should do next
Start with one real workflow and one outcome that matters. Observe the work before redesigning it. Compare the formal process with what people actually do. Pair an AI-fluent builder with an experienced operator from the beginning, then give both permission to challenge the initial frame.
Ask the AI to model scenarios within explicit human constraints rather than produce one supposedly optimal answer. Test the happy path and the awkward cases. Measure the end-to-end result, including review time, coordination, exceptions and downstream effects. Record overrides and near misses as learning data, not as evidence that users are resistant.
Most importantly, name the integration owner. This person does not need to be the best prompter or the most senior operator. They need the authority to connect technical capability, operational reality, organisational incentives and accountable decisions.
A technically capable pilot without that ownership may still produce a brilliant demonstration. It will remain a demonstration.
The next AI skill is making the organisation work
By lunchtime, the production plan in the opening vignette had been abandoned. That does not mean AI had no useful role. Once the hidden constraints were surfaced, the system could still compare scenarios faster, identify trade-offs and help the team test a revised schedule.
But the value appeared only when the analyst and the operator stopped being treated as rival sources of authority. The analyst helped make operational knowledge explicit and testable. The veteran stopped being the last line of defence against an already finished design. Management decided which judgements remained human, who could override the system and how experience would return to the workflow.
The AI had not failed. Integration was unfinished.
The best prompt can produce an answer. Only integration can produce organisational capability.
Sources and evidence
Source links were rechecked 31 October 2026. The opening plant story is illustrative, not a reported case. The implementation/integration distinction, seven gates and AI Integration Test are Andrew's Intel editorial devices, not validated assessment instruments.
Source posture: The book listing is commercially interested and establishes the author's framing, not measured outcomes. The HBR sources support bounded public summaries and a roundtable framing. NIST is voluntary guidance, not a certification of this test. The CHI paper is a qualitative study of 27 newsroom professionals in China, not an adoption-prevalence estimate. The framework and recommendations are editorial synthesis built from these narrower signals.
- Kunwar Apoorva Singh, AI Manager: Stop Prompting. Start Leading. 2026, ISBN 9789358957037. The book and user-supplied excerpt were the initiating signal. The publisher/product page is commercially interested and is used for the author's stated framing, not as independent evidence of organisational outcomes. Read source.
- Amanda Pratt and Melissa Valentine, “To Drive AI Adoption, Build Your Team’s Product Management Skills”. Harvard Business Review, 3 February 2026. Used for the distinction between prompt/context engineering and the wider work of defining workflow problems, evaluating solutions, experimenting and sustaining new practice. Read source.
- Arvind Karunakaran, Katherine C. Kellogg and Batia Wiesenfeld, “AI Experiments Need Domain Experts. Here’s How to Support Them.” Harvard Business Review, 6 August 2026. Public summary used for the requirement that domain experts commit time and energy to organisational AI experiments. Read source.
- National Institute of Standards and Technology, Artificial Intelligence Risk Management Framework (AI RMF 1.0). NIST AI 100-1, January 2023. Voluntary cross-sector framework used for context, roles, domain expertise, feedback, human-AI configuration and post-deployment monitoring. It is not presented as legal advice or certification. Read source.
- Qing Xiao, Qing Hu, Jingjia Xiao, Hancheng Cao and Hong Shen, “Can GenAI Move from Individual Use to Collaborative Work? Experiences, Challenges, and Opportunities of Coordinating GenAI into Collaborative Newswork”. Proceedings of CHI 2026, DOI 10.1145/3772318.3790984. Qualitative study of 27 newsroom managers, editors and journalists in China; used as a bounded example of the gap between individual use and coordinated organisational workflow. Read source.
- Michael Polanyi, The Tacit Dimension. Originally published 1966; University of Chicago Press edition, 2009. Used for the concept that important knowledge may be carried in practice and experience rather than fully stated as formal rules. Read source.
- HBR Editors, “The Hidden Realities of AI Adoption”. Harvard Business Review, 30 July 2026. Roundtable summary used only for the broad organisational framing around work redesign, trust, talent and the quality of human judgement. Read source.
