You’ve given your AI agent thousands of examples. Historical records, past decisions, expert-authored reports. The data is comprehensive. So why is the agent still getting it wrong?
The answer lies in what the data doesn’t contain. When an AI agent trains on an expert’s emails or historical logs, it learns the outputs of decisions, not the judgement, pattern recognition, or edge-case handling that produced them. The expert who wrote those records was drawing on years of accumulated intuition, scanning for cues that never made it into the document, and applying mental models that existed only in their head.
To capture that invisible expertise, a growing number of AI development teams are turning to Cognitive Task Analysis (CTA) – a structured methodology for eliciting tacit knowledge from domain experts. By systematically mapping how experts perceive cues, weigh options, and navigate ambiguity, CTA translates human intuition into concrete engineering specifications.
Why Historical Data Is Not Enough
Large Language Models operate on statistical probabilities, predicting the next most likely token based on vast datasets. This is highly effective for language generation. It becomes unreliable when applied to complex, high-stakes decision-making.
Two limitations become apparent quickly.
The first is reasoning. LLMs do not possess an inherent understanding of physical-world constraints or domain-specific logic. When they encounter novel situations, such as edge cases not well-represented in training data, they tend to produce confident-sounding responses that are fundamentally wrong. This “hallucination” problem is particularly dangerous in expert domains, where a plausible-sounding error can be indistinguishable from the correct answer.
The second is situational awareness. A human expert doesn’t passively receive information; they actively scan their environment for subtle cues, filtering out noise to focus on what matters. An LLM treats all information in its context window with roughly equal weight unless explicitly instructed otherwise. Without the ability to distinguish critical signals from irrelevant data, an AI agent can make decisions that appear logical on the surface but fail in practice.
The solution isn’t more data. It’s a more rigorous approach to capturing what the expert actually does and the reasons why.
Eliciting the Knowledge That Experts Can’t Easily Articulate
Cognitive Task Analysis encompasses a range of techniques designed to surface the cognitive work that experts perform without consciously thinking about it. This is not a single interview. It is a structured investigation into how an expert perceives situations, what draws their attention, and how they make decisions when the stakes are high and the information is incomplete.
The process falls roughly into five stages:
- Preparation: Understand the problem domain, the nature of the tasks being performed, and which analytical methods are best suited to uncovering the relevant expertise.
- Knowledge Elicitation: Apply specific methods to capture the key decisions and cognitively demanding tasks that define expert performance.
- Analysis and Representation: Decompose the elicited data and restructure it into a form that can be translated into system design.
- Implementation: Iteratively apply the identified decisions and strategies to the AI system being built.
- Evaluation: Establish clear performance measures, evaluate the results, and improve based on evidence.
Applied Cognitive Task Analysis (ACTA)
The most practical framework for AI development teams is Applied Cognitive Task Analysis. ACTA streamlines the knowledge elicitation process through three primary methods:
- Task Diagram: The analyst works with the expert to produce a high-level map of the task, specifically identifying which subtasks require the most cognitive effort or judgement.
- Knowledge Audit: Probes how the expert diagnoses problems, anticipates future states, and recognises anomalies. The focus is on the specific cues the expert relies on and the strategies they employ.
- Simulation Interview: The expert is presented with a challenging, realistic scenario and asked to walk through their decision-making process step by step. This reveals how they handle pressure, ambiguity, and shifting priorities in conditions that mirror real work.
Translating Expert Judgement into Agent Architecture
The practical value of CTA lies in what you do with the findings. The outputs of analysis map directly onto the components of modern AI agent architectures.
| CTA Finding | AI Agent Component | Implementation Strategy |
|---|---|---|
| Critical Cues | Context Engineering / Memory | Ensure the agent’s system prompt or Retrieval-Augmented Generation pipeline explicitly surfaces these specific data points before a decision is made. |
| Expert Strategies | Prompt Engineering | Translate the expert’s mental model into Chain-of-Thought instructions, directing the LLM to replicate the expert’s step-by-step reasoning process. |
| Common Errors | Guardrails / Constraints | Use identified pitfalls to write explicit negative constraints in the system prompt (e.g., “Never approve a claim if X is missing”). |
| Decision Points | Agentic Workflows / Human-in-the-loop | Design the agent’s workflow to pause at high-stakes decision points, either triggering a specific sub-agent for deeper analysis or requesting Human-in-the-Loop validation. |
This mapping also creates an evaluation framework. When an AI or RAG pipeline isn’t performing as expected, the CTA findings provide a structured lens for identifying precisely where the reasoning breaks down and what needs to change.
Conclusion
Giving an AI agent a large dataset of historical decisions is a necessary first step. It is not sufficient for building a system you can trust with consequential decisions.
To move beyond brittle automation, you need to look beyond the data and examine how the expert actually thinks. Cognitive Task Analysis provides the methodology to extract that tacit knowledge; systematically mapping cues, strategies, and decision points so that your AI agent doesn’t merely mimic expert language, but genuinely replicates expert reasoning.
The problem you’re trying to solve existed long before you noticed it. The expertise you need to encode has been sitting in people’s heads all along.
Contact Galdren to explore how Cognitive Task Analysis can be applied to your AI development process.