Pretrained LLMs are a "cortex" with no "hippocampus," and I think that is why they fail on real company work.

Here's an argument I've been chewing on: the reason pretrained LLMs fail on real company work is structural, and it maps cleanly onto how human memory is organized. Treat the mapping as an analogy, not a literal claim.

Your brain runs two memory systems (Complementary Learning Systems theory, McClelland et al. 1995). The neocortex learns slowly and holds general, world knowledge. The hippocampus learns fast: it captures specific episodes as they happen, then consolidates the ones that recur into durable, reusable procedure.

A pretrained LLM basically is the neocortex. It read the internet and holds the world's general knowledge. To a first approximation that problem is solved. What it does not have is a hippocampus: the fast, company-specific memory that watched how your team actually handled a refund last spring and turned that into a repeatable procedure. So you drop this brilliant cortex into a company and it improvises, and improvised automation fails in production.

The real procedure was never in the help doc anyway. It lives in the team's conversations, a couple of people's heads, and one exception everyone now quietly copies.

This also explains why the usual tools don't fix it. Retrieval and search are only half a hippocampus: they recall a document but don't consolidate scattered episodes into the real procedure, and the document is often confidently wrong. Agent platforms make you run their agent on their stack.

If the diagnosis is right, a fix would need to consolidate scattered work episodes (including the exceptions nobody wrote down) into cited, human-approved, versioned procedures that existing agents could run, with a human sign-off on anything sensitive. Governance (citations, approvals, an audit trail) would have to be central, because "your AI issued a refund, under whose authority?" is the question that stops people cold.

What I actually want to test:

1. Is "the model doesn't know an organization's actual procedures" the real blocker, or is the bottleneck something else (trust, security, work that just isn't repetitive)?
2. Is the cortex/hippocampus split a useful frame here, or does it break down under scrutiny?
3. For anyone who has run agents on real workflows: what actually made them trustworthy enough to rely on?

Genuinely interested in where this argument falls apart.