Scott Wueschinski
← All articles

Insight

The Substrate Is the Strategy: Why Retail's AI Bets Keep Dying at the Foundation

Retail keeps funding the layer that demos well and starving the substrate underneath it. The fix is a data foundation argued in the language of downside, not upside.

· 10 min read

Three separate conversations have been landing on my desk from the forward-deployed seat inside enterprise retail, and they all turn out to be the same conversation wearing different clothes. A personalization vendor that went dark in 2023 is back with the word “agentic” stapled to the front of the pitch. A CFO is asking a CDO a question the CDO cannot answer in board language. A $40M data lake that got a standing ovation three years ago now sits quiet while the whole organization argues about which LLM to license. On the surface these are three different problems belonging to three different budgets. Underneath, they are one problem, and it is the most expensive problem in retail right now because almost nobody is naming it.

The problem is this: the enterprise keeps funding the layer that shows well in a demo and starving the substrate that determines whether the layer works at all. The model, the copilot, the agent, the conversational interface, the vendor logo on the slide. That is where the money goes because that is where the attention goes. The data foundation underneath it, the identity resolution, the semantic definitions, the freshness and lineage of every field an autonomous system will act on, is where the outcome is actually decided, and it is the part of the stack that never gets a slide of its own.

The pattern: buying the costume, skipping the fix

Start with what the market is actually selling. The personalization vendors that quietly died in 2023 have returned to the exact same buyers, same logo, new deck, one new word in front. Sinequa put numbers on the rot in a report worth reading: 84 percent of enterprise leaders say they encounter rebranded products marketed as agents during evaluation, and 87.5 percent say that experience has damaged their trust in AI broadly. Even more telling, 51.3 percent claim agents are in production today, while only 10 percent have actually deployed a true multi-agent system. That leaves 70.7 percent running a sophisticated chatbot and calling it autonomy. I walked through what that recycled wave looks like up close in Personalization is back, and worse than before, and the operator-grade tell is simple. Real agency means a system independently decides how to pursue a goal, selects its own tools, and adapts to the result. A rules engine waits for a merchandiser to author the segment, write the condition, and define the next-best-action. Wrap that switchboard in a conversational interface and you change what it looks like in the room. You have not changed what it is.

The same pattern runs through the data lake. Every Tier 1 retailer put a line item of twenty to fifty million dollars into a lake three years ago, hit the milestones, declared the project done, and then never built the connective tissue from lake to decision to action. The lake became a passive repository that powers Monday-morning reports. When the AI conversation arrived, most CDOs went straight to model selection and their single largest investment of the last cycle never came up. I laid out the retrofit that the winning retailers are quietly running in The $40M data lake nobody asks about anymore, and the mechanism there is identical to the personalization one. The shiny thing on top is not the bottleneck. The readiness of the substrate for agent consumption is.

So the pattern has a shape. In both cases the organization pays for the visible artifact, treats the foundation as finished or irrelevant, and then wonders why the outcome underperforms the demo. The buyer is the same buyer. The substrate problem is the same substrate problem. And the vendor is betting you forgot.

Why it happens: the wrapper sells better than the fix

This is a story about incentives that make the wrong choice feel like the rational one. Three forces push every buying decision toward the costume and away from the substrate.

The first is legibility. A conversational agent that returns a fluent answer is legible to a boardroom in ninety seconds. A semantic abstraction layer built on dbt, latency tiering that isolates the five to ten percent of data that genuinely needs to be fast, and lineage exposed as a first-class artifact with freshness tags and confidence bands, none of that demos. It gets no vendor logo on the slide. The work that makes every downstream AI dollar worth ten times what it would otherwise be worth is precisely the work that photographs worst.

The second force is the sunk-cost narrative around the lake. Once a CDO has hit the milestones and declared victory, revisiting the foundation reads internally as admitting the first project was incomplete. So the organization moves on to the next glamorous thing rather than doing the unglamorous retrofit, and the asset goes underutilized while the budget chases foundation models.

The third force, and the most damaging, is that the failure is delayed and diffuse. A dashboard is forgiving. It surfaces a number and a human applies judgment; if the underlying data is messy, the human notices and reaches for context. An agent ingests, ranks, decides, and acts, often in a closed loop, often with no human in the path. Feed it fragmented identity and stale inventory and it will personalize at machine speed, confidently wrong thousands of times before anyone notices the conversion dip. The mess compounds silently, which means the moment of buying the costume feels safe and the consequence arrives a quarter or two later, disconnected from the decision that caused it.

Put those three together and you get a market that rewards the wrapper and punishes the fix, right up until the fix becomes the only thing that matters.

What it costs: the compounding you cannot buy back

Here is where retail leaders need to change the math they carry into the room. The cost of skipping the foundation is not a flat penalty you absorb once. It compounds, and it compounds faster the more AI you deploy on top of it.

Trace it quarter by quarter. In quarter one you buy the agentic-labeled rules engine, skip the identity-resolution work, and everything looks fine. In quarter two a competitor who fixed the substrate first now has a system that genuinely acts: it reconciles a customer across channels, reads live inventory, and reroutes the experience without a human writing a rule. By quarter three that is no longer a feature gap, it is a learning gap, because their system is improving on real signal while yours replays a frozen decision tree. By quarter four the distance between an engine that adapts and one that pretends to is structural, and you cannot buy it back at the speed they earned it.

The same multiplier lives inside the lake. A retailer with an unretrofitted lake spending $5M on agentic deployments in 2026 will get roughly half the value a peer with a retrofitted lake gets for the same spend. The agents are identical. The substrate is different. That is the whole story. Every new AI initiative launched on top of a broken foundation inherits the same discount, so the gap widens with every dollar of downstream investment, and by the time it shows up in margin or share it is already two cycles too late to close cheaply.

This is the argument retail CFOs have started forcing into the open, and most CDOs are not ready for it. The question is no longer “what is the ROI” or “what is the payback period.” CFOs have had those answers for three cycles. The question is “what does it cost us to not do this,” and it is exposing the gap between CDOs who have a transformation thesis and CDOs who have a vendor schedule. I broke down why that question is landing now in The CFO’s AI question every CDO is failing. Through 2024 and most of 2025, competitive parity was a defensible posture. Move when the leaders move, fast-follow on personalization, do not buy the first wave at peak prices. That posture broke in 2026, because margin gaps between AI-native and AI-curious operators became measurable inside a single fiscal year, senior data and ML leaders who left in 2024 never came back, and PE and activist scrutiny stopped treating inaction as conservative and started treating it as a governance failure.

The operating model: fund the foundation, argue in downside, then let it act

If the disease is one disease, the cure is one cure, and it has three moves that run in order.

Move one: put a bounded number on the downside and lead with it. Retail CDOs walk into board cycles armed with a vendor TCO, a capability map, and an opportunity-sizing model from one of the big three firms. What they lack is a bounded number for margin erosion under status quo, a defensible cost of execution lag, a talent flight risk model, and a quantified loss of optionality. That four-component frame is the Cost of Doing Nothing, and it changes the conversation. Consider the specialty retailer evaluating an $8M agentic pricing intelligence build. On ROI alone it showed $19M of three-year value and a 2.4x payback, a project that gets approved most years. In 2026 it got killed, because the CFO held it next to a bigger ask. Rebuilt as a CODN case it carried $26M of three-year cost of inaction: $11M of margin erosion as a peer’s AI-native pricing widened the gap, $6M of execution lag as the data foundation aged, $4M of talent flight as the pricing analytics lead exited for a competitor, and $5M of optionality decay as a future retail media partnership became dependent on pricing infrastructure not yet in place. The board approved within one cycle. The number that moved them was $26M of unmanaged downside. ROI justifies projects. CODN justifies programs, and programs are what AI-native retail actually requires.

Move two: spend the money on the substrate, and spend it on the unglamorous parts. The retrofit that separates the compounding winners from the rest is a semantic abstraction layer that gives every important entity and field a stable, agent-readable identity, so a system can reason about whether a SKU is promoted, returnable, age-restricted, or seasonally indexed. It is latency tiering rather than blanket latency optimization: isolate the five to ten percent of data that genuinely needs to react inside the conversion window and leave the other ninety percent on its existing batch cadence. And it is lineage as a first-class artifact, every agent-exposed field carrying a freshness tag, a derivation history, and a confidence band, so a system knows which data is canonical and recovers gracefully when something goes stale. This is the retrofit nobody publishes about because it never earns a logo on the slide, and it is the single highest-leverage spend in the stack.

Move three: only after the foundation holds, hand it to something that can actually act, and prove the act. The diligence question that filters the field fast is one sentence: show me a decision the system made that no human pre-authorized, and show me the moment it changed its mind. Run that against a vendor’s demo on your own data. If they cannot produce it, you are looking at the costume, and no amount of foundation work will make a costume autonomous. The sequence matters. Governance, knowledge readiness, and operational trust are the real barriers, and the retailers producing results are moving carefully, mapping where the system breaks before they let it act. The ones buying the costume are moving fast toward a faster failure.

What the case studies will say in 2027

The retailers whose names land on the case studies next year will be the ones running the few that are real, on a substrate they retrofitted while everyone else was arguing about which foundation model to license. That is the only number that will matter, and it will have been decided by choices made in 2026, in board rooms where a CDO either walked in with a bounded downside number and a foundation-first sequence or walked in with a vendor schedule and hope.

The forward move for any retail or CPG leader reading this is not complicated to state, even though it is unglamorous to execute. Before your next board cycle, put the Cost of Doing Nothing on the ledger next to every AI ask, fund the semantic layer and the latency tiering and the lineage before you fund a single autonomous deployment on top of them, and refuse to buy anything that cannot show you a decision it made and reversed on its own. Do that and every AI dollar that follows compounds in your favor. Skip it and you will personalize the wrong thing at machine speed, pay the full price of a foundation you never built, and discover a quarter too late that the competitor who did the quiet work already earned a lead you cannot purchase back.

The substrate was always the strategy. The organizations that internalize that in 2026 will spend the back half of the decade compounding. The rest will spend it explaining to a board why the demo worked and the deployment did not.