All posts
Amay Aggarwal
Amay Aggarwal
Co-founder, Anglera

The AI search glossary for B2B catalogs, in ten layers

Ninety-odd terms from the AI search vocabulary, organized by where they bite in a real catalog — crawler access, rendering, retrieval mechanics, surfaces, the product record, feeds and protocols, entity trust, and measurement. Each term links to a full definition.

The AI search glossary for B2B catalogs, in ten layers

Most AI search glossaries are alphabetical, which is the least useful possible order. Alphabetical puts llms.txt next to long-tail SKU and leaves you no idea that one of them will change your revenue and the other almost certainly will not.

So this one is organized by where a term bites. Ten layers, roughly in the order a buyer's question travels through your catalog: can a crawler get in, does it receive anything, how does retrieval work on what it got, which surface is the buyer using, is the record good enough to survive the question, how does an agent transact, can anyone tell who you are, and finally, how would you know any of this is working.

Every term links to a full definition. If you only read one section, make it the second and third — access and rendering are where most catalogs are quietly losing, and both are diagnosable in an afternoon.

For the underlying argument about how a B2B product record should be built in the first place, start with how to structure product data for AI agents.

1. The names for the work

Four acronyms, one discipline, and a great deal of confusion sold at a premium. Knowing which term has a real origin and which is a coinage tells you how much weight to put on anyone using it.

The honest summary: if a vendor's methodology differs from another's, it will show up in what they actually do to your data, not in which four letters they put on the deck.

2. Who gets in

This is the layer with the highest ratio of consequence to effort, and the one most often configured by inheriting somebody's robots.txt from 2024. Training crawlers, retrieval crawlers and user-triggered fetchers are three different things with three different tokens, and the vendor names look deceptively similar.

  • AI crawler — the umbrella entry, with a reference table of every major agent
  • GPTBot — OpenAI's training crawler
  • OAI-SearchBot — OpenAI's retrieval crawler, the one that decides ChatGPT citations
  • ClaudeBot — Anthropic's training crawler, alongside Claude-SearchBot and Claude-User
  • PerplexityBot — retrieval, honours robots.txt; Perplexity-User is user-initiated and documented as generally ignoring it
  • Google-Extended — not a crawler at all, and does not opt you out of AI Overviews
  • llms.txt and llms-full.txt — cheap, harmless, and not the reason you are not being cited

Blocking GPTBot while leaving OAI-SearchBot open is a coherent position. Blocking both by accident, then commissioning an AI visibility audit, is a more common one.

3. What actually gets read

The second diagnosable-in-an-afternoon layer, and the one that catches teams by surprise because Google has been covering for them. Google executes JavaScript before indexing. AI crawlers, on the available evidence, do not.

A storefront that injects its spec table and JSON-LD client-side is serving an app shell to every agent in section 2. The markup validates perfectly in a tool that runs JavaScript. It is absent from what a crawler receives.

4. How retrieval works

You cannot control any of this machinery, which is exactly why it is worth understanding: it explains why a thin record loses, in mechanical terms rather than as an article of faith.

The through-line: retrieval extracts passages and compares vectors. A specification that exists only in a PDF is not a weak signal, it is not a signal. And a passage that names a value without naming the product cannot be attributed back to your SKU no matter how accurate it is.

5. The surfaces

Where the buyer actually is. Each behaves differently, and the differences matter more for a distributor than for a DTC brand, because most of these were designed around consumer retail assumptions that industrial catalogs violate.

AI Mode is the one to think hardest about. In a conversation, each additional constraint is a filter applied to what the system knows about you, and a null field is elimination rather than a lower rank. Categories where your fill rate is thin are categories where you drop out on turn three and never find out.

6. The record: identity and classification

Now we are inside your own data, and the layer everything else depends on. An agent resolves identity first and narrows by class second. A product it cannot identify never gets its specs compared.

The B2B-specific point: consistency beats coverage. An MPN formatted identically in the ERP, the PIM and the web catalog is worth more than a GTIN you sourced from three places and cannot reconcile.

7. Completeness: surviving the constraint

The layer where most enrichment budget should go and where the least of it usually does. Every constraint in a buyer's question is a field you either have or do not.

One note on semantic completeness, because it is circulating with a correlation coefficient attached to it. The underlying writing principle is sound. The number is not traceable to any published study, and fill rate against a defined per-category attribute set is the measurable version of the same idea.

8. Feeds, protocols, and transacting

The layer that gets the most conference attention and warrants the least urgency for most distributors. It is worth tracking. It is rarely worth being early on.

Governance is worth reading carefully here, because it gets reported sloppily. MCP was donated to the Agentic AI Foundation, a Linux Foundation directed fund, in December 2025. ACP has not been donated to anything; its repository describes foundation stewardship as a future path. Those are different levels of commitment and they should inform different integration decisions.

The part of this section that actually matters to a distributor is not checkout. It is that UCP names catalog search and lookup as a specified capability, which makes the quality of your product record directly queryable and directly comparable against a competitor's, inside a single agent turn.

9. Entity trust

Smaller layer, frequently oversold, occasionally decisive. The question it answers is whether a machine can tell who you are and whether your claims are checkable.

  • E-E-A-T — a rater framework, explicitly not a ranking factor, with trust as the load-bearing letter
  • sameAs — disambiguation, not endorsement
  • Wikidata — useful for the manufacturers you carry, largely unavailable for your own company
  • Data governance — the unglamorous prerequisite

The distributor version of E-E-A-T is not author bios. It is naming the standard number and issuing body on a certification instead of writing "UL listed," linking the manufacturer's spec sheet to the SKU so a claim can be checked, and leaving a field blank rather than guessing at it. First-hand application knowledge — what actually fails in coastal installations, which published supersession does not work in practice — is the content a competitor cannot copy and a model cannot synthesize from anywhere else.

10. Measurement

Last, deliberately. Every instrument here is a proxy, all of them are noisy, and the vocabulary exists partly so vendors can put a number on something no provider reports.

Three instruments, three blind spots. Analytics sees clicks and misses every answer that resolved without one. Prompt panels see answers and sample a non-deterministic system. Server logs see retrieval and tell you nothing about what was said. Run all three, report trends across a quarter, and treat single-week movement as noise, because that is what it is.

The short version

If you read the whole list and want one sequence: check what your product pages return without JavaScript, check which crawlers you are actually allowing, then measure attribute fill rate on the ten to fifteen specs buyers filter on in your top categories. Everything in sections 4 through 10 is downstream of those three answers.

The vocabulary is genuinely useful for reading vendor claims critically, which is most of what it will be used for this year. The work underneath it has not changed much: the facts have to exist, in fields, in HTML, tied to a part number that means the same thing in every system you run.

Anglera does that middle part. Your PIM stores the record; we fill the missing attributes at catalog scale from supplier spec sheets and manufacturer sources, normalized against your schema and written back into the system you already run. The crawler configuration and the rendering stay with your team.

Frequently asked questions

What is the difference between AEO, GEO, LLMO and AISO?

Mostly branding. GEO comes from a 2024 KDD paper that framed content visibility in generative engines as a black-box optimization problem. AEO predates large language models and grew out of featured-snippet work. LLMO and AISO are vendor coinages with no canonical definition. All four describe the same job: making content retrievable, factually complete, and self-contained enough to quote. Evaluate the methodology, not the acronym.

Which AI crawlers should a distributor allow?

At minimum the retrieval crawlers, since they decide whether you can be cited: OAI-SearchBot for ChatGPT search, PerplexityBot, and Claude-SearchBot. Allow the user-triggered agents too, ChatGPT-User, Perplexity-User and Claude-User, since those fire when a real buyer asks about a page. Training crawlers such as GPTBot and ClaudeBot are a separate decision about whether you want your content in model training data.

Does blocking GPTBot remove my products from ChatGPT?

No, and this is the most common configuration mistake in the category. GPTBot is OpenAI's training crawler. ChatGPT's search features are served by OAI-SearchBot, a completely separate agent with its own robots.txt token. Blocking GPTBot leaves ChatGPT search access untouched. Blocking OAI-SearchBot is what removes you from those answers, and plenty of sites have done it by accident.

Does Google-Extended opt me out of AI Overviews?

It does not. Google-Extended controls whether crawled content can be used for training and grounding in Gemini Apps and the Vertex AI API for Gemini. AI Overviews and AI Mode are features inside Google Search, and Google states that Google-Extended does not affect inclusion in Search. The controls that apply to AI features are nosnippet, data-nosnippet, max-snippet and noindex, all of which affect ordinary results too.

What is the difference between a feed, schema markup, and MCP?

Three delivery mechanisms with different freshness and reach. Schema markup is structured data embedded in a page a crawler already fetches, so it is broad but only as current as the crawl. A feed is a file or API you push, richer and refreshed on your schedule. MCP is a live query interface, so an agent gets current branch stock or contract pricing at the moment it asks. Most catalogs need the first two before the third is worth building.

What does share of model actually measure?

The percentage of AI answers across a chosen prompt set that mention or cite your brand or products. It is estimated by re-running a fixed set of prompts on a schedule and counting appearances, because no assistant publishes visibility data. That makes it sampling, not reporting. Two vendors will report different numbers for the same brand because their prompt sets and counting rules differ. Always state the method beside the number.

Is FAQPage schema still worth adding after Google removed FAQ rich results?

Yes, but for a different reason than most guidance gives. Google stopped showing FAQ rich results in Search from 7 May 2026, so there is no longer a SERP appearance payoff. A self-contained question with a self-contained answer is still close to ideal retrieval material, because retrieval systems extract passages rather than pages. It is a citation play now, not a rich-results play.

Do AI crawlers run JavaScript?

Generally not. Analysis of large-scale crawl logs found no evidence that OpenAI's GPTBot executes JavaScript, and the safe assumption is that other AI crawlers behave the same way. Google is the exception, since it runs a separate rendering phase before indexing. That gap is why a catalog can rank acceptably in Google for years while being effectively blank to every AI crawler.

What is the single highest-leverage thing to fix first?

Check what your product pages actually return without JavaScript. Fetch a PDP with curl and look for your JSON-LD block and a few specification values in the raw response. If they are not there, that is what every AI crawler receives, and no amount of content work downstream will help. After that, attribute fill rate on the specs buyers filter on.

How many of these terms does a catalog team actually need?

Fewer than the list suggests. The layers that decide outcomes for most distributors are crawler access, rendering, and attribute completeness. Retrieval mechanics are worth understanding so you can reason about why something failed, and the protocol layer is worth tracking rather than integrating. Measurement vocabulary is mostly useful for reading vendor claims critically.

Amay Aggarwal

About the author

Amay AggarwalCo-founder, Anglera

Amay is a co-founder of Anglera, where he's building the AI pipeline that turns messy supplier catalogs into structured, AI-readable product data for distributors and answer engines. He built the catalog AI systems at Uber Eats on top of research from Stanford's AI lab.

See it on your own SKUs.

A 30-minute walkthrough on your categories and your supplier data.

Book a demo