Services consulting

AI search optimization: getting cited, not just ranked

Generative Engine Optimization is the practice of structuring content and authority so AI answer engines — Google AI Overviews, ChatGPT Search, Perplexity, Gemini — cite you inside the answer. This page explains what the evidence actually supports.

What is Generative Engine Optimization (GEO)?

Generative Engine Optimization is the practice of optimising content and brand presence so AI answer engines cite you inside the answer they generate. The term was introduced in a 2024 research paper by Aggarwal and colleagues at Princeton University and IIT Delhi, published at KDD 2024, which tested nine content modifications against generative visibility metrics.

It differs from SEO in the mechanism, not the fundamentals. SEO aims to rank a document; GEO aims to have a specific passage retrieved, synthesised and attributed. That makes the unit of optimization the passage rather than the page, and the unit of success the citation rather than the impression.

Google's own position is that optimising for generative AI search is still SEO and that the same fundamentals apply — its AI optimization guide explicitly states you do not need llms.txt files, special markup or content chunking. That is accurate. Google also states its generative features are grounded in the same core ranking and quality systems. The practical difference lies in other engines' retrieval behavior, and in the fact that a document read in full by a human may never be lifted at all.

How do AI answer engines choose sources?

AI answer engines use retrieval-augmented generation: they search an index for relevant passages, pass those to a language model, and have it synthesise an answer with citations. Four consequences follow, and each one changes how you should write.

  1. Passages must be self-contained. A retriever lifts a chunk of text without the surrounding page. If your answer depends on context from three paragraphs earlier, the lifted version is wrong or incomplete — and a model will not reconstruct it for you.
  2. Specificity beats comprehensiveness. "AI Overviews launched in the United States on 14 May 2024" is a retrievable fact. "AI Overviews launched recently" is not. Anchored facts with names, numbers and dates are what gets cited.
  3. Freshness is weighted, but not decisive. Engines prefer current sources for current questions, and a page cited last month that has since gone stale tends to be replaced by a fresher competitor.
  4. Heading phrasing matters. People ask assistants full questions. A heading phrased as the literal question — "How do I optimize for AI Overviews?" — is far more likely to be matched than "Optimization Strategies".

What actually raises your citation rate?

This is where most GEO advice goes wrong, so it is worth separating what has evidence behind it from what is merely repeated. The 2024 GEO paper tested nine modifications and measured the effect on generative visibility.

Effect sizes from Aggarwal et al. (KDD 2024), with our assessment of how far each can be generalised.
TacticReported effectStrength of evidenceWhat to do
Quotations from recognized authoritiesAbout +41% visibilityStrongest of the tested tacticsAdd a real expert quote with a name and a role
Statistics and hard data pointsAbout +33% visibilityStrongPut numbers in the same sentence as the claim they support
Citing sources inlineAbout +28% overall, and about +115% for pages ranking 5thStrong, with a large effect on lower-ranked pagesLink primary sources — studies, official documentation
Keyword stuffingAbout −9% visibilityConsistently negativeRemove it. The legacy tactic actively backfires
Fluency and readabilityPositiveModerateWrite clearly; jargon-heavy prose performs worse
llms.txtNo demonstrated ranking effectWeak — community conventionPublish it if cheap; expect nothing from it
Content chunking for AINo demonstrated effectWeakWrite well-structured sections anyway, but do not contort the page for it
Buying brand mentionsIneffective and riskyGoogle states it is ineffectiveEarn them; do not manufacture them

Two results in that table are counterintuitive and worth internalising. First, the largest gains went to pages that were not already ranked first — the paper reported roughly +115% visibility from source citations for a rank-five page, while the top-ranked page could actually lose ground. Adding evidence is a leveling play, not a winner's prize. Second, keyword stuffing, the classic 2014 tactic, was actively harmful.

The strongest predictor is not a technical factor

Ahrefs analyzed 75,000 brands and reported a correlation of 0.664 between branded web mentions and appearing in Google AI Overviews, against 0.326 for Domain Rating. In other words, how often and how visibly your brand is discussed elsewhere on the web correlates roughly twice as strongly as your link profile. That is an off-site, authority problem dressed up as an on-site one — and it is why GEO work that stops at the website has a ceiling.

Do I need an llms.txt file?

No, and it is important to be clear about that. Google's official AI optimization guide states directly that you do not need to create new machine-readable files, AI text files, markup or Markdown to appear in its generative features.

llms.txt is a community specification proposed by Jeremy Howard in September 2024. It is a plain-text index at your site root listing your most important pages with one-line descriptions. It is cheap to publish, it does no harm, and some non-Google agent ecosystems look for it.

But it is a discovery aid, not a ranking mechanism. Treat it as insurance with a very low premium rather than a strategy. We publish one on this site and we would not spend client budget on anything more elaborate. The full treatment, including a working example and the honest verdict, is in what is llms.txt?

Which AI crawlers should I allow?

There are now several distinct AI crawlers with different purposes, and treating them as one category is the most common robots.txt mistake. The key distinction is between crawlers that fetch live pages to answer a user's question, and crawlers that gather content for model training.

Crawler purposes differ. Note that Google-Extended has no effect on Google Search rankings, which is a widely misunderstood point.
CrawlerOperatorPurposeDefault recommendation
OAI-SearchBotOpenAILive retrieval for ChatGPT searchAllow
ChatGPT-UserOpenAIUser-triggered fetch when ChatGPT browsesAllow
GPTBotOpenAITraining data collectionBusiness decision — document it
PerplexityBotPerplexityLive retrieval and indexingAllow
ClaudeBotAnthropicTraining data collectionBusiness decision — document it
Google-ExtendedGoogleControls Gemini training and groundingDoes not affect Google Search ranking
Applebot-ExtendedAppleApple Intelligence trainingBusiness decision — document it
CCBotCommon CrawlOpen dataset used by many model buildersUsually allow

Our recommendation is to allow retrieval crawlers and to make a deliberate, documented decision on training crawlers. The commercial argument for allowing training is straightforward: you gain citations in future models, you are not paywalled, and you have no content to monetise directly. The argument against is if your content is proprietary or you consider the category valuable enough to compete with. Whichever you choose, write down the reason — a decision with a stated rationale survives the next quarterly argument; one without gets relitigated every few months.

How do you measure AI visibility?

AI visibility cannot be measured with the tools you already have. Search Console does not report it, GA4 does not know about it, and rank trackers do not model it. Measuring it requires sampling the answers themselves.

The method that works is a citation ledger. For a defined set of priority queries — typically the 30 to 100 questions your customers actually ask — sample the answers across Google AI Overviews, ChatGPT Search, Perplexity and Gemini on a recurring schedule, and record two separate numbers.

The only two numbers that survive contact with non-deterministic answers.
MetricDefinitionWhy both are needed
AI-present rateHow often an AI answer appears at all for this queryContainers flicker. A missing answer is not a lost citation
Cited-when-present rateOf the times an answer appeared, how often you were citedThis is the defensible position — a query cited 3 times out of 4 is a real position, a single mention is a coin flip

Track them on a rolling window rather than a single day, because answers are non-deterministic and the cited set rotates. Tools such as Profound, Otterly, Athena and Goodie automate the sampling; if you would rather not pay for one, the sampling is straightforward to script. The discipline matters more than the tool — a spreadsheet updated weekly will beat an expensive dashboard nobody looks at.

Related services

How to Appear in Google AI Overviews

The evidence, the measurement, and what Google actually says.

Read more

What is llms.txt?

Format, adoption, and an honest verdict on whether it matters.

Read more

Content Marketing

Writing that is both useful and extractable.

Read more

Frequently asked questions

Is GEO just SEO rebranded?
Partly. Google says plainly that optimising for generative AI search is still SEO, and the fundamentals — crawlable, indexable, valuable content — are identical. What differs is the selection mechanism: a search engine ranks documents, while an AI answer engine retrieves self-contained passages and synthesises them. That makes section-level extractability and evidence density newly important. It is an evolution of the craft, not a replacement.
Does AI content rank?
Content is not judged by who or what wrote it. Google targets "scaled content abuse" — generating large volumes of content primarily to manipulate rankings — regardless of whether a human or a model produced it. Useful-first content that satisfies a real need is the criterion. AI assistance with research, structure and drafting is normal practice; generating a thousand thin posts is what gets penalised.
Will llms.txt get me cited by ChatGPT?
There is no evidence that it does. It is a community convention that some agent ecosystems check, not something OpenAI or Google has adopted as a ranking input. Publish it because it costs twenty minutes; do not build a strategy around it. Our full assessment is in the llms.txt guide.
Should I block AI crawlers?
It is a legitimate commercial decision, but make it deliberately. Blocking GPTBot and ClaudeBot removes you from future model training and therefore from citations in those models, at no SEO cost but at a real visibility cost. Most businesses gain more from being cited than they lose. Whichever you choose, document the reason.
How is AI visibility different from ranking in terms of what I should write?
Three concrete changes. Sections must answer their own heading without relying on surrounding context. Specific facts — names, numbers, dates — belong in the same sentence as the claim they support. And headings should be phrased as the literal question a person would type, because that is how the retrieval query is formed.
Does AI visibility actually drive revenue?
It does for some businesses and not for others, which is why measuring it matters. If your customers research before buying, being cited during that research can influence deals that would otherwise have gone to a competitor. If your customers buy on impulse from a known brand, AI visibility matters very little. Know which you are before spending budget here.
Can you get us cited in ChatGPT answers?
No one can, and any agency claiming otherwise is selling a guarantee. What can be done is making your content the most retrievable and citable source for your category, earning the branded mentions that correlate with citation, and measuring whether it is working. That is a compounding process, not a switch.
Should technical SEO come first, or GEO work?
Technical SEO, always. Both classic search and AI retrieval operate on the same index, so if a page cannot be crawled, rendered or indexed it cannot be retrieved by anything. Fixing indexation problems before writing for extraction is both cheaper and more effective.

Need ai search optimization for your business?

Get a free, no-obligation review of where you stand today on ai search optimization — and the three changes that would move the number that matters. No pitch deck.

Book a free 30-minute audit