The 30-second answer: let OAI-SearchBot in, be in the index ChatGPT searches, and answer the question in the first paragraph
OpenAI’s publisher FAQ says any public website can appear in ChatGPT search, as long as it is not blocking OAI-SearchBot. That is the gate. Behind it, ChatGPT finds candidate pages through third-party search providers it does not name, and the evidence since launch points at Bing. So the levers are: allow the right bot, make sure Bing has your pages, and write each page so a model that quotes can quote it.
Five steps, in order of effect: allow OAI-SearchBot and ChatGPT-User in robots.txt and in your firewall; get your pages into Bing with Webmaster Tools, a sitemap, and IndexNow; make each important page answer one question as text; keep every copy of a fact consistent; and measure with the utm_source=chatgpt.com referrals OpenAI adds to its links.
How ChatGPT search finds and cites a page
OpenAI’s crawler documentation describes three agents with three jobs, and the distinction matters more here than for any other assistant:
- OAI-SearchBot is for search. OpenAI says it is used to surface websites in search results in ChatGPT’s search features, and recommends allowing it in robots.txt. A robots.txt change takes about 24 hours to be reflected. Its IP ranges are published at openai.com/searchbot.json.
- ChatGPT-User fetches a page when a person asks something that needs it. OpenAI says it is not used for crawling the web in an automatic fashion, that robots.txt rules may not apply because a user initiated the request, and that it is not used to determine whether content may appear in search.
- GPTBot is for training foundation models. Disallowing it indicates your content should not be used in training. It has no bearing on search.
The publisher FAQ adds two details site owners ask about. A page you have disallowed can still show up as a bare link and title if OpenAI finds the URL elsewhere and judges it relevant; it just cannot be summarised. To keep a page out entirely, use a noindex meta tag, and let the crawler fetch the page so it can read the tag. And ChatGPT adds utm_source=chatgpt.com to the links it shows, which is how you will measure all of this later.
Where Bing fits, as of October 2026
When OpenAI launched ChatGPT search on 31 October 2024, its announcement said the feature uses third-party search providers as well as content provided directly by its partners. It did not name the providers, and it still has not. Three things are nonetheless well established:
- Independent tests in the weeks after launch found ChatGPT’s results closely tracking Bing’s index, including pages Google ranked differently and pages Bing had not indexed going missing from ChatGPT.
- OpenAI has since been reported to be building and testing a search index of its own, which would reduce the dependence over time. It has not confirmed the details.
- OAI-SearchBot crawls your site directly. Whatever the provider mix, OpenAI’s own crawler has to be able to read the page to summarise it.
The practical rule: treat Bing as the index you need to be in and OAI-SearchBot as the reader you need to allow. Both are cheap. If OpenAI’s own index takes over, nothing in the steps below becomes wrong; it just matters less which search engine you pinged.
Step 1. Allow the right bots, and verify the hits
User-agent: OAI-SearchBot Allow: / User-agent: ChatGPT-User Allow: /
If you also want to opt out of training, add a separate Disallow group for GPTBot; the three are evaluated independently. Then check the layer in front of robots.txt: a CDN or firewall rule that challenges non-browser requests will block OAI-SearchBot without ever reading your robots.txt. Add the ranges from openai.com/searchbot.json and openai.com/chatgpt-user.json to its allow list. The crawler list has the full set of user agents and the verification steps.
Step 2. Get your pages into Bing
Most sites have never looked at Bing. Three things close the gap in an afternoon:
- Bing Webmaster Tools. Free. Verify the site, submit the same sitemap you give Google, and check that your important pages show as indexed. Allow the bingbot user agent in robots.txt and in the firewall, the same way as in step 1.
- IndexNow. A push protocol Bing accepts: host a key file at the site root, then send each new or updated URL to the endpoint. One POST can carry up to 10,000 URLs, and the specification says a submission is shared with all participating engines, which include Bing, Yandex, Naver, Seznam, and Yep. Many CMS plugins do this automatically.
- Dates and titles. Bing, like any engine, needs a visible publication date and a title that names the thing. The same habits that help step 3 help here.
POST https://api.indexnow.org/indexnow
Content-Type: application/json; charset=utf-8
{
"host": "example.com",
"key": "<your-key>",
"urlList": [
"https://example.com/pricing",
"https://example.com/docs/getting-started"
]
}
Step 3. Make each important page quotable
Both OAI-SearchBot and ChatGPT-User read the HTML as served. The model then lifts sentences from it. Three habits make a page the one it lifts from:
- One page, one question, answered first. The question in the heading, a two-sentence answer with the number and the date in the first paragraph, explanation afterwards.
- Text in the HTML. Prices in images, content behind tabs, and sections loaded by script after the page arrives are invisible to a plain fetch.
- Something citable. A figure with its source, a quotation, a dated reference. The GEO article covers the one controlled study on this and what it found.
Step 4. Keep facts consistent, and be realistic about llms.txt
A search-backed answer finds every copy of a fact you have published, including the 2024 blog post with the old price. Date the current page, annotate or redirect old copies, and make structured data match the visible text. The pricing article walks through the sweep.
On llms.txt: OpenAI’s crawler documentation does not mention it, and public log studies have counted almost no fetches from OpenAI’s agents. Publish it for the tools that read it, and do not expect it to move ChatGPT. The ChatGPT and llms.txt article has the evidence.
Step 5. Measure
- Referrals. Filter analytics for utm_source=chatgpt.com. This is the cleanest signal any assistant gives you, because OpenAI adds it on purpose.
- Logs. Count OAI-SearchBot and ChatGPT-User requests per week, verified against the published IP JSON. The first means you are being indexed; the second means a question caused a fetch.
- A monthly audit. Ask ChatGPT your ten most important questions with search enabled, in a logged-out session, and record whether you appear in the sources and which page was cited. The citations article has the full routine.
When you are not cited
| Symptom | Likely cause | Fix |
|---|---|---|
| No OAI-SearchBot in logs | robots.txt or a firewall rule blocks it | Allow by name and by IP range; wait about 24 hours |
| Bot visits, page not in Bing | Bing has not indexed the page | Verify in Webmaster Tools, submit the sitemap, send IndexNow |
| Shown as a bare link, never quoted | The page is disallowed for OAI-SearchBot | Allow the page, or add noindex if you want it gone |
| Cited with the wrong number | An old copy of the fact outranks the current page | Date the current page; annotate or redirect old copies |
| Competitor cited for your brand query | Title and first paragraph do not name the thing | Put product and company name in the title and opening |
| Cited on Perplexity, not ChatGPT | Different pipelines and a different index | Check Bing coverage; keep tracking each assistant separately |
The first row is the one that fails silently. A checker fetches your robots.txt and pages the way a bot does and reports what OAI-SearchBot and the other common agents are allowed to read.
See which bots can reach your site
Run the checker on your URL. It fetches your robots.txt and reports what OAI-SearchBot, ChatGPT-User, and the other common AI user agents are allowed to read, alongside the llms.txt draft it generates.
Run the check →FAQ
What decides whether ChatGPT search cites my site?
OpenAI's publisher FAQ says any public website can appear in ChatGPT search, provided it is not blocking OAI-SearchBot, the crawler that surfaces sites in ChatGPT's search features. Beyond that gate, a page has to be findable by the search provider ChatGPT queries and has to answer the question as text. OpenAI does not publish a ranking method.
Does ChatGPT search use Bing?
OpenAI's launch announcement said ChatGPT search uses third-party search providers as well as content from its partners, and it has not named the providers. Independent tests after the launch found results that closely tracked Bing's index, and OpenAI is reported to be building an index of its own. As of October 2026 the safe assumption is that a page Bing has not indexed is harder for ChatGPT to find, so being in Bing is cheap insurance, not a guarantee.
I blocked GPTBot. Does that remove me from ChatGPT search?
No. OpenAI documents three agents with separate jobs. GPTBot is for training and disallowing it only says your content should not be used to train models. OAI-SearchBot is for search, and it is the one to allow if you want to be cited. ChatGPT-User fetches pages when a person asks, and OpenAI says it is not used to decide what appears in search.
A page I disallowed still shows up as a link. Why?
OpenAI's FAQ explains that a disallowed page can still appear as a bare link and title if its URL is found elsewhere and judged relevant; what it cannot do is be summarised or quoted. To keep a page out entirely, OpenAI recommends a noindex meta tag, and notes that the crawler must be allowed to fetch the page in order to read the tag.
Does llms.txt help me get cited in ChatGPT?
Not that anyone has shown. OpenAI's crawler documentation does not mention the file, and public server-log studies have counted almost no llms.txt fetches from OpenAI's agents. Inclusion is governed by OAI-SearchBot and by whether your pages are readable; the file is a separate, cheap thing to publish for the tools that do read it.
How do I know whether ChatGPT is sending traffic?
OpenAI adds utm_source=chatgpt.com to the links it shows, so referrals appear under that source in any analytics tool. Pair that with your server logs: OAI-SearchBot visits mean you are being indexed, and ChatGPT-User visits mean someone's question caused a fetch. Verify both against the IP ranges OpenAI publishes at openai.com/searchbot.json and openai.com/chatgpt-user.json.
Next steps
- → Does ChatGPT actually use llms.txt? (what OpenAI documents and what the logs show)
- → How to get your site cited by Perplexity (the same five steps for the other search-backed assistant)
- → How to check whether AI search has picked up your site
- → All Learn articles