The advent calendar of AI search tips.
From 1 to 24 December one door opens each day. Behind each door is one check you can run on your own website, most of them in under an hour, so AI assistants and search engines can read it properly.
All 24 tips are below.
The doors
Open a door to read its tip. Doors you have opened stay open on this device.
-
1 December. Open your robots.txt
Type your domain with /robots.txt after it into a browser and look for GPTBot, OAI-SearchBot, ClaudeBot and PerplexityBot. If one of them is followed by the line Disallow: /, that crawler may read none of your pages.
-
2 December. Two OpenAI crawlers, two jobs
OpenAI sends OAI-SearchBot to find pages for ChatGPT search and GPTBot to collect training data. You can allow the first and block the second in robots.txt, if you want to be found in answers without your pages going into training.
-
3 December. Say who runs the site, in markup
Add Organization structured data to your home page with your official name, logo, address and links to your profiles elsewhere. It gives search engines and AI tools a machine-readable record of who is behind the site. Check it at validator.schema.org.
-
4 December. Firewalls can block crawlers too
A firewall or CDN bot rule can turn AI crawlers away even when robots.txt lets them in. Cloudflare, for one, has a setting that blocks AI crawlers, so check your dashboard as well as the file.
-
5 December. Alt text on every meaningful picture
Describe what a picture shows in its alt text, in plain words. A crawler that cannot see the picture reads those words, and so does anyone using a screen reader. Purely decorative pictures get an empty alt.
-
6 December. Read your page the way most crawlers do
Most AI crawlers do not run JavaScript. Open one of your pages, choose View page source (the raw HTML, not the inspector) and search for your prices or opening hours. If they are not in that source, those crawlers never see them.
-
7 December. Titles that say something
Each page title should name what is on the page and who you are, for example "Emergency plumber in Leeds | Smith Plumbing". A title like "Home" tells a search result or an assistant nothing about you.
-
8 December. Point crawlers at your sitemap
Add a line such as Sitemap: https://yoursite.com/sitemap.xml to robots.txt. Keep the sitemap to pages that load and that you want found, so crawlers spend their visit on those.
-
9 December. Ask the assistants yourself, more than once
Ask ChatGPT, Gemini and Claude the question a buyer would ask, with your town or trade in it. Ask each one three times, because the answers change from one ask to the next, and note who gets named each time.
-
10 December. Know what Google-Extended does
Blocking Google-Extended in robots.txt keeps your pages out of answers in the Gemini apps and out of Gemini training. It does not remove you from Google Search, which crawls as Googlebot, so block it only if that trade suits you.
-
11 December. Say what you do, near the top
Put one plain sentence near the top of your home page that says what you sell, to whom and where, for example "We fit kitchens in Leeds and Bradford." An assistant can only repeat what your site states.
-
12 December. Local details that match everywhere
If you serve a local area, add LocalBusiness markup with the same name, address, phone number and opening hours as your Google Business Profile. When those details differ between places, machines cannot tell which is right.
-
13 December. One page for each service
Give every service its own page, with its own title and a plain description of what it includes, who it is for and what it costs. One Services page with twelve bullet points answers none of those twelve questions well.
-
14 December. Check for nosnippet and noarchive
A robots meta tag with nosnippet hides your text from search snippets and from Google's AI Overviews, and noarchive limits what Bing Copilot can use. Search the page source of the pages you want quoted for both words.
-
15 December. Put a number on your prices
If you can, publish a price or a price range. When a buyer asks an assistant what something costs, a page with a number on it is a page it can cite.
-
16 December. Write a short llms.txt
llms.txt is a plain text file at the root of your site that says what the site is and links its main pages. It was proposed in September 2024 and few assistants are known to read it yet, so keep it short and true; it takes about ten minutes to write.
-
17 December. Link straight to the final address
Point every internal link at the page's final address. A link that passes through two or three redirects, or ends on a missing page, costs the crawler part of its visit.
-
18 December. Headings that outline the page
Give each page one main heading and subheadings that read like its table of contents. Machines and screen readers both use them to find the part of the page that answers a question.
-
19 December. Answer the questions you get on the phone
Write the questions buyers ask you onto the pages they belong to, each with a direct answer in its first sentence. An assistant looking for that answer then finds it in one place, in your words.
-
20 December. Be on the lists that get read
Assistants often name the businesses that other sites already name: directories, review sites, trade bodies and local press. Find the top three lists for your trade and town, and check that you are on them with the right details.
-
21 December. Verify your site with Bing
Add your site to Bing Webmaster Tools. Copilot answers from Bing's index, and Bing supports IndexNow, which lets you tell it about a new or changed page as soon as you publish it.
-
22 December. Dates that tell the truth
Show a published date and an updated date on articles and guides, and change the updated date only when the content changes. Readers and machines use those dates to judge whether advice is still current.
-
23 December. Ask what they say about you
Ask an assistant what your business does and where. Wrong facts usually come from an old page, a directory listing or a profile you forgot about, so fix that source and ask again a month later.
-
24 December. Check again next month
Put a monthly reminder in your calendar to open robots.txt, test your markup and ask one assistant about your business. Plugin updates, theme changes and firewall settings change these without telling anyone.
Check your robots.txt against 25 AI crawlers at once.
The free scan reads your robots.txt for 25 AI crawlers, keeps, fixes or writes your llms.txt, and grades up to 1,000 of your pages with a price in points on every fix.





