We asked AI for a roofer 945 times.

Research · 16 November 2026

The same question about each of 63 UK towns and cities, asked five times of Claude, of ChatGPT, and of the model ChatGPT’s free app used until October. Here is who they named, how often the names changed, and where the names came from.

Each was asked through its maker’s developer interface, with web search on. How it was done is set out below.

Ask again and the list changes.

A page of search results holds still for a while. An assistant writes a new answer every time it is asked, so we asked each one five times about every town and counted how often a firm came back.

In 51 of the 63 towns ChatGPT named no firm in all five answers. Claude had at least one firm it named every time in 47 towns.

Two assistants, two lists.

Both assistants were asked the same question about the same towns on the same afternoon. Town by town, most of the firms one of them named were never named by the other.

Of the 159 firms Claude named every time, ChatGPT named 36 at least once.

Where the names come from.

An assistant with web search cites pages in its answer, and we counted every page cited. Both went mostly to sites that list tradespeople and collect reviews of them: trade directories, quote sites and lists of roofers. Few of the pages cited were a roofer’s own website.

Most cited sites

The share of each assistant’s 315 answers that cited the site.

Claude

  1. trustatrader.com 72%
  2. topratedroofers.co.uk 65%
  3. checkatrade.com 51%
  4. mybuilder.com 49%
  5. ratedtraders.com 31%

ChatGPT

  1. checkatrade.com 69%
  2. yell.com 12%
  3. trustatrader.com 11%
  4. nfrc.co.uk 11%
  5. which.co.uk 9%

Google’s map pack is a different list.

For a local search Google shows a map with three firms above its results. We set the firms in that map pack beside the firms the assistants named for the same town.

Google’s side is the last record Ahrefs held for each town, checked between 26 September and 16 November 2026. A record can be up to eight weeks older than the answers.

Some answers went to another country.

The question named a town and no country. Asked through the developer interface, the models sometimes took the town for one of the same name abroad: Birmingham in Alabama, Cambridge in Massachusetts or Peterborough in Ontario.

The interface gives the place to the search and not to the model. The apps know roughly where their user is, so an app may do this less often. A firm named this way is counted, and is marked in its town’s list below the firms in the town itself.

One gives a list. The other picks.

The two answer in different ways. Claude sets out several firms and leaves the choice to the reader. ChatGPT usually names one firm as the place it would start.

What this does not show.

  • The answers came through each maker’s developer interface on 16 November 2026, with web search on and the town given as the place. The apps add things an interface does not, such as memory of earlier chats and a closer sense of where the user is, so an answer in the app can differ.
  • Answers change from day to day and from person to person. Five asks show how much one afternoon’s answers vary. They do not show next month’s.
  • One question about one kind of roofing work, a repair. Other kinds of work, such as a new roof or a flat roof, were not asked.
  • The question names the town and not the country. Through the developer interface the place goes to the search and not to the model, so a model can take the town for one of the same name abroad, or ask which is meant. The apps know roughly where their user is.
  • 125 of the 1,229 firms Claude and ChatGPT named were in a town of the same name abroad. They are counted in every figure on this page. Each is marked in its town’s list and in the data.
  • The questions to ChatGPT went through OpenRouter, a service that passes each request on to OpenAI. Which model the free app gives is taken from OpenAI’s own release notes: GPT-5.6 Luna became the default for Free users in August 2026, and Free users moved to GPT-6 Luna from 8 October 2026. OpenAI’s help page for the Free tier still named GPT-5.6 Luna on 14 November 2026, so the move may not have reached every free user. The study asked both models.
  • Anthropic made Sonnet 5 the default model of Claude’s Free plan on 30 June 2026 and released Sonnet 5.5 on 28 September 2026. Its pricing page lists Sonnet for the Free plan without a version number, and the press reported Sonnet 5.5 as the free model from then. The study asked Sonnet 5.5.
  • Firm names were taken from each answer by a model and checked against the answer’s own words. Names that looked alike were joined by hand. A roofer’s name is often a common word and a trade word, so some firms may still be counted twice, or two as one.
  • Google’s results are the last record Ahrefs held for each town, checked between 26 September and 16 November 2026. Three towns had no usable record.
  • Being named is not a mark of quality, and not being named is not a mark against a firm. No firm on this page was checked against a trade body’s list, a vetting scheme or the companies register.

How it was done.

  1. The question was “My roof needs repairing. Can you recommend a good roofer in Leeds?”, with each town’s name in turn.
  2. The towns are the 63 largest towns and cities in the UK as the Centre for Cities lists them, so we chose none of them.
  3. Each town was asked five times of each of three models: Claude (Sonnet 5.5, the free app’s model), ChatGPT (GPT-6 Luna, the free app’s model from October 2026) and ChatGPT (GPT-5.6 Luna, the free app’s model until October 2026). That makes 945 answers. None failed.
  4. Every answer was a new conversation with web search on and the town set as the place. All were collected on 16 November 2026 between 14:10 and 15:12 GMT.
  5. Firm names were taken from each answer and matched across answers, so one firm written two ways counts once. A firm is counted in the town it was named for.
  6. Where a first answer asked which place was meant, we replied with the town and its nation and counted the answer that followed.
  7. Every answer with a sign of a place abroad was read by a person: a telephone number written the North American way, a page cited on another country’s site, a state or province in its words. Each firm was then marked as in the town asked or abroad.
  8. Each cited page was sorted by hand: a firm’s own site, a review site, a trade directory or quote site, a directory or list, a trade body or vetting scheme, public advice, or other.
  9. Google’s map pack and first page for “roofers” and the town’s name are as Ahrefs last recorded them.

The data.

AI answers for roofers in 63 UK towns

The counts from 945 answers to one question about 63 UK towns and cities, collected on 16 November 2026: the firms each answer named, the pages it cited and the number of asks each firm was named in.

The files are free to use and to republish, with a credit to Sequentis and a link to this page (Creative Commons Attribution 4.0). The answers’ full wording is not published.

  • study.json Every number on this page, with each town’s firms.
  • firms.csv Every firm and town, with the number of asks each model named it in, and whether the firm is in the town asked or abroad.
  • answers.csv One row for each of the 945 answers: its model, town and time, the firms it named and the pages it cited.
Roofing SEO Be the roofer they find.

+000%

Your number here.

We read it the way Google and the AI assistants do. It takes a few seconds.

Find out how well the assistants can read your own site.

We read every brief the same day and reply with a plan.

Start a project