Why your website is not showing up on Google
Usually it is one of three things, and you can check all three in about five minutes without any tools. If those come back clean, the cause is more likely to be something in front of your site than something in it, and that is the part nobody writes about.
This site, 22 July 2026
Nobody wrote the file on the left. A CDN setting did.
Before
After one toggle
Every per-crawler block in the dashboard was already off. The nine refusals came from one switch called Managed robots.txt, which is on by default.
Check whether it is indexed at all
Search site:yourdomain.co.uk in Google. That asks Google what it has, rather than where you rank.If results come back, you are indexed and this is a ranking problem, not an indexing one. Those are different problems with different fixes, and most of the advice you will find answers the wrong one.
If nothing comes back, Google does not have your site. Everything below is about that.
The three ordinary causes
| Cause | How to check it | What it means |
|---|---|---|
| The site is too new | Nothing to check. How long since launch? | Indexing takes days to weeks. If you launched last Tuesday, nothing is wrong. |
| A noindex tag | View source, search for "noindex" | One line tells Google to stay out. Staging sites ship with it and it gets forgotten. |
| robots.txt is blocking | Visit yourdomain.co.uk/robots.txt | A "Disallow: /" line blocks the whole site. See below, because this one has a twist. |
That is the standard list, and on most sites the answer is the first row.Give it a fortnight before assuming anything is broken.
The cause nobody writes about
If your robots.txt blocks crawlers you never told it to block, the next question is not what you did wrong. It is whether you wrote that file at all.A CDN can rewrite it for you, and one of the common ones does it by default.
The file at the top of this page is ours. On 22 July 2026 this site was refusing nine crawlers, and it took three sessions to find out why.Nobody had written those lines.Every per-crawler block in the Cloudflare dashboard was already switched off, which is exactly what made it hard: the security settings all looked correct because they were correct.
The lines came from one switch, AI Crawl Control then Signals then Managed robots.txt, described as creating or updating your robots.txt to signal that your content should not be used for AI training.It is on by default and it silently replaces your file.One toggle, and the file went back to being ours.
That matters more every month. If you care about being quoted by an assistant as well as ranked by a search engine, a blanket refusal aimed at AI training takes you out of both.
Tell Google the site exists
- Create a Search Console property. It is free, it takes about ten minutes, and without it you are guessing. It is also the only place that will tell you Google has seen your site and chosen not to index it, which is a different problem again.
- Submit your sitemap. Usually at yourdomain.co.uk/sitemap.xml. This is not magic and it does not force anything, but it removes the excuse that Google never found the pages.
- Use the URL Inspection tool on one real page. It reports exactly what Google sees, including whether a redirect, canonical or noindex is getting in the way.
This is the step people skip because it feels like admin rather than work.Skipping it means every other decision you make about search is a guess.
If you are indexed but nobody finds you
Then the site is not missing, it is losing. Usually to pages that answer the question better or have been answering it for longer.
The uncomfortable version: search for the thing you want to be found for and read what currently ranks. If those pages answer the question more completely than yours, you are not being ignored.You are being outranked, which is fixable and slower.
Common questions
How long does it take for a new website to appear on Google?
Days to a few weeks for a small site, and there is no way to buy your way to the front of that queue. Submitting a sitemap through Search Console does not speed indexing up so much as remove the possibility that Google simply has not found the pages. If a month has passed with nothing in a site: search, stop waiting and start checking, because at that point something is usually blocking it rather than slowing it.
Why does my site show up when I search the name but not for anything else?
That is the normal state for a new or small site, and it is good news rather than bad. Ranking for your own business name means Google has indexed you and understands what you are called. Ranking for a competitive phrase means beating everyone already answering it. The first happens automatically. The second is the actual work, and it is a content and links problem rather than a technical one.
Can my hosting or CDN stop Google indexing my site?
Yes, and it is more common than the advice suggests. A CDN sits in front of your site and can serve its own robots.txt, block traffic it classifies as a bot, or challenge crawlers with a security check they cannot pass. On this site in July 2026 a Cloudflare setting called Managed robots.txt, which is on by default, had written nine Disallow lines nobody asked for while every per-crawler block in the same dashboard was correctly switched off. The way to catch it is to fetch your own robots.txt from outside your network and read what is actually served, rather than what you believe you published.
Do I need to pay someone to get my site on Google?
No. Getting indexed is free and mostly automatic, and anyone charging a fee purely to submit your site is selling you something Google does that on its own. Where money genuinely helps is competing for a phrase lots of other businesses want, which is a content and authority problem rather than a submission one. Be wary of any offer that promises a position or a timescale, because nobody can promise either.