How Google finds your site
Google uses programs called crawlers that download pages. Google then analyses the content and stores it in a large database, the index. Only when someone searches does Google choose the pages from that index that fit best.1
Two things are important to know. Google does not guarantee that it will crawl, index or show a page, even if everything is right. And Google does not accept payment to visit a site more often or rank it higher.1
The most common causes
If your site is not in Google, the problem is almost always one of these six.
Too new
A new site has not been discovered yet. Crawling can take anywhere from a few days to a few weeks.2
How to find it: Submit your sitemap through Google Search Console and request indexing.
robots.txt
This file tells crawlers which pages they may view. One wrong line shuts off your whole site.3
How to find it: Open yourdomain.com/robots.txt. If it says "Disallow: /", everything is blocked.
noindex
A page with "noindex" is removed from the search results. Web developers sometimes switch this on during the build and forget it afterwards.4
How to find it: Search Console shows pages with "URL marked noindex".
Technical errors
A server error or a page that looks empty (soft 404) is not included.5
How to find it: The Page indexing report in Search Console gives the reason for each page.
Duplicate content
If the same content is on several addresses, Google chooses one itself. The rest drops out.5
How to find it: Search Search Console for "Duplicate without user-selected canonical".
Crawled, not indexed
Google has seen the page but has not included it (yet). According to Google this is not necessarily a problem, but it is often a sign that the page adds little.5
How to find it: Make the page more specific and more useful, with real information.
Work it out in fifteen minutes
- Search for site:yourdomain.com in Google. If you see nothing, not a single page is in the index.
- Add your site to Google Search Console, for free, and verify it through your domain provider.
- Submit your sitemap and use URL inspection for your homepage. There you can see whether Google knows the page.
- Look at the Page indexing report. It shows, page by page, why a page was not included.5
- Also add your site to Bing Webmaster Tools. Several AI search features, including ChatGPT Search, take results from the Bing index.6
How Ekkora handles it
Findability is one of the eight checks before launch: titles, descriptions, sitemap and structured data. At handover we submit the site to Google and Bing. With the free website check you can see in half a minute whether your own site is set up to be found.
Questions
- How long does it take before a new site is in Google?
- According to Google, crawling can take anywhere from a few days to a few weeks. Even an indexing request does not guarantee that a page will appear straight away, or at all.2
- Can I pay to rank higher in Google?
- Not in the normal search results. Google does not accept money for that.1 Paid ads are separate and are labelled as ads.
- My site is in Google, but far down. Is that the same problem?
- No. In that case the page is included, but Google finds other pages more relevant. That calls for better content, links from other sites and good reviews, not a technical fix.
Sources
- Google Search Central: In-depth guide to how Google Search works (updated 18 December 2025)
- Google Search Central: Ask Google to recrawl your URLs
- Google Search Central: Introduction to robots.txt
- Google Search Central: Block Search indexing with noindex
- Search Console Help: Page indexing report
- Jetfuel: How to set up Bing Webmaster Tools (on ChatGPT Search and the Bing index) (2026)