Fazley RabbiWhen someone types a search into Google, Google does not go out and search the web at that moment. It looks through an index it has already built. Getting into search results is therefore a three-step journey: Google has to find your page (crawling), understand and store it (indexing), and then decide it is one of the most useful answers for a particular search (ranking). If any step fails, the page does not show up, however good it is.
Stage one: crawling, or finding the page
Google uses automated programs, usually called crawlers, to visit pages and follow the links on them. Its main crawler is called Googlebot. It discovers pages mostly in three ways:
- Links from pages it already knows, both on your own site and on other sites.
- Sitemaps, files that list the pages you want found, which you can submit through Google Search Console.
- Revisits to pages it has seen before, to check what has changed.
Think of a crawler as a delivery rider who only knows the roads on his map. If a page on your site has no links pointing to it, it is like a shop down an unnamed lane: it exists, but nobody is routed there.
Crawling can be blocked, sometimes by accident. A robots.txt file can tell crawlers to stay away from parts of a site, and a site left in "under construction" mode or behind a login cannot be read. A slow or often unreachable server, such as a server in an office that goes down during power cuts, also makes crawling harder.
Stage two: indexing, or understanding and storing it
After fetching a page, Google tries to understand it: the text, headings, title, images and their descriptions, links, and structured data if there is any. It also renders the page much like a browser does, so content that appears after scripts run can usually be read, although it is safer when the key text is in the page itself.
Google then decides whether to keep the page in its index. Not every crawled page is kept. Common reasons a page is left out:
- A
noindexinstruction tells Google not to index it. - It is a near copy of another page, so Google keeps one version as the main (canonical) one.
- It is thin, such as a product page with a photo and a price but no description.
- Google judged it not useful enough to keep, at least for now.
When indexing, Google mainly looks at the mobile version of your pages. That matters in Bangladesh, where many visitors arrive on a phone. If your mobile layout hides content that the desktop version shows, Google may not see it.
Stage three: ranking, or choosing what to show
When someone searches, Google pulls matching pages from its index and puts them in order. It does not publish a full formula, but its public explanations describe the broad things it weighs:
| What Google considers | In everyday terms |
|---|---|
| Meaning of the search | What the person actually wants, even with spelling mistakes or Banglish |
| Relevance | Does the page really cover that topic? |
| Quality | Is the information helpful, accurate and trustworthy? |
| Usability | Does the page work well on a phone and load reasonably fast? |
| Context | The searcher's location, language and settings |
Context explains why two people can see different results. Someone in Rajshahi searching "AC servicing" will see local businesses that someone in Sylhet will not. It also explains why a Bangla search and an English search for the same thing can return different pages.
Ranking is also where the rest of the web matters. Links and mentions from other trustworthy sites suggest that real people find your business worth referring to.
Where small business websites usually get stuck
When I review a small business website, I check the stages in this order, because the problem is often earlier than the owner expects. They worry about ranking when the page was never indexed.
- Not found: new pages with no internal links and no sitemap.
- Not indexed: near-identical product pages, empty category pages, or a leftover
noindexfrom the developer's test version. - Indexed but not ranking: pages that do not clearly answer what people search for, often written in English while customers search in Bangla or Banglish.
If your pages do not appear on Google at all, the guide to pages that do not appear on Google walks through the fix step by step.
A quick self-check
You can check the basics yourself in a few minutes:
- Search
site:yourdomain.comon Google to see roughly which pages are indexed. - Add your site to Google Search Console and open its page indexing report.
- Inspect one important page in Search Console to see whether Google can fetch it and whether it is indexed.
- Make sure every important page is linked from at least one other page on your site.
- Open your site on a phone using mobile data and check that the key content shows.
Once you know which stage is failing, the fix becomes much clearer. If you would like a second pair of eyes, my SEO, AEO, GEO and AIO service starts with exactly this check, and the SEO, AEO, GEO and AIO explainer shows how the same foundation supports AI search too.