Google Search
Crawls, indexes, and serves web pages in response to user queries, making your content discoverable only if each stage succeeds.
If you have ever published a page and wondered why it never appears in results, you already know that being crawled does not guarantee indexing or ranking.
Key points
- Ensure your pages are crawlable by allowing Googlebot access to important resources like CSS and JavaScript.
- Use clear, descriptive titles and headings that match what searchers actually type, not just keywords.
- Submit a sitemap to help Google discover all your important pages, especially new or updated content.
- Monitor indexing status in Google Search Console to catch issues like noindex tags or crawl errors early.
- Create content that satisfies search intent, not just keyword density, to improve relevance and ranking.
- Avoid blocking internal links or navigation; crawlability relies on accessible pathways for Googlebot.
A blog post about pruning roses
A new blog post on 'how to prune roses' is published. Google crawls it within a week, but the page lacks a clear title tag and uses images without alt text. The page is indexed but ranks poorly because Google cannot understand its content. After adding a descriptive title and alt text, the page appears on page one for related queries, though ranking still depends on query relevance and competition from established sites.
Three stages of Google Search
- Crawling Google's automated crawlers perform the crawl Google process to discover new pages by following links and sitemaps. Without crawlability, your page cannot enter the search pipeline, and blocked resources like CSS may cripple understanding.
- Indexing Google analyses the page content and stores it in its index. Not every crawled page gets indexed; thin or low-quality pages may be skipped entirely, even if Googlebot visited them.
- Serving When a user searches, Google retrieves relevant pages from its index and ranks them. This stage depends on query relevance and many ranking signals, not just content quality, including user location and device.
Four common mistakes
- Treating stages as one step Many assume publishing equals ranking. In reality, crawling, indexing, and serving are separate hurdles; each can fail independently, and a page may be crawled but never indexed.
- Blocking crawlers Using robots.txt to disallow important resources like CSS or JavaScript can prevent Google from understanding your page. Ensure critical files are crawlable to meet google search essentials.
- Ignoring search intent Writing content that does not match what users actually search for leads to poor relevance and low rankings. Align your page with the searcher's goal, not just a keyword list.
- Forgetting internal links Without crawlable links between your pages, Google may not discover new content. Use descriptive anchor text and a logical site structure to aid website crawling.
Three things to check before publishing
- Crawlability Verify that Googlebot can access your page and its resources. Use the URL Inspection tool in Google Search Console to test for crawl errors and ensure no accidental blocks.
- Indexability Ensure no meta robots noindex tag or login walls block indexing. Your page should be eligible for the index to appear in results, and check for proper canonicalisation.
- Content signals Place key terms in the title, main heading, alt text, and link text. Google uses these signals to understand what the page is about and match it to queries accurately.
Common questions
How can I identify a song using Google Search?
Use the search by humming or singing feature on the Google app. Tap the microphone icon and hum the tune for 10–15 seconds.
How do I use Google Trends to compare search terms?
Go to Google Trends, enter up to five terms separated by commas. The graph shows relative popularity over time and by region.
Why is a page not appearing in Google Search?
Check if the page is indexed using Google Search Console. Common reasons include crawl errors, noindex tags, or poor content quality.
Sources
- Google Search Central: How Search Works Official documentation on crawling, indexing, and serving stages.
- Google Search Essentials Requirements and best practices for appearing in Google Search.