Sunday, 7 June 2015

How much time does Googlebot take to crawl the page after submitting it to index

Question: 1
I've a daily changing job site and I've also setup a dynamically generated XML 
sitemap for the search engines. But Googlebot indexes the at it's own priority.
  • I've a page linking to newly added jobs which I want Googlebot to index ASAP.
  • I've observed that after giving a page "Submit to index" in "Fetch as Google" in GWT Google may take 2-3 days to index it.
  • Has Google released any official update about how much time it'd take to index a page after we "Add to index" in the GWT?
  • I've tried to search in Google about this query but I found nothing ...


Your question is impossible to answer based on facts because every site is treated differently from one to the next. The time it takes for Google to return to a site is very complex algorithm which has countless variables that will affect the crawl back date:

  • Your Niche will play some role in how important it believes your content is.
  • Your site speed plays some role.
  • Your backlinks, social mentions - if your adding content that happens to get linked from various trusted sites your get a update within minutes not hours or days.

Like you've said it does take 2-3 days usually but can be up-to a few weeks. Pages of mine that I uploaded when I uploaded my website a few weeks ago are still getting crawled and then getting added to index.

Maybe if you submit your jobs to an established job website with a link back to yours it would help?

The way that Google works is that it goes to other pages through links in pages it already knows.

Basically Google's bot will discover pages at the same rate that users find them, you need to have one link from a page that Google knows. If you sign up for Webmaster Tools then this speeds the process up. If you do that it usually takes only 2-3 days to get it crawled.

No comments:

Post a Comment