crawl frequency

Quick Reference

The rate at which a website is crawled. High rates of crawling, by, say a ‘spider’ like that of Google, is a mark of the website's status and trustworthiness. Sites which are well trusted or frequently updated may be crawled more frequently than sites with low trust scores and limited link authority. See also spider.

Subjects: Marketing.

Reference entries