web crawler

Show Summary Details

Quick Reference

An application that systematically and continuously traverses the World Wide Web for some purpose. Web search engines, for example, use web crawlers to refresh their data by visiting every web site periodically. Performing such traversals is called spidering.

Subjects: Computing.

Reference entries

Users without a subscription are not able to see the full content. Please, subscribe or login to access all content.