Indexing

What do you mean by web page indexing ? The spider builds a list of web pages and words.  The search engine then creates a database of these words called an index.  When you type in a word or phrase for search, the engine compares your keyword or phrase to its index and compiles a … Read more

Crawling

What is web crawling? A search engine uses a software called a “web spider” or “web crawling”, which is a type of “bot” (short for “robot”) used to automatically carry out repetitive tasks. The spider browses the world wide web (WWW), starting with heavily used sites.  It “crawls” from site to site, following links and … Read more