It can be expressed as being a share and is particularly applied to investigate the prominence of a selected key word within the context of the general written content. Keyword density iIndexing: The data gathered because of the crawlers is structured and saved in a sizable database referred to as an index.Robots.txt information are very important