This is the name of the Crawler/spider that is currently visiting a page. Spider is a robot sent out by search engines to catalogue websites on the internet. When a spider indexes a particular website, this is known as ‘being spidered’.

Leave a Reply

Your email address will not be published. Required fields are marked *

Post comment