Notice: Trying to access array offset on value of type bool in /home/admin/domains/robotstxt.info/public_html/maincore.php on line 205
Discussion Forum: Bots (good and bad) that crawled your site - Robots.txt
Navigation
Users Online Now
Guests Online 4

Members Online 0


Total Members: 2
Newest Member: robots-txt

Bots (good and bad) that crawled your site 1 thread

Web Robots (also known as Web Crawlers, or Spiders), are automated programs that rummage the Web. Search engines such as Google use them to index the web content, spammers use them to scan for email addresses, ransack your site and many other uses.
Subforums
Good Bots
Which bots will benefit your site? Search engine bots for sure. Like Google, Bing, Yahoo.
Bad Bots
Bad Bots are bots that hurt your site by ransacking your data. Scanning for email adresses, searching for weaknesses in your site. Bruteforcing login scripts. Sending and posting spam.
Threads
No threads found.
You can view all discussion threads in this forum.
You cannot start a new discussion thread in this forum.
You cannot start on a poll in this forum.
You cannot upload attachments in this forum.
You cannot download attachments in this forum.
Sign In
Not a member yet? Click here to register.