Banner ads
TechCo Hosting Information and Blog

Web Bots

December 31st, 2008 ~ No Comments

Internet bots, also known as web robots, WWW robots or simply bots, are software applications that run automated tasks over the Internet. Typically, bots perform tasks that are both simple and structurally repetitive, at a much higher rate than would be possible for a human alone. The largest use of bots is in web spidering, in which an automated script fetches, analyses and files information from web servers at many times the speed of a human.

Web bots, or spiders simply crawl the web, the same way that Google crawls it, at regular intervals to catch new and existing web sites and detect relevant keywords.

Another, more malicious use of bots is the coordination and operation of an automated attack on networked computers, such as a denial-of-service attack by a botnet. Internet bots can also be used to commit click fraud and more recently have seen usage around MMORPG games as computer game bots. A spambot is an internet bot that attempts to spam large amounts of content on the Internet, usually adding advertising links.

Three of the most common bad robots are:

  • Email harvesters: they want to spam you.
  • Corporate enforcers checking for trademark or copyright violations.
  • Scrapers trying to copy your whole site, then set it up somewhere else and put Adwords on it.

For more on the subsect search Google for Bad Web Bots

Tags: Support