Hi, hier mal eine Info welche "Bots" sich im Forum offiziell rumtreiben und im öffentlichen Teil Daten sammeln für Suchmaschinen, Bigdata und co:
Zitat:
AdsBot [Google]
Alexa [Bot]
Alta Vista [Bot]
Ask Jeeves [Bot]
Baidu [Spider]
Bing [Bot]
Exabot [Bot]
FAST Enterprise [Crawler]
FAST WebCrawler [Crawler]
Francis [Bot]
Gigabot [Bot]
Google [Bot]
Google Adsense [Bot]
Google Desktop
Google Feedfetcher
Heise IT-Markt [Crawler]
Heritrix [Crawler]
IBM Research [Bot]
ICCrawler - ICjobs
ichiro [Crawler]
Majestic-12 [Bot]
Metager [Bot]
MSN [Bot]
MSN NewsBlogs
MSNbot Media
NG-Search [Bot]
Nutch [Bot]
Nutch/CVS [Bot]
OmniExplorer [Bot]
Online link [Validator]
psbot [Picsearch]
Seekport [Bot]
Sensis [Crawler]
SEO Crawler
Seoma [Crawler]
SEOSearch [Crawler]
Snappy [Bot]
Steeler [Crawler]
Synoo [Bot]
Telekom [Bot]
TurnitinBot [Bot]
Voyager [Bot]
W3 [Sitesearch]
W3C [Linkcheck]
W3C [Validator]
WiseNut [Bot]
YaCy [Bot]
Yahoo [Bot]
Yahoo MMCrawler [Bot]
Yahoo Slurp [Bot]
Mfg