360Spider
404checker
Aboundex
AfD-Verbotsverfahren
AIBOT
Alexibot
AllSubmitter
Apexoo
ASPSeek
Attach
BackDoorBot
Backlink-Ceck
BacklinkCrawler
BackWeb
Badass
Bandit
Battleztar Bazinga
BBBike
Bigfoot
Blackboard
BlackWidow
BlowFish
Brandprotect
Brandwatch
BuiltBotTough
Bullseye
BuzzSumo
CCBot
Cegbfeieh
CheeseBot
CheTeam
ChinaClaw
Claritybot
coccocbot-web
cognitiveseo
CopyRightCheck
Copyscape
Cosmos
crawler.feedback
crawl.sogou.com
DBLBot
Demon
Deusu
Devil
Digincore
DigitalPebble
Dirbuster
Disco
Discobot
Discoverybot
Dispatch
DomainCrawler
DomainSigmaCrawler
Download Wonder
Dragonfly
DTS Agent
Ebingbong
EirGrabber
EMail Siphon
EroCrawler
ExtractorPro
facebookscraper
FemtosearchBot
Fimap
Firefox/7.0
FlashGet
Foobot
Freeuploader
GalaxyBot
GetWeb
Gigablast
G-i-g-a-b-o-t
Grabber
Grafula
GrapeFX
GT::WWW
Haansoft
Harvest
HMView
HTTrack
Humanlinks
IlseBot
IndeedBot
InfoNaviRobot
InfoTekies
Internet Ninja
ips-agent
Iria
IRLbot
Iskanie
JamesBOT
Jetty
JikeSpider
Joomla
Jorgee
Jyxobot
Kozmosbot
Lanshanbot
LexiBot
Lftp
Libwhisker
Likse
LinkextractorPro
LinkScan
LinkWalker
LinqiaMetadataDownloaderBot
Lipperhey Spider
Lmspider
Ltx71
lwp-request
lwp-trivial
Mag-Net
Majestic12
Majestic-SEO
MarkMonitor
Mata Hari
Meanpathbot
mediawords
MegaIndex.ru
Metauri
Microsoft Data Access
MIIxpc
Mojeek
Mr.4x3
Msrabot
MS Web Services Client Protocol
Musobot
Navroad
NearSite
netEstate NE Crawler
NetLyzer
NetMechanic
NetSpider
NetZIP
NextGenSearchBot
Nibbler
NICErsPRO
NPbot
oBot
Offline Explorer
OrangeSpider
OutclicksBot
PageScorer
Pandalytics
pcBrowser
Picscout
PictureFinder
Pi-Monster
Pixray
PleaseCrawl
plumanalytics
POE-Component-Client-HTTP
Probethenet
Psbot
PxBroker
QueryN Metasearch
RankActive
RankActiveLinkBot
RankFlex
RankingBot
RankingBot2
Rankivabot
RankurBot
ReGet
Ripper
Rogerbot
s1z.ru
SalesIntelligent
ScanAlert
Scanbot
ScoutJet
Screaming
SearchmetricsBot
SemrushBot
SEOkicks
SEOkicks-Robot
SEOlyticsCrawler
seoscanners
SEOstats
serpstatbot
sexsearcher
Shodan
Siteimprove
SiteLockSpider
SiteSucker
SmartDownload
Snapbot
Snoopy
Sosospider
SpaceBison
sp_auditbot
Spbot
spyfu
Sucker
Sucuri
SuperHTTP
SurveyBot
Suzuran
T0PHackTeam
tAkeOut
Telesoft
The Intraformant
Thumbor
Toweyabot
Tracemyfile
Trendiction
Trendictionbot
True_Robot
Turnitin
TurnitinBot
UnisterBot
Upflow
URLy.Warning
VeriCiteCrawler
VidibleScraper
Virusdie
VoidEYE
Voltron
WASALive-Bot
Webalta
Web Auto
WebBandit
WEBDAV
WebEnhancer
Web Fuck
WebImageCollector
WebmasterWorldForumBot
Web Sauger
Webshag
WebsiteExtractor
Website Quester
WebSucker
WebWhacker
WebZIP
Whack
Whatweb
WinHTTrack
Wotbox
WWW-Collector-E
WWW-Mechanize
WWWOFFLE
x22Mozilla
Xaldon WebSpider
Xaldon_WebSpider
Xenu
xpymep1.exe
Zade
Zauba
Zermelo
ZumBot