404checker
ADmantX
AIBOT
Abonti
AfD-Verbotsverfahren
AhrefsBot
Alexibot
AlphaBot
Anthill
Asterias
AwarioSmartBot
BLEXBot
BackWeb
Badass
Bandit
Black Hole
BlowFish
Bolt
Brandprotect
BunnySlippers
CATExplorador
CCBot
CODE87
Calculon
CazoodleBot
CheeseBot
CherryPicker
ChinaClaw
Cliqzbot
Copier
CopyRightCheck
Copyscape
Craftbot
CrunchBot
Curious
DIIbot
DTS Agent
DataCha0s
DatabaseDriverMysqli
Deusu
Digincore
DigitalPebble
Discobot
Discoverybot
DnyzBot
DomainAppender
DomainCrawler
DomainSigmaCrawler
DomainStatsBot
Dragonfly
Drip
EasyDL
Evil
Exabot
Express WebPictures
FDM
Fimap
Flunky
Foobot
Fuzz
Fyrebot
GalaxyBot
Getintent
Gigablast
Go-Ahead-Got-It
GoZilla
Gotit
GridBot
HEADMasterSEO
HaosouSpider
Harvest
Havij
Hloader
IDBTE4M
Iblog
IndeedBot
Indy Library
InterGET
InternetSeer
JamesBOT
JennyBot
JetCar
Jetty
Joomla
Kenjin Spider
Kinza
Kozmosbot
LNSpiderguy
Larbin
LeechFTP
Lftp
LibWeb
Likse
Linkdexbot
LinkextractorPro
LinqiaScrapeBot
Litemage_walker
Ltx71
MFC_Tear_Sample
MQQBrowser
MSFrontPage
MSIECrawler
MTRobot
Majestic-SEO
Masscan
Mata Hari
MauiBot
MeanPath Bot
Meanpathbot
Mediatoolkitbot
MegaIndex.ru
MicroMessenger
Mojeek
Morfeus Fucking Scanner
NPbot
Nameprotect
Nessus
NetLyzer
NetZIP
Niki-bot
NimbleCrawler
Nimbostratus
Nuclei
Octopus
Offline Navigator
OpenLinkProfiler
Openfind
OrangeBot
PECL::HTTP
PHPCrawl
PageAnalyzer
Papa Foto
Petalbot
Pi-Monster
Pixray
PleaseCrawl
ProPowerBot
ProWebWalker
Probethenet
PxBroker
PyCurl
Quick-Crawler
RankActiveLinkBot
RankFlex
RankingBot2
RankurBot
Reaper
Recorder
RocketCrawler
SEOkicks
SEOprofiler
SEOstats
SISTRIX
SMTBot
Scanbot
Scrapy
ScreenerBot
ScrepyBot
Searchestate
Seomoz
Siphon
Site Sucker
Siteimprove
Sitevigil
Snapbot
Sociscraper
SpaceBison
Spbot
Spinn3r
Sqlworm
Sqworm
Stripper
Sucker
SuperBot
SuperHTTP
SurveyBot
T8Abot
TeleportPro
Telesoft
TheNomad
Thumbor
TightTwatBot
Titan
Trendiction
True_Robot
Turnitin
Twice
Typhoeus
Vacuum
VelenPublicWebCrawler
VeriCiteCrawler
Virusdie
Voil
WASALive-Bot
WBSearchBot
WEBDAV
WISENutbot
WPScan
WWW-Mechanize
WWW::Mechanize
Wallpapers/3.0
Web Fuck
Web Pix
Web Sucker
WebEnhancer
WebFetch
WebImageCollector
WebPix
WebReaper
WebZIP
Webalta
WebmasterWorldForumBot
Webshag
Whacker
Who.is Bot
Widow
Woobot
Wotbox
Xaldon_WebSpider
Zeus
ZoomBot
ZumBot
arquivo.pt
autoemailspider
check1.exe
coccocbot-web
cognitiveseo
com.plumanalytics
crawler4j
facebookscraper
instabid
ips-agent
lwp-trivial
magpie-crawler
probe-image-size
ripz
s1z.ru
satoristudio.net
scan.lol
seoscanners
serpstatbot
siteripz
sogouspider
sysscan
tAkeOut
trendiction.com
voyagerx.com
webmeup-crawler
xpymep1.exe
zgrab