404enemy
80legs
AIBOT
Abonti
Acunetix
AfD-Verbotsverfahren
AhrefsBot
AiHitBot
Anarchie
Anarchy99
Anthill
AwarioRssBot
AwarioSmartBot
BDCbot
BDFetch
BackWeb
BacklinkCrawler
Barkrowler
Bigfoot
Bitacle
Blow
Bolt
Brandprotect
Brandwatch
CATExplorador
CCBot
CSHttp
Calculon
ChinaClaw
Chlooe
Claritybot
Cloud mapping
Copyscape
Cosmos
Craftbot
Curious
DBLBot
DIIbot
DSearch
Digincore
DigitalPebble
Discobot
Discoverybot
Dispatch
DnBCrawler-Analytics
EMail Wolf
Ebingbong
EirGrabber
Extreme Picture Finder
Firefox/7.0
FlashGet
FrontPage
FyberSpider
Genieo
Go!Zilla
Grabber
Grafula
GridBot
HEADMasterSEO
HTMLparser
Haansoft
HaosouSpider
Havij
Humanlinks
HybridBot
IlseBot
Image Fetch
Image Sucker
InfoTekies
Intelliseek
InternetSeer
Iria
JOC Web Spider
JennyBot
Jetty
Jyxobot
Kozmosbot
LWP::Simple
Lftp
Likse
Linkbot
LinkpadBot
LinqiaMetadataDownloaderBot
Lmspider
MIIxpc
MJ12bot
MQQBrowser
MSIECrawler
Mail.RU_Bot
Majestic12
MarkMonitor
MarkWatch
Masscan
MauiBot
Mb2345Browser
MeanPath Bot
Meanpathbot
Microsoft Data Access
Mojolicious
Msrabot
Name Intelligence
NearSite
Needle
NetZIP
Nettrack
Netvibes
Nibbler
NimbleCrawler
Ninja
Nutch
Openvas
OrangeBot
OrangeSpider
OutclicksBot
OutfoxBot
PECL::HTTP
Page Analyzer
PageAnalyzer
Papa Foto
Pavuk
PeoplePal
Petalbot
Picscout
PictureFinder
Pimonster
PleaseCrawl
Pockey
ProWebWalker
Pump
PxBroker
QueryN Metasearch
Quick-Crawler
RankActive
RankActiveLinkBot
RankingBot2
Re-re
ReGet
Reaper
RebelMouse
RedesScrapy
SBIder
SEOkicks
SEOlyticsCrawler
SEOprofiler
SEOstats
SMTBot
ScanAlert
Screaming
SearchmetricsBot
Semrush
SemrushBot
SeoSiteCheckup
Shodan
SiteCheckerBotCrawler
SiteExplorer
Sitevigil
SmartDownload
Snoopy
Sogou web spider
SpaceBison
Spammen
SpankBot
Spinn3r
SputnikBot
Sqlmap
Sqworm
Sucker
Sucuri
SuperBot
SuperHTTP
Surfbot
SurveyBot
Suzuran
Swiftbot
Szukacz
Teleport
Telesoft
Telesphorep
TheNomad
Thumbor
Titan
Toweyabot
Trendictionbot
Turingos
TwengaBot
Typhoeus
URLy.Warning
UnisterBot
VB Project
Vagabondo
VelenPublicWebCrawler
WASALive-Bot
WISENutbot
WPScan
WWW::Mechanize
Wallpapers
Wallpapers/3.0
WallpapersHD
Web Auto
Web Collage
Web Fuck
Web Pix
WebCollage
WebCopier
WebImageCollector
WebPix
WebSauger
WebSucker
WebWhacker
WebZIP
WebmasterWorldForumBot
Website Quester
Who.is Bot
Widow
WiseGuys Robot
Woobot
Wotbox
Xenu
YoudaoBot
Zade
Zitebot
ZoominfoBot
ZumBot
arquivo.pt
check1.exe
cognitiveseo
com.plumanalytics
crawl.sogou.com
crawler4j
dataforseo.com
gopher
heritrix
instabid
ips-agent
lwp-trivial
muhstik-scan
oBot
polaris version
ripz
satoristudio.net
scalaj-http
seobility
seostar
serpstatbot
trendiction.de
ubermetrics-technologies.com
webpros.com
webprosbot
x09Mozilla
zgrab