404checker
404enemy
80legs
AIBOT
ASPSeek
Aboundexbot
AfD-Verbotsverfahren
AiHitBot
Aipbot
AllSubmitter
Alligator
Anarchie
Anarchy99
Ankit
Apexoo
Asterias
Atomseobot
BDFetch
BLEXBot
BackDoorBot
BackStreet
Bandit
Bigfoot
BlackWidow
BlowFish
Boardreader
Bolt
BuiltWith
BunnySlippers
CCBot
Calculon
CazoodleBot
Cegbfeieh
CheTeam
Citoid
Cloud mapping
Collector
Cosmos
Crescent
Curious
DBLBot
DataCha0s
Devil
Dirbuster
Discobot
Discoverybot
DnyzBot
DomCopBot
DomainAppender
DomainSigmaCrawler
DomainStatsBot
Domains Project
Download Wonder
Drip
EasyDL
Ebingbong
Evil
Exabot
Extractor
EyeNetIE
FDM
FemtosearchBot
Firefox/7.0
FlashGet
Foobot
Freeuploader
Fuzz
Fyrebot
GermCrawler
GetRight
GetWeb
GrabNet
Grafula
HTTP::Lite
Heritrix
Iblog
Image Sucker
IndeedBot
InfoNaviRobot
Intelliseek
InternetSeer
Iria
Iskanie
Keyword Density
Lanshanbot
LeechFTP
LexiBot
Lftp
LieBaoFast
Linkdexbot
LinkextractorPro
LinkpadBot
Lipperhey Spider
Litemage_walker
MIDown tool
MJ12bot
MSFrontPage
MTRobot
Magnet
Mail.RU_Bot
Majestic SEO
Majestic-SEO
MarkMonitor
Mass Downloader
Mata Hari
MauiBot
Mediatoolkitbot
MegaIndex.ru
MicroMessenger
Microsoft Data Access
Mojeek
Mojolicious
MolokaiBot
Mr.4x3
Nameprotect
Navroad
NearSite
Net Vampire
NetAnts
NetSpider
NetZIP
Nettrack
Netvibes
NextGenSearchBot
Niki-bot
Nikto
Nimbostratus
Ninja
Nmap
Not
Octopus
Offline Explorer
OnCrawl
Openfind
OrangeBot
OrangeSpider
OutfoxBot
Page Analyzer
PageGrabber
PageScorer
Pandalytics
PeoplePal
Piepmatz
Pockey
ProPowerBot
Psbot
Pu_iN
Pump
RSSingBot
RankActive
RankActiveLinkBot
RealDownload
RebelMouse
Recorder
Ripper
RocketCrawler
Rogerbot
SEOlyticsCrawler
SEOprofiler
SalesIntelligent
ScanAlert
Scanbot
Searchestate
SearchmetricsBot
Seekport
SemanticJuice
Semrush
Seomoz
Site Sucker
SiteSucker
Sitebeam
Siteimprove
Sitevigil
Snake
Snapbot
Snoopy
Sociscraper
Sottopop
SpaceBison
SpankBot
Spanner
Spinn3r
SputnikBot
Stripper
Sucker
SuperBot
SuperHTTP
SurveyBot
Suzuran
T0PHackTeam
Teleport
Telesoft
Thumbor
Titan
Tracemyfile
Trendiction
Trendictionbot
True_Robot
Turnitin
TwengaBot
URLy Warning
UnisterBot
V-BOT
VeriCiteCrawler
VoidEYE
WEBDAV
WISENutbot
WPScan
WeSEE
Web Fuck
Web Pix
Web Sucker
WebAuto
WebFuck
WebWhacker
WebsiteExtractor
WebsiteQuester
Webster
Wonderbot
Xaldon_WebSpider
Zade
Zeus
Zitebot
ZumBot
arquivo-web-crawler
check1.exe
crawl.sogou.com
crawler.feedback
crawler4j
dataforseo.com
demandbase-bot
evc-batch
facebookscraper
gopher
heritrix
internetVista monitor
isitwp.com
magpie-crawler
page scorer
ripz
seobility
seoscanners
serpstatbot
sexsearcher
sitechecker.pro
sp_auditbot
webgains-bot
webprosbot
x22Mozilla
zgrab