404checker
404enemy
80legs
Aboundex
Acunetix
AhrefsBot
AiHitBot
Aipbot
AlphaBot
Anarchy
Apexoo
AwarioSmartBot
BBBike
BackDoorBot
BackStreet
BackWeb
BacklinkCrawler
Badass
Bandit
Bigfoot
BlackWidow
Blackboard
Brandprotect
Brandwatch
BuiltBotTough
Bullseye
CATExplorador
CODE87
Cegbfeieh
ChinaClaw
Chlooe
Citoid
Claritybot
Cliqzbot
Cocolyzebot
Cogentbot
CopyRightCheck
Copyscape
DSearch
DTS Agent
DatabaseDriverMysqli
Dispatch
DittoSpyder
DnBCrawler-Analytics
Download Wonder
Drip
EMail Wolf
EasyDL
Ebingbong
EirGrabber
Evil
Exabot
ExtractorPro
Extreme Picture Finder
Fimap
FlashGet
Foobot
Fuzz
GT::WWW
Genieo
Getintent
Gigabot
Go-Ahead-Got-It
GoZilla
Grafula
HMView
HTTP::Lite
Heritrix
HonoluluBot
Humanlinks
IDBTE4M
IlseBot
InfoTekies
InterGET
InternetSeer
Iskanie
IstellaBot
JOC Web Spider
Jbrofuzz
JikeSpider
Jorgee
JustView
Jyxobot
Kinza
Kozmosbot
Lanshanbot
LeechGet
Lftp
LieBaoFast
Lightspeedsystems
LinkScan
LinkextractorPro
Lipperhey Spider
Lmspider
MFC_Tear_Sample
MIIxpc
MTRobot
Magnet
Majestic SEO
MarkMonitor
MarkWatch
Mass Downloader
Masscan
Mb2345Browser
Meanpathbot
Mediatoolkitbot
MegaIndex.ru
Microsoft URL Control
Minefield
MolokaiBot
Morfeus Fucking Scanner
Mr.4x3
Musobot
NearSite
Nessus
NetAnts
NetLyzer
Nettrack
NextGenSearchBot
Niki-bot
NimbleCrawler
Nuclei
Offline Explorer
Offline Navigator
OnCrawl
OpenVAS
PHPCrawl
POE-Component-Client-HTTP
Page Analyzer
PageAnalyzer
PageScorer
Papa Foto
Pavuk
Petalbot
PictureFinder
Pockey
ProPowerBot
ProWebWalker
Probethenet
Psbot
PxBroker
RSSingBot
RankActive
RankurBot
ReGet
Reaper
Recorder
SBIder
SEOkicks
SEOstats
Scanbot
Scrapy
ScreenerBot
ScrepyBot
SearchmetricsBot
Seekport
Semrush
SentiBot
SeoSiteCheckup
Shodan
SiteExplorer
SiteSnagger
SiteSucker
Siteimprove
Sitevigil
SmartDownload
Snake
Snapbot
SocialRankIOBot
Sogou web spider
Spanner
Spinn3r
SputnikBot
Sqlworm
Sucker
Szukacz
T0PHackTeam
TeleportPro
Telesphoreo
Telesphorep
Toweyabot
Trendiction
Trendictionbot
Turnitin
Twice
Typhoeus
URLy Warning
UnisterBot
V-BOT
VB Project
VCI
Vagabondo
VelenPublicWebCrawler
Voil
WBSearchBot
WEBDAV
WISENutbot
WPScan
WWW::Mechanize
WWWOFFLE
Wallpapers
WallpapersHD
Web Auto
Web Fuck
Web Sucker
WebBandit
WebCopier
WebEnhancer
WebFetch
WebImageCollector
WebReaper
WebStripper
WebSucker
WebZIP
Webalta
Wotbox
Xaldon_WebSpider
Xenu
ZyBorg
adscanner
arquivo.pt
check1.exe
coccocbot
cognitiveseo
crawler4j
domainsproject.org
instabid
linkdexbot
lwp-request
lwp-trivial
meanpathbot
netEstate NE Crawler
oBot
polaris version
s1z.ru
satoristudio.net
seobility
seoscanners
sexsearcher
sitechecker.pro
spyfu
tAkeOut
trendiction.com
trendiction.de
voyagerx.com
webgains-bot
webprosbot
x09Mozilla
zauba.io
zgrab