404checker
404enemy
AIBOT
ALittle Client
Aboundexbot
Acunetix
AhrefsBot
Alexibot
AlphaBot
Ankit
Apexoo
Attach
AwarioRssBot
BDFetch
BackStreet
Barkrowler
Battleztar Bazinga
Bitacle
Black Hole
BlackWidow
Boardreader
Brandprotect
BuiltWith
Bullseye
BunnySlippers
Calculon
CazoodleBot
Cegbfeieh
CheeseBot
Chlooe
Cliqzbot
Cosmos
Crawling at Home Project
CrazyWebCrawler
Curious
Custo
CyotekWebCopy
DIIbot
Demon
Deusu
Devil
Digincore
DigitalPebble
Discobot
DomCopBot
DomainAppender
DomainStatsBot
Dragonfly
ECCP/1.0
Ebingbong
EirGrabber
Exabot
ExtLinksBot
Extreme Picture Finder
EyeNetIE
FDM
FHscan
Flunky
Foobot
Fuzz
G-i-g-a-b-o-t
GT::WWW
GalaxyBot
GetWeb
Getintent
HMView
HTTP::Lite
HaosouSpider
Harvest
Havij
HonoluluBot
Humanlinks
IDBTE4M
IDBot
IRLbot
IlseBot
Image Fetch
InfoTekies
Intelliseek
Internet Ninja
InternetSeer
Iskanie
IstellaBot
JOC Web Spider
Jbrofuzz
JennyBot
Jetty
JikeSpider
JustView
Kenjin Spider
Keyword Density
LWP::Simple
Larbin
Lftp
Libwhisker
Lightspeedsystems
LinkScan
LinkpadBot
LinqiaMetadataDownloaderBot
LinqiaScrapeBot
MFC_Tear_Sample
MJ12bot
Mag-Net
Majestic12
MarkMonitor
Masscan
Mediatoolkitbot
Microsoft URL Control
Minefield
Mister PiX
Mojolicious
MolokaiBot
Mr.4x3
Needle
NetAnts
NetLyzer
NetSpider
NetZIP
Nikto
Nmap
Offline Explorer
OnCrawl
OpenLinkProfiler
PECL::HTTP
PHPCrawl
POE-Component-Client-HTTP
PageGrabber
PageScorer
Papa Foto
Pavuk
Petalbot
Picscout
PictureFinder
Piepmatz
Pimonster
Pixray
QueryN Metasearch
Quick-Crawler
RSSingBot
RankActive
RankActiveLinkBot
RankingBot
RankingBot2
Rankivabot
RebelMouse
Recorder
RocketCrawler
SEOkicks
SEOkicks-Robot
SEOlyticsCrawler
SEOprofiler
SISTRIX
SMTBot
SalesIntelligent
Scanbot
SearchmetricsBot
Seekport
Semrush
SemrushBot
Shodan
SlySearch
Snake
Snapbot
Snoopy
Sociscraper
Spammen
SpankBot
Spbot
Spinn3r
Sqlmap
Sqworm
Stripper
Sucuri
SuperBot
SurveyBot
Suzuran
Szukacz
T0PHackTeam
Telesphorep
Thumbor
Toata
Toweyabot
Tracemyfile
URLy Warning
URLy.Warning
UnisterBot
Upflow
VB Project
Vagabondo
VelenPublicWebCrawler
VeriCiteCrawler
Virusdie
VoidEYE
Voil
WASALive-Bot
WEBDAV
WPScan
WWW::Mechanize
WallpapersHD
Web Auto
Web Sucker
WebCopier
WebFuck
WebGo IS
WebSauger
WebSucker
WebWhacker
WebZIP
Webalta
WebmasterWorldForumBot
Webshag
Website Quester
Whack
Widow
WinHTTrack
Wonderbot
Xenu
YoudaoBot
Zauba
Zeus
Zitebot
ZmEu
ZoomBot
ZyBorg
adscanner
arquivo.pt
check1.exe
com.plumanalytics
dataforseo.com
demandbase-bot
gopher
instabid
linkdexbot
lwp-request
lwp-trivial
magpie-crawler
meanpathbot
pcBrowser
s1z.ru
scan.lol
seoscanners
seostar
sitechecker.pro
sp_auditbot
sysscan
tAkeOut
webprosbot
x09Mozilla
x22Mozilla
zgrab