404checker
404enemy
80legs
ADmantX
AIBOT
Abonti
Aboundex
AllSubmitter
Alligator
Anarchie
Anarchy
Anarchy99
Anthill
Asterias
Attach
AwarioRssBot
AwarioSmartBot
BBBike
BackStreet
Badass
Barkrowler
BatchFTP
BetaBot
Bigfoot
Blow
Brandprotect
Buddy
BuiltBotTough
BuiltWith
Bullseye
BunnySlippers
Calculon
CensysInspect
CheeseBot
Citoid
Cliqzbot
Cocolyzebot
Copier
CopyRightCheck
Crawling at Home Project
CrazyWebCrawler
Crescent
Curious
DSearch
DatabaseDriverMysqli
Digincore
Disco
DittoSpyder
DnBCrawler-Analytics
DomainAppender
Domains Project
ECCP/1.0
EMail Wolf
EasyDL
EroCrawler
Express WebPictures
Extractor
EyeNetIE
FDM
FHscan
FemtosearchBot
Freeuploader
FrontPage
G-i-g-a-b-o-t
GT::WWW
GetRight
GetWeb
Getintent
Go!Zilla
Go-Ahead-Got-It
Gotit
Grabber
GridBot
HTTrack
HaosouSpider
Havij
Heritrix
Humanlinks
IDBot
IRLbot
Id-search
IlseBot
InfoNaviRobot
Intelliseek
InterGET
Iria
IstellaBot
JOC Web Spider
JamesBOT
JikeSpider
Jorgee
Jyxobot
Kenjin Spider
Kinza
LNSpiderguy
Larbin
LeechGet
Libwhisker
Likse
LinkWalker
LinkpadBot
LinksManager
Lipperhey Spider
Lmspider
Ltx71
MFC_Tear_Sample
MIDown tool
MIIxpc
MSIECrawler
MTRobot
Mag-Net
Magnet
Majestic SEO
Mb2345Browser
Microsoft Data Access
Minefield
Mojolicious
Morfeus Fucking Scanner
Musobot
NPbot
Name Intelligence
NearSite
Needle
NetAnts
Nettrack
Netvibes
NextGenSearchBot
Nibbler
Niki-bot
Ninja
Nmap
Nuclei
Offline Navigator
OpenLinkProfiler
OpenVAS
OrangeBot
OrangeSpider
PHPCrawl
Page Analyzer
Papa Foto
Pavuk
Pi-Monster
PictureFinder
Pixray
Psbot
Pu_iN
Pump
RankingBot
RankingBot2
ReGet
RealDownload
Ripper
SEOkicks
SEOprofiler
SEOstats
SalesIntelligent
ScanAlert
ScreenerBot
Semrush
Siphon
SiteSucker
Sitebeam
SmartDownload
Snake
Snoopy
SocialRankIOBot
Sociscraper
Sogou web spider
Sosospider
SpaceBison
Spinn3r
Sqlmap
Sqworm
Steeler
Sucker
Sucuri
SuperHTTP
Surfbot
Szukacz
T0PHackTeam
T8Abot
TeleportPro
The Intraformant
TheNomad
Thumbor
Titan
Trendiction
TwengaBot
Typhoeus
URLy Warning
UnisterBot
V-BOT
Vacuum
Virusdie
WASALive-Bot
WPScan
WWW-Collector-E
WWW-Mechanize
WWWOFFLE
Wallpapers/3.0
WallpapersHD
WeSEE
Web Enhancer
Web Fuck
WebEnhancer
WebImageCollector
WebSauger
WebSucker
WebZIP
WebmasterWorldForumBot
Website Quester
Webster
Whack
Whacker
Who.is Bot
Widow
Woobot
YoudaoBot
Zade
Zauba
adscanner
archive.org_bot
arquivo.pt
backlink-check
com.plumanalytics
crawler.feedback
demandbase-bot
domainsproject.org
evc-batch
instabid
internetVista monitor
ips-agent
isitwp.com
magpie-crawler
page scorer
pcBrowser
scan.lol
seoscanners
seostar
sogouspider
sysscan
tAkeOut
trendiction.de
ubermetrics-technologies.com
voyagerx.com
webgains-bot
webmeup-crawler
webprosbot
zauba.io
zgrab