404checker
404enemy
Aboundex
Aboundexbot
Acunetix
AiHitBot
Aipbot
Alexibot
AllSubmitter
AlphaBot
Anarchie
Ankit
Apexoo
arquivo.pt
Asterias
AwarioSmartBot
BackDoorBot
backlink-check
BacklinkCrawler
BackStreet
BackWeb
Badass
BDCbot
BetaBot
Bitacle
Blow
Bolt
Brandprotect
Brandwatch
BuiltWith
BunnySlippers
Calculon
CATExplorador
CCBot
CheeseBot
ChinaClaw
Chlooe
Claritybot
Cogentbot
Cosmos
Craftbot
CrazyWebCrawler
CrunchBot
CSHttp
Custo
CyotekWebCopy
DataCha0s
demandbase-bot
Deusu
Devil
DigitalPebble
Disco
Discoverybot
DittoSpyder
DnyzBot
DomainCrawler
DomainSigmaCrawler
Domains Project
domainsproject.org
Dotbot
DTS Agent
Ebingbong
eCatch
ECCP/1.0
EMail Wolf
EroCrawler
Express WebPictures
ExtractorPro
facebookscraper
Fimap
FlashGet
Fyrebot
GetRight
GetWeb
Gigabot
Gotit
Go!Zilla
GrabNet
GrapeFX
GridBot
HaosouSpider
Harvest
HEADMasterSEO
HTMLparser
IDBot
Id-search
IlseBot
Image Fetch
Image Sucker
instabid
InterGET
Internet Ninja
InternetSeer
ips-agent
IRLbot
IstellaBot
JamesBOT
Jetty
JOC Web Spider
Joomla
Jyxobot
Kinza
LeechFTP
LexiBot
Lftp
LibWeb
Libwhisker
Lightspeedsystems
Likse
LinkextractorPro
LinqiaScrapeBot
Lipperhey
Lmspider
LNSpiderguy
lwp-request
LWP::Simple
Magnet
Mag-Net
magpie-crawler
Majestic12
Majestic-SEO
MarkWatch
Mata Hari
Microsoft Data Access
MJ12bot
Mojeek
Morfeus Fucking Scanner
MSFrontPage
muhstik-scan
Netcraft
netEstate NE Crawler
NetLyzer
NetMechanic
Nettrack
NetZIP
Nibbler
NimbleCrawler
Nimbostratus
Nutch
Octopus
Offline Explorer
OpenLinkProfiler
Openvas
OrangeSpider
OutclicksBot
PageAnalyzer
PageGrabber
PageScorer
Pavuk
pcBrowser
PeoplePal
PictureFinder
Pixray
PleaseCrawl
polaris version
Pump
PxBroker
QueryN Metasearch
RankingBot
RankingBot2
Rankivabot
RankurBot
RealDownload
RebelMouse
RepoMonkey
Ripper
RSSingBot
s1z.ru
SBIder
Scanbot
scan.lol
ScoutJet
Screaming
ScreenerBot
SemrushBot
SEOprofiler
SEOstats
SISTRIX
SiteCheckerBotCrawler
sitechecker.pro
Siteimprove
SiteSnagger
SiteSucker
Sitevigil
SlySearch
SmartDownload
SMTBot
Snoopy
sogouspider
Sosospider
Spammen
Spbot
SputnikBot
Sqlmap
Sqlworm
Sqworm
SuperHTTP
Surfbot
Swiftbot
sysscan
Teleport
Telesphorep
Titan
Tracemyfile
Trendiction
Trendictionbot
Turnitin
Twice
Typhoeus
UnisterBot
Upflow
URLy.Warning
Vacuum
VB Project
VCI
VidibleScraper
Virusdie
VoidEYE
Voil
Wallpapers/3.0
WBSearchBot
WebAuto
Web Auto
WebCopier
WebEnhancer
Web Fetch
WebFuck
WebLeacher
WebmasterWorldForumBot
WebReaper
WebSauger
WebsiteExtractor
WebsiteQuester
Website Quester
WebSucker
WebZIP
WeSEE
Widow
WinHTTrack
Woobot
WPScan
WWW-Mechanize
WWW::Mechanize
Xaldon WebSpider
Xenu
YoudaoBot
Zauba
zauba.io
Zeus
ZyBorg