404checker
404enemy
AIBOT
Aipbot
Alexibot
Alligator
AllSubmitter
BackDoorBot
Bandit
Barkrowler
Battleztar Bazinga
BlackWidow
BLEXBot
Blow
BlowFish
Boardreader
Bolt
BuiltBotTough
BuiltWith
Bullseye
BunnySlippers
BuzzSumo
Calculon
CATExplorador
CheTeam
Chlooe
Claritybot
Cliqzbot
Cloud mapping
Collector
com.plumanalytics
CopyRightCheck
Copyscape
Cosmos
crawl.sogou.com
CrazyWebCrawler
Custo
DataCha0s
demandbase-bot
Demon
Deusu
Devil
DigitalPebble
Dirbuster
Disco
DomainCrawler
DomainSigmaCrawler
Dotbot
Download Wonder
Drip
EasyDL
ECCP/1.0
Ecxi
EroCrawler
Exabot
Express WebPictures
ExtLinksBot
Extractor
facebookscraper
Fimap
Foobot
FrontPage
FyberSpider
Fyrebot
Genieo
GermCrawler
Getintent
GetWeb
Go-Ahead-Got-It
GrabNet
Grafula
GridBot
GT::WWW
HaosouSpider
Harvest
Havij
HTTP::Lite
Iblog
IDBot
Image Fetch
Image Sucker
IndeedBot
Indy Library
Internet Ninja
InternetSeer
ips-agent
Iria
IRLbot
IstellaBot
Jbrofuzz
JetCar
Jetty
JOC Web Spider
Joomla
Larbin
LeechFTP
Lftp
Libwhisker
Likse
LinkpadBot
LinqiaScrapeBot
Lipperhey
Lmspider
Magnet
Mag-Net
Majestic-SEO
Masscan
Mata Hari
MeanPath Bot
Mediatoolkitbot
Metauri
Microsoft URL Control
MIDown tool
MIIxpc
Mister PiX
Mojeek
Morfeus Fucking Scanner
MSFrontPage
MSIECrawler
Msrabot
MS Web Services Client Protocol
muhstik-scan
Needle
NetAnts
Netcraft
netEstate NE Crawler
NetLyzer
Nettrack
NetZIP
NextGenSearchBot
NimbleCrawler
Offline Explorer
Openfind
OpenLinkProfiler
Openvas
OrangeSpider
OutclicksBot
Page Analyzer
page scorer
Panscient
pcBrowser
PECL::HTTP
PeoplePal
Picsearch
PictureFinder
Pimonster
Pixray
PleaseCrawl
POE-Component-Client-HTTP
ProPowerBot
PxBroker
PyCurl
QueryN Metasearch
RankActive
RankActiveLinkBot
RankFlex
RankingBot
RankingBot2
Rankivabot
RankurBot
RealDownload
Reaper
Recorder
RedesScrapy
ReGet
RepoMonkey
Ripper
Rogerbot
ScanAlert
scan.lol
ScoutJet
Semrush
SEOkicks
SEOlyticsCrawler
seoscanners
SeoSiteCheckup
sexsearcher
Shodan
Sitebeam
SiteLockSpider
SiteSnagger
SiteSucker
Sitevigil
SlySearch
SmartDownload
SMTBot
Snake
Sociscraper
sogouspider
Sosospider
Sottopop
SpaceBison
SpankBot
Spanner
sp_auditbot
spyfu
Sqworm
Stripper
Sucker
Sucuri
SuperBot
SuperHTTP
Surfbot
Swiftbot
sysscan
Szukacz
T0PHackTeam
T8Abot
tAkeOut
Teleport
TeleportPro
Telesphorep
TheNomad
Thumbor
Titan
Toata
Toweyabot
Tracemyfile
Trendiction
Trendictionbot
TurnitinBot
Twice
UnisterBot
URLy Warning
Vagabondo
VeriCiteCrawler
Voltron
Wallpapers/3.0
WebAuto
Web Auto
WEBDAV
Web Enhancer
WebGo IS
WebLeacher
Webshag
WebsiteExtractor
Website Quester
Webster
WebSucker
Web Sucker
WebZIP
Whatweb
Who.is Bot
WWW-Mechanize
Xaldon_WebSpider
Xenu
YoudaoBot
Zauba
ZmEu
ZumBot