360Spider
404checker
404enemy
80legs
ADmantX
Abonti
Aboundexbot
Acunetix
AiHitBot
AllSubmitter
Alligator
AlphaBot
Anarchie
Anarchy
Anarchy99
Ankit
Anthill
Aspiegel
Attach
BackWeb
BacklinkCrawler
Badass
Bandit
BatchFTP
BlackWidow
Blackboard
BotALot
Buddy
BuiltBotTough
BunnySlippers
CCBot
CODE87
CensysInspect
CheTeam
ChinaClaw
Chlooe
Citoid
Cliqzbot
Cocolyzebot
Collector
Copier
CopyRightCheck
Cosmos
Craftbot
Crawling at Home Project
CrazyWebCrawler
Crescent
Curious
DBLBot
DIIbot
DataCha0s
DatabaseDriverMysqli
Digincore
DomCopBot
DomainSigmaCrawler
Domains Project
Dotbot
Express WebPictures
ExtLinksBot
Extractor
ExtractorPro
EyeNetIE
FlashGet
Fuzz
FyberSpider
Fyrebot
G-i-g-a-b-o-t
GetWeb
Gigabot
Go-Ahead-Got-It
Gotit
HEADMasterSEO
Haansoft
Hloader
HybridBot
IDBTE4M
IDBot
IRLbot
IlseBot
Image Fetch
Image Sucker
IndeedBot
Indy Library
IstellaBot
Jbrofuzz
JennyBot
JetCar
Joomla
Jorgee
Kinza
LWP::Simple
Lanshanbot
Larbin
Leap
LeechGet
Lftp
LieBaoFast
Lightspeedsystems
LinkWalker
Linkdexbot
LinqiaRSSBot
Lipperhey
Lipperhey Spider
MJ12bot
MSFrontPage
MTRobot
Mag-Net
Mail.RU_Bot
MarkMonitor
Masscan
Mata Hari
Meanpathbot
Metauri
Minefield
Mojeek
Mr.4x3
NICErsPRO
Nameprotect
NearSite
Nessus
NetSpider
Netvibes
Nikto
Ninja
Nmap
Nuclei
Nutch
Octopus
OnCrawl
OpenVAS
Openfind
OrangeBot
OrangeSpider
OutclicksBot
PHPCrawl
Page Analyzer
PageAnalyzer
PageGrabber
PageScorer
Pandalytics
Papa Foto
Pavuk
Picsearch
Piepmatz
Pixray
ProPowerBot
Probethenet
Pu_iN
PxBroker
PyCurl
RankFlex
RankingBot2
Rankivabot
RankurBot
Re-re
ReGet
RealDownload
Recorder
RocketCrawler
Rogerbot
SEOkicks-Robot
SEOprofiler
SISTRIX
SalesIntelligent
Scanbot
Scrapy
ScrepyBot
SemrushBot
SiteCheckerBotCrawler
SiteSnagger
SiteSucker
Sitebeam
Snapbot
Snoopy
SocialRankIOBot
Sosospider
Sottopop
Sucker
SuperBot
SuperHTTP
SurveyBot
Swiftbot
Szukacz
T0PHackTeam
TeleportPro
The Intraformant
Toweyabot
Turnitin
TurnitinBot
Twice
URLy.Warning
UnisterBot
VidibleScraper
Voil
WBSearchBot
WEBDAV
WWWOFFLE
Wallpapers/3.0
Web Sauger
Web Sucker
WebBandit
WebFuck
WebGo IS
WebReaper
WebZIP
Webshag
Who.is Bot
Widow
WinHTTrack
WiseGuys Robot
Woobot
Wotbox
Xaldon WebSpider
Xaldon_WebSpider
Xenu
YoudaoBot
Zade
Zauba
ZyBorg
arquivo-web-crawler
arquivo.pt
check1.exe
clark-crawler
coccocbot-web
com.plumanalytics
crawler4j
demandbase-bot
domainsproject.org
gopher
heritrix
instabid
internetVista monitor
isitwp.com
iubenda-radar
netEstate NE Crawler
polaris version
ripz
s1z.ru
scan.lol
seocompany.store
seostar
serpstatbot
siteripz
spyfu
tAkeOut
trendiction.de
x09Mozilla
x22Mozilla
zauba.io
zgrab