360Spider
ASPSeek
AhrefsBot
Alexibot
Aspiegel
AwarioRssBot
BDFetch
BacklinkCrawler
Blackboard
Brandprotect
BunnySlippers
CheTeam
Cocolyzebot
CopyRightCheck
CyotekWebCopy
DTS Agent
Digincore
Dirbuster
DomainSigmaCrawler
DomainStatsBot
Express WebPictures
FemtosearchBot
Fimap
Freeuploader
Go!Zilla
Grafula
HTTrack
Humanlinks
HybridBot
IDBot
Iblog
InfoNaviRobot
Information Security Team InfraSec Scanner
Kozmosbot
Likse
Litemage_walker
MIDown tool
Mata Hari
Microsoft URL Control
Mojolicious
MolokaiBot
Morfeus Fucking Scanner
NICErsPRO
Netvibes
Nikto
NimbleCrawler
Nutch
OnCrawl
OpenVAS
OutclicksBot
PHPCrawl
Pandalytics
ProWebWalker
PxBroker
RankActiveLinkBot
Reaper
Recorder
RedesScrapy
SBIder
SEOlyticsCrawler
SEOprofiler
SEOstats
Scrapy
SemrushBot
SiteSnagger
Sottopop
Spammen
Sqlmap
Sqworm
Szukacz
T8Abot
Tracemyfile
TurnitinBot
Twice
Vagabondo
VoidEYE
WWWOFFLE
Web Fuck
WebFetch
Webshag
Wprecon
Xaldon WebSpider
Xaldon_WebSpider
Xenu
Zade
Zeus
ZmEu
ZoominfoBot
everyfeed-spider
heritrix
instabid
lwp-trivial
plumanalytics
s1z.ru
sexsearcher
sogouspider
trendiction.com
voyagerx.com
webmeup-crawler
x22Mozilla