404enemy
80legs
AIBOT
ALittle Client
ASPSeek
AhrefsBot
AiHitBot
Aipbot
Alexibot
Alligator
Anarchie
Anarchy
Anthill
Asterias
Attach
BDFetch
BLEXBot
BackStreet
BacklinkCrawler
Battleztar Bazinga
BetaBot
Black Hole
BotALot
Buck
BuiltBotTough
BunnySlippers
BuzzSumo
CCBot
CODE87
CheTeam
CheeseBot
Chlooe
Claritybot
Cloud mapping
Cocolyzebot
Collector
Copier
Crawling at Home Project
Crescent
DIIbot
DatabaseDriverMysqli
Devil
Digincore
Dirbuster
Disco
Discobot
Discoverybot
Dispatch
DomainAppender
Domains Project
Dotbot
Dragonfly
ECCP/1.0
EMail Siphon
EasyDL
Ecxi
Express WebPictures
Extractor
ExtractorPro
EyeNetIE
Ezooms
FHscan
Firefox/7.0
Flunky
Foobot
Freeuploader
FrontPage
G-i-g-a-b-o-t
GalaxyBot
GetWeb
Getintent
Gigabot
GoZilla
Gotit
GrabNet
GrapeshotCrawler
HMView
HTMLparser
HTTP::Lite
HTTrack
Haansoft
HaosouSpider
Heritrix
HonoluluBot
Humanlinks
HybridBot
IDBot
IlseBot
InfoTekies
Intelliseek
JamesBOT
JennyBot
JetCar
Jetty
Kenjin Spider
Keybot Translation-Search-Machine
Kinza
LNSpiderguy
Lanshanbot
LexiBot
Lftp
LibWeb
LieBaoFast
LinkScan
Linkbot
Linkdexbot
LinksManager
Lipperhey
MFC_Tear_Sample
MIDown tool
MIIxpc
MSFrontPage
Mail.RU_Bot
MarkMonitor
Mata Hari
MeanPath Bot
Mediatoolkitbot
Metauri
Minefield
MolokaiBot
NICErsPRO
NPbot
Name Intelligence
Needle
Net Vampire
NetLyzer
NetMechanic
NetSpider
Netcraft
Nettrack
NextGenSearchBot
Nibbler
Niki-bot
Nimbostratus
Nmap
Not
Nutch
Offline Explorer
Offline Navigator
Panscient
Pavuk
Piepmatz
Pimonster
PleaseCrawl
ProWebWalker
Probethenet
PyCurl
QueryN Metasearch
RankActive
RankActiveLinkBot
RankFlex
Re-re
ReGet
RebelMouse
Rogerbot
SEOkicks
SEOkicks-Robot
SEOlyticsCrawler
SMTBot
Screaming
ScreenerBot
Searchestate
SemanticJuice
Semrush
SeoSiteCheckup
SiteCheckerBotCrawler
SiteExplorer
SiteSucker
Siteimprove
SlySearch
SmartDownload
Sociscraper
Sogou web spider
Sottopop
Spbot
Spinn3r
SputnikBot
Sqlmap
Sqlworm
Stripper
Sucuri
SuperBot
SurveyBot
Szukacz
T0PHackTeam
T8Abot
Thumbor
Titan
Toata
Tracemyfile
Trendictionbot
True_Robot
Twice
VB Project
Vacuum
VelenPublicWebCrawler
VidibleScraper
Voil
WBSearchBot
WEBDAV
WISENutbot
WWWOFFLE
Wallpapers
Web Auto
Web Collage
Web Pix
Web Sauger
WebAuto
WebCollage
WebPix
WebSauger
Website Quester
Webster
Whacker
Who.is Bot
Widow
Wotbox
Xaldon_WebSpider
Xenu
Zeus
Zitebot
ZoomBot
ZyBorg
adscanner
archive.org_bot
arquivo-web-crawler
backlink-check
check1.exe
crawl.sogou.com
crawler.feedback
crawler4j
demandbase-bot
gopher
instabid
iubenda-radar
meanpathbot
mediawords
page scorer
plumanalytics
polaris version
scalaj-http
seocompany.store
serpstatbot
sexsearcher
spyfu
trendiction.de
ubermetrics-technologies.com
voyagerx.com
x09Mozilla
zgrab