404enemy
80legs
Aboundexbot
Acunetix
AhrefsBot
Aipbot
Ankit
archive.org_bot
arquivo-web-crawler
Aspiegel
Asterias
Attach
autoemailspider
BackDoorBot
Backlink-Ceck
backlink-check
BacklinkCrawler
Barkrowler
BBBike
BDFetch
BetaBot
BLEXBot
BlowFish
Boardreader
Brandprotect
Brandwatch
BunnySlippers
CATExplorador
CazoodleBot
CCBot
Cegbfeieh
Claritybot
Cliqzbot
Collector
com.plumanalytics
CopyRightCheck
crawler4j
CrunchBot
CSHttp
Custo
DatabaseDriverMysqli
demandbase-bot
Demon
Deusu
Devil
DIIbot
Dirbuster
Disco
Discobot
Discoverybot
DnyzBot
DomainCrawler
DomainSigmaCrawler
domainsproject.org
Ebingbong
eCatch
ECCP/1.0
Ecxi
EirGrabber
EMail Siphon
EMail Wolf
EroCrawler
evc-batch
Extractor
FemtosearchBot
Fimap
Flunky
Foobot
Freeuploader
FrontPage
GalaxyBot
Genieo
Getintent
GetWeb
G-i-g-a-b-o-t
Gotit
Grafula
GrapeFX
Harvest
HEADMasterSEO
heritrix
Hloader
HMView
HTMLparser
HTTP::Lite
HTTrack
Iblog
Id-search
IlseBot
ips-agent
Iria
Iskanie
JikeSpider
JustView
Kenjin Spider
Kinza
Lanshanbot
LeechFTP
LeechGet
Lftp
Libwhisker
Lightspeedsystems
Likse
Linkdexbot
LinkextractorPro
LinkpadBot
LinkScan
LinksManager
Lipperhey
LNSpiderguy
Ltx71
lwp-trivial
Mag-Net
Majestic12
Majestic-SEO
Mass Downloader
Mata Hari
Mb2345Browser
MeanPath Bot
Mediatoolkitbot
MegaIndex.ru
Microsoft Data Access
Mister PiX
MJ12bot
Mojolicious
Morfeus Fucking Scanner
MQQBrowser
MSFrontPage
MSIECrawler
Name Intelligence
NearSite
NetAnts
Netcraft
netEstate NE Crawler
NetSpider
Nettrack
Net Vampire
Netvibes
NetZIP
NextGenSearchBot
NICErsPRO
Nikto
NimbleCrawler
Nmap
NPbot
oBot
Octopus
OnCrawl
OpenLinkProfiler
OpenVAS
OrangeBot
OutfoxBot
PageGrabber
page scorer
PageScorer
Pavuk
PECL::HTTP
Picscout
Picsearch
PictureFinder
Pimonster
Pixray
POE-Component-Client-HTTP
ProPowerBot
ProWebWalker
PxBroker
QueryN Metasearch
Quick-Crawler
RankActiveLinkBot
Rankivabot
RankurBot
RebelMouse
RedesScrapy
Ripper
RocketCrawler
Rogerbot
SalesIntelligent
scan.lol
ScoutJet
Scrapy
ScreenerBot
SearchmetricsBot
Semrush
SemrushBot
SEOlyticsCrawler
seoscanners
SEOstats
Shodan
Siphon
SiteSucker
Site Sucker
SMTBot
Snoopy
Sociscraper
sogouspider
Sogou web spider
Spammen
SpankBot
Steeler
Surfbot
SurveyBot
Suzuran
Swiftbot
sysscan
Szukacz
tAkeOut
Teleport
TeleportPro
Telesphoreo
Telesphorep
The Intraformant
TightTwatBot
Toweyabot
Trendictionbot
Turnitin
UnisterBot
URLy Warning
URLy.Warning
VCI
VeriCiteCrawler
VoidEYE
Voil
Voltron
WebBandit
WebCollage
WebCopier
Web Enhancer
WebFetch
Web Fetch
WebFuck
WebmasterWorldForumBot
webmeup-crawler
Web Pix
WebReaper
WebSauger
Web Sauger
WebsiteQuester
Website Quester
WebWhacker
WeSEE
Whack
Woobot
Wotbox
WWW-Collector-E
WWW-Mechanize
xpymep1.exe
zauba.io
ZmEu
ZumBot
ZyBorg