404checker
80legs
AhrefsBot
AiHitBot
Aipbot
Alexibot
AllSubmitter
Anarchy
Ankit
Apexoo
Aspiegel
Asterias
AwarioRssBot
AwarioSmartBot
BBBike
BLEXBot
BackDoorBot
BackStreet
BackWeb
Barkrowler
Battleztar Bazinga
Boardreader
Buck
BunnySlippers
CATExplorador
CODE87
Calculon
Cegbfeieh
Claritybot
Copyscape
Crescent
CrunchBot
CyotekWebCopy
DBLBot
DIIbot
DSearch
DatabaseDriverMysqli
Demon
Devil
DigitalPebble
Disco
Discobot
Discoverybot
DnBCrawler-Analytics
DomCopBot
DomainAppender
DomainSigmaCrawler
Dotbot
Dragonfly
Drip
ECCP/1.0
EMail Wolf
EasyDL
Ebingbong
EroCrawler
Evil
EyeNetIE
FDM
Firefox/7.0
Foobot
Fuzz
G-i-g-a-b-o-t
GT::WWW
Genieo
Go!Zilla
Go-Ahead-Got-It
Gotit
Grafula
GrapeFX
GridBot
HMView
HTMLparser
HTTrack
Harvest
Hloader
IDBot
Iblog
Id-search
InfoTekies
Intelliseek
InterGET
InternetSeer
Iria
JOC Web Spider
Jbrofuzz
JikeSpider
JustView
Jyxobot
Kenjin Spider
Kinza
Kozmosbot
LNSpiderguy
LWP::Simple
Lanshanbot
LeechGet
Libwhisker
LieBaoFast
Lightspeedsystems
LinkScan
Linkbot
LinqiaRSSBot
Lipperhey
Litemage_walker
MQQBrowser
MSFrontPage
Mag-Net
Magnet
Mail.RU_Bot
Majestic-SEO
MarkWatch
MeanPath Bot
MegaIndex.ru
Metauri
MicroMessenger
Microsoft URL Control
Moblie Safari
Mojeek
MolokaiBot
Mr.4x3
NPbot
Navroad
Needle
NetZIP
Netcraft
Nettrack
Niki-bot
Ninja
Not
Octopus
Offline Explorer
OpenVAS
OutclicksBot
PHPCrawl
Page Analyzer
PageAnalyzer
PageGrabber
Pandalytics
Panscient
PeoplePal
Pi-Monster
Picscout
PictureFinder
Pixray
PleaseCrawl
ProPowerBot
ProWebWalker
Psbot
Quick-Crawler
RankingBot
RankurBot
Re-re
RedesScrapy
RepoMonkey
Rogerbot
SEOkicks
SEOstats
ScanAlert
Scanbot
Screaming
SemanticJuice
SeoSiteCheckup
Shodan
Site Sucker
SiteLockSpider
SiteSnagger
SiteSucker
Sottopop
SpaceBison
Spbot
SputnikBot
Sqlmap
Sqworm
T8Abot
TeleportPro
Telesphorep
The Intraformant
TheNomad
Toata
Trendiction
Trendictionbot
True_Robot
Turingos
Turnitin
URLy Warning
URLy.Warning
Upflow
V-BOT
VCI
Vacuum
Vagabondo
VelenPublicWebCrawler
VeriCiteCrawler
Voil
Voltron
WASALive-Bot
WBSearchBot
WEBDAV
WWWOFFLE
Web Enhancer
Web Fetch
Web Sauger
WebAuto
WebBandit
WebEnhancer
WebGo IS
WebImageCollector
WebReaper
WebStripper
WebZIP
Website Quester
WebsiteExtractor
Whatweb
Who.is Bot
WinHTTrack
Wonderbot
Woobot
Xaldon_WebSpider
Zade
Zauba
ZmEu
ZyBorg
archive.org_bot
arquivo-web-crawler
arquivo.pt
autoemailspider
cah.io.community
coccocbot
com.plumanalytics
evc-batch
gopher
heritrix
ips-agent
iubenda-radar
linkdexbot
lwp-request
lwp-trivial
muhstik-scan
oBot
pcBrowser
ripz
scan.lol
seoscanners
seostar
serpstatbot
siteripz
spyfu
tAkeOut
webmeup-crawler
webpros.com
xpymep1.exe