360Spider
404checker
ADmantX
AIBOT
ASPSeek
Aboundexbot
Acunetix
AfD-Verbotsverfahren
AhrefsBot
Alexibot
AlphaBot
Anthill
Attach
BDFetch
BackWeb
Bandit
Black Hole
Blackboard
Bolt
Brandwatch
Buck
Buddy
BuiltWith
Bullseye
BunnySlippers
Calculon
CazoodleBot
Cegbfeieh
CensysInspect
CheTeam
CherryPicker
Chlooe
Cliqzbot
Cocolyzebot
Collector
Copier
CopyRightCheck
Copyscape
Cosmos
Craftbot
CrazyWebCrawler
Crescent
CrunchBot
DIIbot
DSearch
DatabaseDriverMysqli
Demon
Dirbuster
Discobot
Discoverybot
Dispatch
DnyzBot
DomainAppender
Download Wonder
Dragonfly
Drip
EMail Wolf
EirGrabber
Exabot
Express WebPictures
ExtractorPro
FDM
Firefox/7.0
FlashGet
Flunky
Foobot
Freeuploader
FrontPage
Fyrebot
GT::WWW
Getintent
Gotit
Grafula
GrapeFX
HTTP::Lite
Harvest
Hloader
IDBot
IRLbot
Iblog
IlseBot
Indy Library
InterGET
Iria
JamesBOT
JetCar
Jetty
JustView
Kenjin Spider
Keyword Density
Kinza
Lanshanbot
Leap
LeechGet
LieBaoFast
Lightspeedsystems
LinkpadBot
LinqiaScrapeBot
Lipperhey Spider
Lmspider
MFC_Tear_Sample
MIIxpc
MSIECrawler
Magnet
Majestic SEO
Majestic-SEO
Mass Downloader
Masscan
MauiBot
MeanPath Bot
Meanpathbot
Metauri
MicroMessenger
Microsoft URL Control
Mister PiX
Moblie Safari
Msrabot
Musobot
NICErsPRO
Navroad
NearSite
NetMechanic
Netcraft
Netvibes
Nibbler
NimbleCrawler
Nimbostratus
Nmap
Octopus
Offline Explorer
Openvas
OrangeSpider
PECL::HTTP
PHPCrawl
POE-Component-Client-HTTP
Page Analyzer
PageScorer
Pandalytics
Panscient
Petalbot
Picsearch
PictureFinder
Pixray
PleaseCrawl
Pockey
Pump
PxBroker
RankFlex
Re-re
Recorder
RocketCrawler
SEOkicks-Robot
SEOlyticsCrawler
SalesIntelligent
ScrepyBot
Searchestate
SentiBot
SeoSiteCheckup
Seomoz
Shodan
Site Sucker
SiteCheckerBotCrawler
SiteLockSpider
Siteimprove
Sitevigil
SlySearch
SmartDownload
Sosospider
SpaceBison
Spammen
SpankBot
Spbot
SputnikBot
Sqlworm
SuperBot
SuperHTTP
Surfbot
Suzuran
T0PHackTeam
TeleportPro
Telesphorep
The Intraformant
TheNomad
Titan
Toweyabot
Tracemyfile
Trendictionbot
True_Robot
TurnitinBot
URLy Warning
URLy.Warning
UnisterBot
Upflow
VelenPublicWebCrawler
VeriCiteCrawler
Virusdie
VoidEYE
WISENutbot
WPScan
WWW-Mechanize
WWWOFFLE
Wallpapers
Wallpapers/3.0
WallpapersHD
Web Collage
Web Pix
WebCollage
WebCopier
WebLeacher
WebSucker
WebZIP
WebmasterWorldForumBot
Webshag
Website Quester
WebsiteExtractor
Webster
Whack
Widow
Woobot
Wotbox
Wprecon
Xenu
YoudaoBot
Zade
Zauba
Zermelo
Zeus
Zitebot
ZoominfoBot
ZyBorg
arquivo-web-crawler
cognitiveseo
dataforseo.com
domainsproject.org
eCatch
gopher
instabid
ips-agent
lwp-trivial
muhstik-scan
polaris version
ripz
s1z.ru
scan.lol
sitechecker.pro
spyfu
trendiction.com
trendiction.de
webprosbot
x22Mozilla