360Spider
404checker
404enemy
Aboundexbot
Acunetix
AfD-Verbotsverfahren
AhrefsBot
AIBOT
AiHitBot
Alexibot
Alligator
archive.org_bot
arquivo.pt
arquivo-web-crawler
ASPSeek
Asterias
AwarioSmartBot
BackDoorBot
Backlink-Ceck
BackStreet
Badass
Bandit
BDCbot
Bigfoot
Black Hole
BlackWidow
Blow
BlowFish
Boardreader
BuiltWith
Bullseye
BunnySlippers
Calculon
Cegbfeieh
CheeseBot
CheTeam
com.plumanalytics
Copyscape
crawl.sogou.com
CrazyWebCrawler
Curious
DatabaseDriverMysqli
DBLBot
Deusu
DigitalPebble
DIIbot
Disco
Discobot
Dispatch
DittoSpyder
DnyzBot
DomainCrawler
DomainSigmaCrawler
DomainStatsBot
Dotbot
Download Wonder
Dragonfly
Drip
DSearch
EasyDL
Ebingbong
eCatch
Ecxi
EirGrabber
EroCrawler
Extractor
ExtractorPro
EyeNetIE
Ezooms
FemtosearchBot
Flunky
Foobot
Freeuploader
FyberSpider
GermCrawler
Getintent
Go-Ahead-Got-It
GrapeFX
GridBot
Havij
HEADMasterSEO
heritrix
Hloader
HMView
HTMLparser
HTTP::Lite
HybridBot
Iblog
IlseBot
Image Fetch
IndeedBot
InfoTekies
instabid
InternetSeer
internetVista monitor
ips-agent
Iria
JamesBOT
Jbrofuzz
JikeSpider
Joomla
Jorgee
Jyxobot
Kenjin Spider
LeechGet
LexiBot
Libwhisker
LinkextractorPro
LinkScan
LinksManager
LinkWalker
LinqiaMetadataDownloaderBot
Lipperhey
LNSpiderguy
Ltx71
lwp-request
Mag-Net
magpie-crawler
Majestic12
Majestic SEO
Majestic-SEO
MarkMonitor
MeanPath Bot
MegaIndex.ru
Metauri
Msrabot
Musobot
Name Intelligence
Nameprotect
Navroad
NearSite
Needle
Nessus
NetAnts
Netcraft
Nettrack
Netvibes
NICErsPRO
Nimbostratus
Nmap
NPbot
Octopus
OnCrawl
Openfind
OpenVAS
OrangeBot
OrangeSpider
PageAnalyzer
Page Analyzer
PageScorer
Pavuk
PECL::HTTP
PeoplePal
PHPCrawl
Picscout
plumanalytics
ProPowerBot
ProWebWalker
PxBroker
PyCurl
RankActive
RankingBot2
Rankivabot
RankurBot
RealDownload
RebelMouse
Recorder
RedesScrapy
RocketCrawler
RSSingBot
SalesIntelligent
ScanAlert
scan.lol
Scrapy
Screaming
ScreenerBot
Searchestate
SemrushBot
SEOkicks-Robot
SEOprofiler
SEOstats
serpstatbot
Sitebeam
SiteExplorer
Siteimprove
SiteLockSpider
SlySearch
SmartDownload
Snake
sogouspider
Sosospider
Sottopop
Spammen
Spanner
sp_auditbot
Spbot
spyfu
Sqlworm
Stripper
Surfbot
Suzuran
Szukacz
T0PHackTeam
tAkeOut
TeleportPro
Telesphorep
TheNomad
Tracemyfile
trendiction.com
trendiction.de
True_Robot
Turingos
Turnitin
TurnitinBot
Twice
Typhoeus
URLy Warning
Voil
WallpapersHD
WASALive-Bot
WebBandit
WebCopier
WEBDAV
Web Enhancer
Web Fetch
Web Fuck
WebImageCollector
WebmasterWorldForumBot
webmeup-crawler
WebPix
WebReaper
WebSauger
Web Sauger
WebSucker
WebZIP
WeSEE
Whack
Whacker
Who.is Bot
Widow
Wonderbot
Wprecon
x09Mozilla
Xenu
YoudaoBot
Zauba
zgrab
Zitebot
ZumBot
ZyBorg