404enemy
Aboundex
Aboundexbot
AfD-Verbotsverfahren
AIBOT
AiHitBot
Aipbot
Alligator
AlphaBot
Anarchie
Apexoo
archive.org_bot
Attach
autoemailspider
BackDoorBot
Backlink-Ceck
BackWeb
BBBike
BDCbot
BetaBot
Bigfoot
Blackboard
Blow
BlowFish
Boardreader
Brandprotect
Brandwatch
Buddy
Calculon
CATExplorador
CCBot
CheeseBot
CherryPicker
ChinaClaw
Cloud mapping
Cogentbot
cognitiveseo
Copier
CopyRightCheck
Copyscape
crawler4j
crawler.feedback
crawl.sogou.com
CSHttp
Curious
Custo
demandbase-bot
DigitalPebble
Dirbuster
Disco
Discobot
Dispatch
DomainAppender
DomainCrawler
Dragonfly
Drip
DTS Agent
EasyDL
eCatch
ECCP/1.0
EMail Wolf
EroCrawler
Exabot
Express WebPictures
Extractor
Ezooms
FemtosearchBot
Fimap
FlashGet
FrontPage
FyberSpider
GermCrawler
GetRight
GetWeb
Gigablast
Go-Ahead-Got-It
GoZilla
Go!Zilla
Grabber
GrabNet
Grafula
GrapeshotCrawler
GridBot
Haansoft
HaosouSpider
Harvest
Havij
HEADMasterSEO
Heritrix
HMView
HTMLparser
IDBot
Id-search
IlseBot
Image Fetch
Indy Library
Intelliseek
InterGET
internetVista monitor
ips-agent
IRLbot
Iskanie
IstellaBot
JennyBot
JikeSpider
Jorgee
Jyxobot
Kozmosbot
Lanshanbot
Libwhisker
Lightspeedsystems
LinkpadBot
LinkScan
LinksManager
LinqiaRSSBot
Lipperhey
Litemage_walker
Ltx71
lwp-request
LWP::Simple
lwp-trivial
magpie-crawler
Mail.RU_Bot
MarkMonitor
MarkWatch
Masscan
Mata Hari
mediawords
MegaIndex.ru
Metauri
Microsoft Data Access
MIDown tool
MJ12bot
Morfeus Fucking Scanner
MSFrontPage
Musobot
Name Intelligence
Nameprotect
Nettrack
Net Vampire
NICErsPRO
NimbleCrawler
Nmap
NPbot
oBot
Offline Explorer
Offline Navigator
Openfind
OrangeBot
OutclicksBot
OutfoxBot
Page Analyzer
page scorer
PageScorer
Pandalytics
Panscient
Papa Foto
Pavuk
PECL::HTTP
PeoplePal
PHPCrawl
Picscout
Pimonster
Pixray
PleaseCrawl
plumanalytics
Probethenet
ProPowerBot
Psbot
PyCurl
QueryN Metasearch
RankActive
RankActiveLinkBot
RankFlex
RankingBot2
RankurBot
Reaper
RebelMouse
RedesScrapy
ReGet
RepoMonkey
RocketCrawler
s1z.ru
ScanAlert
Scanbot
scan.lol
ScoutJet
Scrapy
Searchestate
SearchmetricsBot
SEOkicks-Robot
Seomoz
seoscanners
SeoSiteCheckup
serpstatbot
Shodan
Sitevigil
Snapbot
Snoopy
SocialRankIOBot
Sogou web spider
Sottopop
Spanner
Spbot
Spinn3r
SputnikBot
Stripper
Surfbot
Suzuran
tAkeOut
Teleport
Telesoft
Telesphorep
The Intraformant
TightTwatBot
Toweyabot
Tracemyfile
Trendictionbot
trendiction.de
True_Robot
Turnitin
Twice
URLy Warning
URLy.Warning
Vacuum
Vagabondo
Voltron
Webalta
WebAuto
Web Auto
Web Fetch
WebGo IS
WebImageCollector
WebReaper
Web Sucker
WebZIP
WeSEE
Whacker
Widow
WiseGuys Robot
Wotbox
Wprecon
WWW::Mechanize
x09Mozilla
Xenu
Zermelo
zgrab
Zitebot
ZmEu
ZyBorg