404enemy
80legs
Aboundex
Aboundexbot
Acunetix
AfD-Verbotsverfahren
AiHitBot
Aipbot
Alexibot
AllSubmitter
Anarchie
arquivo-web-crawler
Asterias
Attach
AwarioRssBot
AwarioSmartBot
BackStreet
Badass
Barkrowler
BatchFTP
BBBike
BetaBot
BLEXBot
Bolt
Buddy
Bullseye
BuzzSumo
Cegbfeieh
check1.exe
CheTeam
ChinaClaw
Chlooe
Claritybot
Cloud mapping
cognitiveseo
Collector
com.plumanalytics
Cosmos
crawler4j
CrazyWebCrawler
Crescent
Custo
CyotekWebCopy
DatabaseDriverMysqli
DBLBot
Demon
DigitalPebble
Dirbuster
Disco
DomainCrawler
DomainSigmaCrawler
Dragonfly
Drip
DSearch
EasyDL
eCatch
ECCP/1.0
Ecxi
EMail Siphon
evc-batch
Exabot
Express WebPictures
Extractor
ExtractorPro
FDM
FHscan
Fimap
Firefox/7.0
Freeuploader
FrontPage
FyberSpider
GalaxyBot
GermCrawler
GetWeb
G-i-g-a-b-o-t
Gotit
GrabNet
Grafula
GrapeFX
HaosouSpider
Hloader
HTTrack
IDBot
IDBTE4M
Id-search
Image Fetch
IndeedBot
Indy Library
instabid
Intelliseek
Internet Ninja
ips-agent
isitwp.com
JennyBot
JetCar
Jetty
JOC Web Spider
Jyxobot
Kinza
Lanshanbot
Larbin
LeechGet
Lftp
LibWeb
Libwhisker
Lightspeedsystems
LinkextractorPro
LinkScan
LinksManager
LinkWalker
LinqiaScrapeBot
Ltx71
Mag-Net
magpie-crawler
Majestic-SEO
MarkMonitor
Mata Hari
Meanpathbot
MegaIndex.ru
Metauri
MFC_Tear_Sample
MicroMessenger
MJ12bot
Mojeek
Mojolicious
Mozlila
MQQBrowser
MSIECrawler
muhstik-scan
Nameprotect
Netcraft
NetLyzer
Net Vampire
Netvibes
NextGenSearchBot
NICErsPRO
Nikto
NimbleCrawler
Nimbostratus
Octopus
Offline Explorer
Offline Navigator
Openfind
Openvas
OpenVAS
OutclicksBot
OutfoxBot
PageAnalyzer
Page Analyzer
page scorer
PageScorer
Panscient
pcBrowser
PHPCrawl
Picscout
Picsearch
PictureFinder
Pixray
Pockey
polaris version
Probethenet
Psbot
PxBroker
PyCurl
RankActive
RankFlex
RankingBot
ReGet
RepoMonkey
Ripper
RocketCrawler
Rogerbot
RSSingBot
s1z.ru
Scrapy
ScreenerBot
Semrush
SemrushBot
SEOkicks-Robot
SEOlyticsCrawler
SEOprofiler
SeoSiteCheckup
SiteSnagger
SlySearch
SMTBot
SocialRankIOBot
Sociscraper
sogouspider
SpaceBison
Spanner
Spbot
Spinn3r
SputnikBot
Sucker
SurveyBot
sysscan
Szukacz
T0PHackTeam
tAkeOut
TeleportPro
TheNomad
Thumbor
Toweyabot
Tracemyfile
Trendictionbot
trendiction.com
trendiction.de
Turingos
Twice
Typhoeus
UnisterBot
URLy Warning
VB Project
VeriCiteCrawler
VidibleScraper
WallpapersHD
WBSearchBot
Webalta
WebAuto
Web Auto
WebCopier
WebFetch
Web Fetch
Web Fuck
WebImageCollector
WebmasterWorldForumBot
WebPix
Web Sauger
WebsiteQuester
WebSucker
Web Sucker
WebWhacker
WebZIP
Whack
Widow
WiseGuys Robot
WISENutbot
Wonderbot
Wotbox
Wprecon
WPScan
WWW-Collector-E
Xaldon_WebSpider
Xenu
xpymep1.exe
Zermelo
zgrab
ZmEu
ZumBot
ZyBorg