360Spider
404enemy
80legs
AfD-Verbotsverfahren
AhrefsBot
Anarchie
Anarchy99
Apexoo
archive.org_bot
Aspiegel
Asterias
autoemailspider
BackDoorBot
backlink-check
BackStreet
Barkrowler
BDFetch
BetaBot
Bitacle
Black Hole
BlackWidow
Blow
BlowFish
BotALot
Brandwatch
BuzzSumo
CCBot
Cegbfeieh
CensysInspect
CheeseBot
ChinaClaw
Claritybot
Cloud mapping
Cocolyzebot
Copier
crawler.feedback
Crescent
CSHttp
DBLBot
demandbase-bot
Deusu
Digincore
DigitalPebble
DIIbot
Disco
Discobot
DittoSpyder
DomainAppender
DomainCrawler
domainsproject.org
Dragonfly
DSearch
EasyDL
eCatch
Ecxi
EirGrabber
EMail Wolf
EroCrawler
evc-batch
Evil
Extreme Picture Finder
facebookscraper
FemtosearchBot
FHscan
Firefox/7.0
Flunky
Foobot
Fuzz
Fyrebot
Genieo
GermCrawler
Getintent
Gigabot
G-i-g-a-b-o-t
GoZilla
Go!Zilla
GrabNet
Grafula
GrapeFX
Harvest
Heritrix
Hloader
HMView
HTTP::Lite
HTTrack
HybridBot
Iblog
IDBTE4M
Id-search
IlseBot
Image Fetch
Indy Library
InfoNaviRobot
instabid
Intelliseek
InterGET
IRLbot
Iskanie
JamesBOT
JennyBot
JetCar
JOC Web Spider
Joomla
Jorgee
JustView
Kenjin Spider
Kozmosbot
Lanshanbot
LeechFTP
LexiBot
Libwhisker
LieBaoFast
Lightspeedsystems
Linkdexbot
LinksManager
LinkWalker
LinqiaRSSBot
LWP::Simple
lwp-trivial
Magnet
Mag-Net
Majestic-SEO
MarkMonitor
MarkWatch
Mass Downloader
Mb2345Browser
meanpathbot
MegaIndex.ru
Microsoft URL Control
MIIxpc
Mister PiX
MQQBrowser
MSIECrawler
Msrabot
muhstik-scan
Musobot
Nameprotect
Navroad
NetSpider
Netvibes
NetZIP
NimbleCrawler
Nimbostratus
node-fetch
Nutch
Offline Navigator
OpenLinkProfiler
Openvas
OpenVAS
PageAnalyzer
page scorer
Pandalytics
Panscient
Papa Foto
PeoplePal
PHPCrawl
Picscout
Piepmatz
PleaseCrawl
Pockey
Pump
PxBroker
Quick-Crawler
RankActive
RankActiveLinkBot
Rankivabot
RealDownload
RebelMouse
Recorder
RedesScrapy
ReGet
Rogerbot
RSSingBot
SalesIntelligent
satoristudio.net
scalaj-http
ScanAlert
Scanbot
scan.lol
ScoutJet
Screaming
ScreenerBot
SentiBot
SEOkicks
SEOprofiler
SeoSiteCheckup
serpstatbot
Shodan
SISTRIX
Sitebeam
SiteSucker
SMTBot
Snapbot
Sociscraper
Sogou web spider
SpaceBison
Sqlmap
Sqworm
Steeler
Stripper
Sucker
Sucuri
Surfbot
Suzuran
Szukacz
Teleport
TheNomad
Toweyabot
Trendiction
Trendictionbot
trendiction.com
trendiction.de
True_Robot
Turingos
TurnitinBot
TwengaBot
Upflow
Vacuum
VeriCiteCrawler
VoidEYE
Wallpapers/3.0
WallpapersHD
Webalta
Web Auto
WEBDAV
Web Enhancer
WebGo IS
WebImageCollector
WebLeacher
WebsiteExtractor
WebsiteQuester
WebSucker
Web Sucker
WebZIP
Whack
Whacker
Whatweb
Widow
WISENutbot
Wonderbot
Wotbox
x22Mozilla
Xaldon_WebSpider
Xenu
YoudaoBot
Zade
zgrab
ZmEu
ZoomBot
ZumBot