404enemy
80legs
Abonti
Aboundexbot
Acunetix
ADmantX
AfD-Verbotsverfahren
AhrefsBot
AIBOT
Alligator
AllSubmitter
Anarchie
Anarchy99
Anthill
Aspiegel
ASPSeek
autoemailspider
AwarioSmartBot
BackDoorBot
Backlink-Ceck
BacklinkCrawler
BackStreet
BackWeb
Battleztar Bazinga
BetaBot
Blackboard
Black Hole
BLEXBot
BotALot
Brandprotect
BuiltWith
BuzzSumo
Calculon
CATExplorador
CazoodleBot
CherryPicker
CheTeam
ChinaClaw
Chlooe
Claritybot
Cogentbot
cognitiveseo
Collector
Copier
CrunchBot
Custo
DatabaseDriverMysqli
DataCha0s
Demon
Deusu
Devil
DigitalPebble
DIIbot
Disco
Discoverybot
Dispatch
DittoSpyder
DnyzBot
DomainStatsBot
Dotbot
Download Wonder
Drip
EasyDL
ECCP/1.0
Ecxi
EirGrabber
EMail Siphon
EMail Wolf
EroCrawler
evc-batch
Evil
ExtractorPro
Extreme Picture Finder
Ezooms
facebookscraper
FemtosearchBot
Flunky
Foobot
Freeuploader
FrontPage
FyberSpider
Fyrebot
GalaxyBot
Genieo
Getintent
GetWeb
Gigabot
Go-Ahead-Got-It
Gotit
Grafula
GrapeshotCrawler
GridBot
GT::WWW
Haansoft
HaosouSpider
Harvest
HEADMasterSEO
heritrix
HTTP::Lite
Iblog
IDBot
Indy Library
InfoNaviRobot
instabid
InterGET
Internet Ninja
Iria
JamesBOT
JetCar
Jetty
JOC Web Spider
Jyxobot
Larbin
LeechFTP
LeechGet
LexiBot
Libwhisker
LieBaoFast
LinkextractorPro
LinkpadBot
LinksManager
LinqiaMetadataDownloaderBot
LinqiaScrapeBot
Lipperhey
Ltx71
lwp-request
lwp-trivial
Magnet
Majestic SEO
MarkMonitor
Mata Hari
MauiBot
Mb2345Browser
MeanPath Bot
Mediatoolkitbot
mediawords
Metauri
Microsoft URL Control
MIDown tool
MIIxpc
Mister PiX
Mojolicious
Morfeus Fucking Scanner
Mr.4x3
Msrabot
Navroad
NearSite
Needle
NetMechanic
Net Vampire
NextGenSearchBot
Nikto
Nmap
oBot
Octopus
Offline Explorer
OnCrawl
OpenVAS
OrangeSpider
Pandalytics
Panscient
Papa Foto
PeoplePal
PHPCrawl
Picscout
Picsearch
Pixray
PleaseCrawl
POE-Component-Client-HTTP
Probethenet
ProWebWalker
PxBroker
QueryN Metasearch
Quick-Crawler
RankActive
RankActiveLinkBot
RealDownload
Recorder
Rogerbot
SBIder
Scanbot
scan.lol
ScoutJet
ScreenerBot
Searchestate
SemrushBot
SEOprofiler
SeoSiteCheckup
sexsearcher
SiteExplorer
Siteimprove
SmartDownload
Snake
Snapbot
Snoopy
Sogou web spider
Sosospider
SpaceBison
Spammen
SpankBot
Stripper
Sucker
SuperBot
SuperHTTP
Surfbot
Suzuran
Swiftbot
sysscan
T8Abot
tAkeOut
Teleport
TeleportPro
TheNomad
Thumbor
Trendictionbot
trendiction.de
True_Robot
Twice
URLy Warning
URLy.Warning
VCI
VeriCiteCrawler
WBSearchBot
WebAuto
WebBandit
Web Collage
WEBDAV
Web Enhancer
WebmasterWorldForumBot
webmeup-crawler
WebsiteQuester
WebStripper
WebSucker
WebWhacker
WeSEE
Whack
Whatweb
Woobot
Wprecon
WWW-Collector-E
x09Mozilla
x22Mozilla
Xenu
Zade
Zauba
Zermelo
Zitebot
ZmEu
ZoominfoBot
ZumBot