404checker
AfD-Verbotsverfahren
Alexibot
Alligator
Anarchy
Anarchy99
arquivo.pt
ASPSeek
Asterias
AwarioSmartBot
BacklinkCrawler
BackWeb
Badass
Barkrowler
BatchFTP
BDCbot
BDFetch
Bigfoot
Blackboard
Black Hole
Brandprotect
Brandwatch
Buck
Buddy
BuiltWith
BuzzSumo
Calculon
CCBot
Cegbfeieh
CensysInspect
CheeseBot
CherryPicker
ChinaClaw
Claritybot
Cloud mapping
coccocbot-web
Cocolyzebot
CopyRightCheck
Copyscape
Cosmos
Craftbot
CrazyWebCrawler
Crescent
CSHttp
Curious
CyotekWebCopy
DatabaseDriverMysqli
demandbase-bot
Devil
Disco
DnyzBot
DomainStatsBot
Dragonfly
Drip
ECCP/1.0
Exabot
ExtLinksBot
Extractor
EyeNetIE
Ezooms
FemtosearchBot
FHscan
Firefox/7.0
FlashGet
FrontPage
Fuzz
GalaxyBot
Genieo
Getintent
GetRight
GetWeb
Go!Zilla
GridBot
Harvest
heritrix
HMView
HTTrack
IDBot
IDBTE4M
Id-search
InfoNaviRobot
instabid
InterGET
internetVista monitor
ips-agent
IstellaBot
JamesBOT
JOC Web Spider
Kinza
Lanshanbot
LexiBot
Lftp
Libwhisker
LieBaoFast
Lightspeedsystems
Likse
LinkextractorPro
LinkScan
Lipperhey
Lipperhey Spider
Lmspider
lwp-trivial
magpie-crawler
Mail.RU_Bot
Majestic SEO
MarkMonitor
MarkWatch
Masscan
Mass Downloader
MauiBot
Mb2345Browser
Meanpathbot
MeanPath Bot
mediawords
Metauri
Microsoft Data Access
MIDown tool
Morfeus Fucking Scanner
Mozlila
MQQBrowser
MSIECrawler
Nameprotect
Navroad
netEstate NE Crawler
Net Vampire
NextGenSearchBot
Nibbler
NICErsPRO
Niki-bot
Ninja
Nmap
NPbot
Nutch
oBot
Offline Explorer
Offline Navigator
OnCrawl
Openfind
OutfoxBot
PageAnalyzer
PageThing.com
PECL::HTTP
Petalbot
PHPCrawl
Picsearch
Piepmatz
Pimonster
Pixray
PleaseCrawl
plumanalytics
Pockey
POE-Component-Client-HTTP
polaris version
probe-image-size
Psbot
PyCurl
RankActive
RankFlex
RankingBot2
Rankivabot
RankurBot
Reaper
RebelMouse
Recorder
RepoMonkey
Ripper
ripz
RocketCrawler
Rogerbot
s1z.ru
SalesIntelligent
SBIder
scan.lol
ScoutJet
Scrapy
Searchestate
SearchmetricsBot
SEOkicks-Robot
Seomoz
SEOprofiler
SEOstats
serpstatbot
sexsearcher
Shodan
Siphon
SiteCheckerBotCrawler
SiteLockSpider
SiteSnagger
SlySearch
SMTBot
sogouspider
Sosospider
sp_auditbot
Spbot
Spinn3r
SputnikBot
Sucker
SuperBot
Swiftbot
sysscan
Szukacz
T8Abot
TeleportPro
Telesoft
Telesphorep
Titan
Trendiction
trendiction.com
Turingos
Turnitin
TurnitinBot
TwengaBot
Twice
UnisterBot
Upflow
Virusdie
Wallpapers/3.0
WallpapersHD
WASALive-Bot
Web Auto
WebCollage
Web Collage
WebCopier
WEBDAV
Web Enhancer
Web Fetch
WebFuck
webmeup-crawler
WebPix
Web Sauger
WebsiteQuester
Website Quester
Webster
Web Sucker
Whacker
WISENutbot
WPScan
WWW::Mechanize
WWWOFFLE
x09Mozilla
Xaldon WebSpider
Xenu
Zade
Zauba
zauba.io
Zeus
zgrab
ZmEu
ZoominfoBot
ZyBorg