404checker
80legs
ADmantX
AfD-Verbotsverfahren
Alexibot
AllSubmitter
Alligator
Anarchy99
Apexoo
Aspiegel
Asterias
Attach
AwarioSmartBot
BBBike
BDFetch
BackStreet
Backlink-Ceck
BacklinkCrawler
Badass
Bandit
Bitacle
Bolt
Buck
Buddy
CCBot
Calculon
CazoodleBot
Chlooe
Citoid
Cliqzbot
Cloud mapping
Copyscape
Crawling at Home Project
CrazyWebCrawler
Custo
CyotekWebCopy
DSearch
DTS Agent
DatabaseDriverMysqli
Demon
Devil
Digincore
DigitalPebble
Discobot
Dispatch
DittoSpyder
DnyzBot
DomCopBot
DomainAppender
DomainCrawler
DomainSigmaCrawler
Dotbot
Dragonfly
EasyDL
Ebingbong
EroCrawler
ExtLinksBot
ExtractorPro
Extreme Picture Finder
EyeNetIE
Ezooms
FDM
FHscan
Fimap
Foobot
FrontPage
Fuzz
FyberSpider
GalaxyBot
Getintent
Gigabot
Gotit
Grafula
GridBot
HTTrack
Harvest
Hloader
HonoluluBot
IlseBot
Image Sucker
Indy Library
InfoNaviRobot
InfoTekies
Intelliseek
InternetSeer
Iria
IstellaBot
JamesBOT
JennyBot
JetCar
JikeSpider
Joomla
JustView
Jyxobot
Kenjin Spider
Keybot Translation-Search-Machine
Kinza
LNSpiderguy
LWP::Simple
LeechGet
LexiBot
LibWeb
LinkScan
LinkpadBot
Lipperhey
Lipperhey Spider
Lmspider
MIDown tool
MIIxpc
MJ12bot
MQQBrowser
MSFrontPage
Majestic SEO
Majestic-SEO
Masscan
Mata Hari
MeanPath Bot
MegaIndex.ru
Metauri
MicroMessenger
Microsoft URL Control
Minefield
Musobot
NICErsPRO
NPbot
Nameprotect
Navroad
NearSite
NetAnts
NetSpider
NetZIP
Nettrack
NextGenSearchBot
Nibbler
NimbleCrawler
Ninja
Nmap
Not
Octopus
OpenLinkProfiler
OpenVAS
OutclicksBot
OutfoxBot
PHPCrawl
POE-Component-Client-HTTP
PageGrabber
PageThing.com
Panscient
Pi-Monster
Picscout
Picsearch
PictureFinder
Piepmatz
ProPowerBot
ProWebWalker
Probethenet
Pump
Quick-Crawler
RankActive
RankActiveLinkBot
RankFlex
Rankivabot
Recorder
RocketCrawler
SEOlyticsCrawler
SEOprofiler
SEOstats
Scanbot
ScreenerBot
Searchestate
SemanticJuice
SeoSiteCheckup
SeobilityBot
Shodan
SiteCheckerBotCrawler
Sitebeam
Snake
Sottopop
SpankBot
Spbot
Sqlmap
Steeler
Swiftbot
Szukacz
T0PHackTeam
TeleportPro
Telesphorep
The Intraformant
TightTwatBot
Toata
TurnitinBot
TwengaBot
Typhoeus
URLy Warning
Upflow
Vagabondo
VidibleScraper
WBSearchBot
WPScan
WWW-Collector-E
Wallpapers
WallpapersHD
WeSEE
Web Fuck
WebBandit
WebCopier
WebGo IS
WebImageCollector
WebLeacher
WebReaper
WebSauger
WebStripper
WebSucker
WebWhacker
Webalta
WebsiteExtractor
WebsiteQuester
Widow
WiseGuys Robot
Woobot
ZumBot
archive.org_bot
clark-crawler
cognitiveseo
com.plumanalytics
crawler.feedback
eCatch
evc-batch
facebookscraper
gopher
heritrix
instabid
isitwp.com
lwp-request
lwp-trivial
magpie-crawler
meanpathbot
mediawords
muhstik-scan
plumanalytics
ripz
s1z.ru
satoristudio.net
scan.lol
seocompany.store
spyfu
webmeup-crawler
x09Mozilla
zauba.io
zgrab