404checker
404enemy
80legs
AfD-Verbotsverfahren
Alexibot
Alligator
Anarchie
Ankit
Anthill
arquivo-web-crawler
Asterias
BackWeb
Barkrowler
BBBike
BetaBot
BlackWidow
Boardreader
BuiltBotTough
BuiltWith
BunnySlippers
BuzzSumo
Calculon
CazoodleBot
CCBot
check1.exe
ChinaClaw
Chlooe
coccocbot-web
cognitiveseo
Copier
crawler4j
crawl.sogou.com
CrazyWebCrawler
Crescent
Demon
DigitalPebble
Dirbuster
Discobot
Discoverybot
domainsproject.org
DomainStatsBot
EirGrabber
EMail Siphon
EMail Wolf
Evil
Exabot
ExtLinksBot
Extractor
ExtractorPro
Ezooms
FemtosearchBot
Flunky
Freeuploader
Fuzz
Genieo
Getintent
GetWeb
Gigablast
G-i-g-a-b-o-t
Go-Ahead-Got-It
gopher
GrapeshotCrawler
GridBot
Haansoft
HaosouSpider
Havij
heritrix
Heritrix
HMView
HTTP::Lite
Humanlinks
HybridBot
Iblog
IDBTE4M
IlseBot
Image Sucker
Indy Library
InfoNaviRobot
InfoTekies
InterGET
Internet Ninja
internetVista monitor
isitwp.com
Iskanie
JennyBot
JetCar
JikeSpider
JOC Web Spider
Joomla
Jyxobot
Kenjin Spider
Keyword Density
Kinza
Lanshanbot
Larbin
LeechFTP
LexiBot
Libwhisker
LieBaoFast
Lightspeedsystems
Likse
Linkbot
LinkextractorPro
LinkScan
LinksManager
LinqiaRSSBot
LinqiaScrapeBot
Lipperhey
Lipperhey Spider
Litemage_walker
lwp-request
LWP::Simple
Mail.RU_Bot
MarkWatch
MauiBot
Mb2345Browser
Meanpathbot
Mediatoolkitbot
mediawords
Metauri
MicroMessenger
Microsoft Data Access
Microsoft URL Control
MIDown tool
MIIxpc
Mojeek
Morfeus Fucking Scanner
MQQBrowser
Msrabot
Name Intelligence
NetAnts
netEstate NE Crawler
NetSpider
NetZIP
NextGenSearchBot
Niki-bot
Nikto
Nimbostratus
Ninja
Octopus
OPPO A33
OrangeSpider
OutfoxBot
PageAnalyzer
page scorer
PageScorer
Pandalytics
Panscient
Papa Foto
PECL::HTTP
PHPCrawl
Pimonster
Pi-Monster
PleaseCrawl
polaris version
ProPowerBot
ProWebWalker
PxBroker
Quick-Crawler
RankFlex
RankingBot
RankurBot
Reaper
RebelMouse
ReGet
Re-re
Ripper
ripz
SalesIntelligent
satoristudio.net
SBIder
scalaj-http
Scanbot
scan.lol
Searchestate
Semrush
SEOkicks
SEOkicks-Robot
SEOlyticsCrawler
SeoSiteCheckup
sexsearcher
Sitebeam
SiteCheckerBotCrawler
sitechecker.pro
SiteExplorer
SiteLockSpider
SiteSucker
Sitevigil
SlySearch
SmartDownload
Snoopy
SocialRankIOBot
sogouspider
SpaceBison
sp_auditbot
Spinn3r
SputnikBot
spyfu
Stripper
Sucker
Sucuri
sysscan
TightTwatBot
Toata
Toweyabot
True_Robot
Turingos
Turnitin
Typhoeus
Upflow
URLy Warning
Vagabondo
VidibleScraper
VoidEYE
Wallpapers/3.0
WallpapersHD
WBSearchBot
WebCollage
WebCopier
WEBDAV
WebFetch
WebFuck
WebPix
WebSauger
Webshag
WebsiteExtractor
Website Quester
WebStripper
WebSucker
Web Sucker
WebWhacker
WeSEE
Whack
Whacker
Widow
WinHTTrack
WISENutbot
Wonderbot
Wotbox
WPScan
WWW-Collector-E
WWW-Mechanize
WWW::Mechanize
Xaldon_WebSpider
xpymep1.exe
Zauba
Zermelo
zgrab
Zitebot
ZoominfoBot