404checker
404enemy
Abonti
Aboundexbot
Acunetix
AfD-Verbotsverfahren
AIBOT
AiHitBot
Alexibot
AlphaBot
Anarchie
Apexoo
archive.org_bot
ASPSeek
Attach
autoemailspider
Backlink-Ceck
BacklinkCrawler
BackWeb
Badass
Bandit
BatchFTP
BDCbot
BDFetch
Bigfoot
Black Hole
BLEXBot
BotALot
Brandprotect
Brandwatch
Bullseye
BunnySlippers
BuzzSumo
Calculon
CazoodleBot
CCBot
CheTeam
Chlooe
Cliqzbot
cognitiveseo
Craftbot
crawler4j
crawler.feedback
crawl.sogou.com
CrazyWebCrawler
Custo
DatabaseDriverMysqli
demandbase-bot
Demon
Deusu
Digincore
Disco
Dispatch
DittoSpyder
DomainAppender
DomainCrawler
Dotbot
Download Wonder
DTS Agent
ECCP/1.0
EMail Wolf
Extractor
Extreme Picture Finder
FHscan
FlashGet
Flunky
Foobot
Fyrebot
Genieo
GermCrawler
Gigabot
GoZilla
Grabber
GrapeshotCrawler
GridBot
GT::WWW
Haansoft
HaosouSpider
Heritrix
Hloader
HMView
HTTP::Lite
Humanlinks
Image Fetch
IndeedBot
Indy Library
Intelliseek
Internet Ninja
internetVista monitor
ips-agent
Iria
IRLbot
IstellaBot
Jbrofuzz
JetCar
JustView
Jyxobot
Kenjin Spider
Keyword Density
Larbin
LeechGet
Lightspeedsystems
Likse
Linkdexbot
LinkextractorPro
LinkpadBot
LinksManager
LinkWalker
LinqiaRSSBot
Lipperhey
Lipperhey Spider
Lmspider
LNSpiderguy
Ltx71
lwp-request
LWP::Simple
lwp-trivial
Mag-Net
magpie-crawler
Mail.RU_Bot
Majestic12
Majestic SEO
Majestic-SEO
MarkWatch
Masscan
Mass Downloader
MauiBot
Meanpathbot
Metauri
MIDown tool
MIIxpc
Mister PiX
Mojeek
Mr.4x3
MSFrontPage
muhstik-scan
Navroad
NearSite
NetLyzer
Net Vampire
Niki-bot
Ninja
oBot
Offline Explorer
Offline Navigator
OnCrawl
OpenLinkProfiler
Openvas
OpenVAS
OutclicksBot
PageAnalyzer
Panscient
Papa Foto
PeoplePal
PHPCrawl
Picscout
Pimonster
plumanalytics
POE-Component-Client-HTTP
Probethenet
Psbot
Quick-Crawler
RankActive
RankFlex
RankingBot
Rankivabot
RankurBot
Reaper
Recorder
RepoMonkey
Ripper
SBIder
ScanAlert
scan.lol
Scrapy
Screaming
ScreenerBot
Searchestate
Semrush
SemrushBot
SEOkicks-Robot
SEOstats
sexsearcher
Siphon
SiteExplorer
Site Sucker
SlySearch
Snake
sogouspider
Sogou web spider
SpaceBison
Spanner
sp_auditbot
Spinn3r
spyfu
Sqlmap
Sqworm
Sucker
Sucuri
SurveyBot
sysscan
Szukacz
T8Abot
tAkeOut
Telesphoreo
Thumbor
Toweyabot
Trendiction
Trendictionbot
TurnitinBot
Typhoeus
Upflow
VCI
VidibleScraper
Virusdie
VoidEYE
Voltron
WallpapersHD
WBSearchBot
Webalta
WebCollage
WEBDAV
WebEnhancer
Web Fuck
WebLeacher
WebmasterWorldForumBot
WebReaper
Web Sauger
Webshag
WebsiteQuester
Webster
WebWhacker
WebZIP
WeSEE
Who.is Bot
Widow
Woobot
Wotbox
WPScan
x22Mozilla
Xaldon WebSpider
Xaldon_WebSpider
Xenu
YoudaoBot
Zade
zauba.io
Zermelo
zgrab
Zitebot
ZyBorg