404checker
404enemy
80legs
Abonti
Acunetix
ADmantX
AfD-Verbotsverfahren
AIBOT
AllSubmitter
AlphaBot
Apexoo
archive.org_bot
autoemailspider
backlink-check
BackWeb
Badass
Bandit
BetaBot
Bigfoot
Blackboard
BLEXBot
Boardreader
BotALot
Brandprotect
BunnySlippers
BuzzSumo
Calculon
CazoodleBot
CCBot
Cegbfeieh
CheeseBot
CherryPicker
CheTeam
Cliqzbot
Cloud mapping
Cogentbot
cognitiveseo
Copyscape
CrunchBot
CSHttp
Curious
Custo
DBLBot
demandbase-bot
Demon
Digincore
DigitalPebble
DIIbot
Dirbuster
Disco
Dispatch
DnyzBot
DomainCrawler
Dotbot
Dragonfly
Drip
DSearch
DTS Agent
EirGrabber
EMail Siphon
EMail Wolf
Extractor
ExtractorPro
EyeNetIE
Ezooms
facebookscraper
FDM
FHscan
FlashGet
Flunky
Freeuploader
FyberSpider
GalaxyBot
Genieo
GermCrawler
G-i-g-a-b-o-t
Go-Ahead-Got-It
GoZilla
Go!Zilla
GrabNet
Grafula
GrapeFX
GrapeshotCrawler
Haansoft
HaosouSpider
Havij
HMView
HTTrack
Humanlinks
Id-search
IlseBot
InfoNaviRobot
instabid
internetVista monitor
ips-agent
Iria
IRLbot
Jetty
JikeSpider
Jorgee
Jyxobot
Keyword Density
Kozmosbot
Lanshanbot
Libwhisker
Likse
LinkpadBot
LinksManager
LinqiaMetadataDownloaderBot
LinqiaRSSBot
Lipperhey
Lmspider
Ltx71
magpie-crawler
Majestic SEO
Masscan
MauiBot
Meanpathbot
MeanPath Bot
MFC_Tear_Sample
Microsoft URL Control
MIDown tool
MIIxpc
Mister PiX
Mojeek
Morfeus Fucking Scanner
MSIECrawler
Msrabot
muhstik-scan
Name Intelligence
NetAnts
NetMechanic
Net Vampire
NetZIP
NICErsPRO
Nimbostratus
Nutch
oBot
Octopus
Offline Explorer
OnCrawl
OpenLinkProfiler
Openvas
OutfoxBot
Page Analyzer
PageGrabber
page scorer
Pandalytics
Papa Foto
pcBrowser
PeoplePal
Picsearch
Pimonster
Pi-Monster
Pixray
POE-Component-Client-HTTP
ProWebWalker
Psbot
PyCurl
QueryN Metasearch
RankActiveLinkBot
RankFlex
RankingBot2
Rankivabot
Reaper
Recorder
RedesScrapy
Ripper
RocketCrawler
s1z.ru
Scanbot
ScoutJet
ScreenerBot
Searchestate
Semrush
SEOlyticsCrawler
Seomoz
SEOprofiler
Sitebeam
SiteExplorer
SiteLockSpider
SiteSnagger
SiteSucker
SMTBot
Snake
sogouspider
Sosospider
Sottopop
SpaceBison
Spammen
Spanner
sp_auditbot
SputnikBot
Sqlmap
Sqlworm
Stripper
Sucker
SuperBot
Surfbot
T8Abot
tAkeOut
Teleport
TeleportPro
Telesoft
Telesphoreo
The Intraformant
TheNomad
Thumbor
TightTwatBot
Titan
Toweyabot
Tracemyfile
trendiction.com
trendiction.de
TurnitinBot
Twice
Typhoeus
URLy Warning
URLy.Warning
VidibleScraper
Voil
Wallpapers/3.0
WallpapersHD
WBSearchBot
Webalta
WebCollage
WebCopier
WebFetch
Web Fetch
Web Fuck
WebPix
Web Pix
Website Quester
WebStripper
WebWhacker
Who.is Bot
Widow
Woobot
Wprecon
WPScan
WWW-Collector-E
WWWOFFLE
Xaldon WebSpider
Xaldon_WebSpider
YoudaoBot
Zauba
Zeus
Zitebot
ZmEu
ZyBorg