404checker
AfD-Verbotsverfahren
Anarchy99
Ankit
Anthill
archive.org_bot
arquivo-web-crawler
Aspiegel
Attach
autoemailspider
AwarioSmartBot
BackDoorBot
Badass
Barkrowler
BatchFTP
BBBike
Bigfoot
BLEXBot
Blow
BlowFish
Brandwatch
BuiltBotTough
Bullseye
CCBot
CensysInspect
CheeseBot
ChinaClaw
Cloud mapping
coccocbot-web
Cocolyzebot
CODE87
Cogentbot
cognitiveseo
Collector
Copyscape
Cosmos
Craftbot
crawl.sogou.com
DatabaseDriverMysqli
DBLBot
Demon
Devil
Discobot
Discoverybot
Dispatch
DomainAppender
DomainSigmaCrawler
Domains Project
DomainStatsBot
DomCopBot
Download Wonder
Drip
DSearch
Ecxi
EMail Siphon
EMail Wolf
Evil
Express WebPictures
ExtLinksBot
Extreme Picture Finder
facebookscraper
Fimap
Firefox/7.0
Foobot
Genieo
GermCrawler
Go-Ahead-Got-It
Gotit
GoZilla
Go!Zilla
Grabber
Grafula
GrapeshotCrawler
GridBot
HaosouSpider
Hloader
HMView
HTTP::Lite
HTTrack
HybridBot
IDBot
IDBTE4M
IndeedBot
Indy Library
InfoNaviRobot
InfoTekies
Internet Ninja
internetVista monitor
ips-agent
JennyBot
JetCar
Jetty
JikeSpider
JOC Web Spider
Joomla
Jorgee
JustView
Kenjin Spider
Kozmosbot
Larbin
LexiBot
Lftp
Libwhisker
LinkpadBot
LinksManager
LinqiaScrapeBot
Lipperhey
Litemage_walker
lwp-request
lwp-trivial
Mag-Net
Majestic12
MarkMonitor
MarkWatch
Masscan
Mass Downloader
Mata Hari
MauiBot
Mb2345Browser
MeanPath Bot
Mediatoolkitbot
mediawords
MegaIndex.ru
Metauri
MicroMessenger
Microsoft Data Access
Microsoft URL Control
Mojeek
Mojolicious
Morfeus Fucking Scanner
Mr.4x3
MTRobot
muhstik-scan
Musobot
Nameprotect
Navroad
NearSite
Nessus
Netcraft
NetLyzer
NetSpider
Niki-bot
Nimbostratus
Nmap
Nuclei
oBot
Octopus
Offline Explorer
OpenLinkProfiler
OpenVAS
OutclicksBot
PageGrabber
page scorer
Panscient
Papa Foto
Pavuk
Picsearch
PictureFinder
Piepmatz
PleaseCrawl
Pockey
Probethenet
ProWebWalker
Pump
QueryN Metasearch
RankingBot2
Rankivabot
Reaper
RebelMouse
Recorder
ReGet
Re-re
Ripper
s1z.ru
SalesIntelligent
Scanbot
ScoutJet
Scrapy
Searchestate
Semrush
SemrushBot
SEOkicks
SEOkicks-Robot
Seomoz
SEOprofiler
SEOstats
sexsearcher
sitechecker.pro
SiteExplorer
SiteLockSpider
siteripz
SiteSucker
SocialRankIOBot
sogouspider
SpaceBison
Spammen
Spanner
sp_auditbot
Sqlmap
Sqlworm
Stripper
Sucker
SurveyBot
T0PHackTeam
T8Abot
tAkeOut
Teleport
TightTwatBot
Toata
Toweyabot
trendiction.de
Turnitin
TwengaBot
Upflow
URLy Warning
URLy.Warning
Vagabondo
VB Project
VelenPublicWebCrawler
VeriCiteCrawler
Voil
Voltron
WallpapersHD
WASALive-Bot
Webalta
WebCollage
WebEnhancer
Web Enhancer
WebFetch
Web Fetch
WebImageCollector
webmeup-crawler
WebPix
WebReaper
WebSauger
Web Sauger
WebsiteQuester
WebWhacker
WebZIP
Whacker
Who.is Bot
WinHTTrack
WISENutbot
Wprecon
WWW-Mechanize
Xaldon WebSpider
Xenu
YoudaoBot
Zauba
zauba.io