404checker
404enemy
80legs
ADmantX
ALittle Client
ASPSeek
Abonti
Acunetix
AfD-Verbotsverfahren
Aipbot
Ankit
Anthill
Apexoo
Aspiegel
Attach
AwarioSmartBot
BBBike
BDCbot
BDFetch
BackDoorBot
BackStreet
BackWeb
Badass
BatchFTP
Battleztar Bazinga
Bitacle
Blow
Boardreader
Brandprotect
Brandwatch
Bullseye
CCBot
CSHttp
Calculon
CazoodleBot
Cegbfeieh
CherryPicker
ChinaClaw
Chlooe
Cliqzbot
Cloud mapping
Collector
Copyscape
Craftbot
Crawling at Home Project
Curious
DIIbot
Deusu
Dirbuster
Discobot
Discoverybot
Dispatch
DittoSpyder
DnBCrawler-Analytics
DnyzBot
DomCopBot
DomainCrawler
Domains Project
Dotbot
ECCP/1.0
EMail Siphon
EasyDL
Ebingbong
Ecxi
EirGrabber
Evil
Express WebPictures
ExtLinksBot
ExtractorPro
Ezooms
Fimap
Flunky
Foobot
FrontPage
Getintent
Gigabot
Go!Zilla
GoZilla
GrabNet
Grabber
GrapeshotCrawler
HTMLparser
HTTP::Lite
Haansoft
Harvest
HonoluluBot
IDBot
Iblog
Id-search
InfoTekies
InternetSeer
Iria
IstellaBot
JOC Web Spider
JamesBOT
Jetty
Jyxobot
Kenjin Spider
Kinza
LNSpiderguy
Leap
Lftp
Libwhisker
LieBaoFast
LinkScan
Linkdexbot
LinkextractorPro
LinkpadBot
LinksManager
LinqiaMetadataDownloaderBot
Lipperhey
Lmspider
MIIxpc
MJ12bot
MSFrontPage
MSIECrawler
Majestic12
MarkWatch
Mata Hari
Mb2345Browser
Meanpathbot
Microsoft URL Control
Minefield
Mojolicious
Mozlila
Mr.4x3
Nameprotect
Navroad
Nessus
Net Vampire
NetAnts
NetMechanic
Netvibes
Niki-bot
Ninja
Nmap
Nuclei
Offline Explorer
Offline Navigator
OpenVAS
PageScorer
Papa Foto
Pavuk
Petalbot
Pi-Monster
Pimonster
Pixray
PleaseCrawl
Pu_iN
RankingBot
RankingBot2
RankurBot
Re-re
RebelMouse
Recorder
RedesScrapy
SBIder
SEOkicks-Robot
SEOstats
SISTRIX
ScoutJet
Screaming
ScrepyBot
Searchestate
SearchmetricsBot
Seekport
Siphon
Site Sucker
SiteLockSpider
Snoopy
Sosospider
Spinn3r
Sqlmap
Stripper
SuperHTTP
Swiftbot
T8Abot
TeleportPro
Telesoft
Telesphoreo
TightTwatBot
Titan
Toata
Trendiction
True_Robot
Turingos
Turnitin
Twice
Typhoeus
URLy Warning
URLy.Warning
V-BOT
Vacuum
Vagabondo
VidibleScraper
Virusdie
Voil
WASALive-Bot
WEBDAV
WPScan
WWW-Collector-E
Web Auto
Web Collage
WebBandit
WebReaper
WebZIP
Webalta
WebmasterWorldForumBot
WebsiteQuester
Wonderbot
Woobot
Wotbox
Xaldon_WebSpider
Xenu
YoudaoBot
Zermelo
Zeus
ZmEu
archive.org_bot
arquivo.pt
autoemailspider
check1.exe
coccocbot-web
cognitiveseo
crawl.sogou.com
dataforseo.com
gopher
heritrix
ips-agent
isitwp.com
lwp-request
lwp-trivial
magpie-crawler
meanpathbot
mediawords
muhstik-scan
polaris version
s1z.ru
satoristudio.net
scan.lol
seocompany.store
serpstatbot
sogouspider
ubermetrics-technologies.com
voyagerx.com
webgains-bot
webpros.com
x09Mozilla
x22Mozilla
zauba.io