nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-04-19 10:09:26 +00:00

250 lines
2.6 KiB
Text

Abonti
Acunetix
AfD-Verbotsverfahren
AhrefsBot
AiHitBot
Alligator
AlphaBot
Anarchie
Anarchy
Anthill
Apexoo
Asterias
BDCbot
BackWeb
Badass
Bigfoot
BlackWidow
Blow
BlowFish
Boardreader
Bolt
BuiltWith
Bullseye
BunnySlippers
CODE87
CSHttp
CazoodleBot
CensysInspect
CheTeam
CheeseBot
CherryPicker
Chlooe
Claritybot
Copyscape
Crescent
CyotekWebCopy
DataCha0s
Deusu
Dirbuster
Disco
DittoSpyder
DnyzBot
DomainAppender
DomainSigmaCrawler
DomainStatsBot
Domains Project
EMail Siphon
EasyDL
EroCrawler
Evil
ExtLinksBot
FDM
Flunky
Freeuploader
FrontPage
G-i-g-a-b-o-t
GermCrawler
Gigabot
Go!Zilla
Gotit
GrabNet
Grabber
GrapeshotCrawler
GridBot
HMView
HTMLparser
HTTrack
Haansoft
Havij
Heritrix
Humanlinks
IDBTE4M
Iblog
InfoNaviRobot
Intelliseek
Internet Ninja
InternetSeer
IstellaBot
JOC Web Spider
JamesBOT
JetCar
Jetty
JustView
Keybot Translation-Search-Machine
Keyword Density
LNSpiderguy
LWP::Simple
Lanshanbot
Larbin
LeechFTP
LeechGet
LexiBot
Lftp
LibWeb
LieBaoFast
Likse
LinkScan
Lipperhey Spider
Ltx71
MFC_Tear_Sample
MIDown tool
MSIECrawler
Majestic-SEO
Majestic12
Masscan
Mata Hari
MauiBot
Mb2345Browser
MeanPath Bot
Meanpathbot
MegaIndex.ru
Microsoft URL Control
Mister PiX
MolokaiBot
Mr.4x3
Musobot
Needle
Nessus
NetAnts
NetMechanic
NetZIP
NextGenSearchBot
Nikto
Nmap
Nuclei
Offline Explorer
Offline Navigator
OpenLinkProfiler
OpenVAS
OrangeSpider
OutfoxBot
PECL::HTTP
PHPCrawl
POE-Component-Client-HTTP
PageScorer
Petalbot
Pi-Monster
Picsearch
Pixray
PleaseCrawl
ProPowerBot
Probethenet
PxBroker
RankActiveLinkBot
RealDownload
RebelMouse
Ripper
SBIder
SEOkicks-Robot
SEOlyticsCrawler
SMTBot
SalesIntelligent
Scanbot
ScreenerBot
ScrepyBot
SearchmetricsBot
SemanticJuice
Seomoz
Siphon
SiteCheckerBotCrawler
Sitebeam
SlySearch
SmartDownload
Snapbot
Snoopy
Sociscraper
Sosospider
Sottopop
Spammen
SpankBot
Spanner
Sucuri
SuperBot
SuperHTTP
Surfbot
Suzuran
T8Abot
Telesoft
Telesphoreo
The Intraformant
Thumbor
Toata
Trendictionbot
Turingos
TurnitinBot
Typhoeus
URLy Warning
Upflow
V-BOT
VCI
Virusdie
VoidEYE
Voltron
WASALive-Bot
WBSearchBot
WEBDAV
WISENutbot
WWW-Collector-E
Wallpapers
WallpapersHD
Web Auto
Web Collage
Web Enhancer
Web Sauger
WebImageCollector
WebReaper
WebSauger
WebSucker
WebWhacker
WebsiteQuester
Webster
Whack
Whatweb
Woobot
Wotbox
Xaldon WebSpider
Xaldon_WebSpider
Xenu
YoudaoBot
Zermelo
ZoominfoBot
ZumBot
adscanner
arquivo-web-crawler
check1.exe
clark-crawler
cognitiveseo
crawl.sogou.com
crawler4j
facebookscraper
instabid
isitwp.com
iubenda-radar
linkdexbot
lwp-trivial
magpie-crawler
oBot
pcBrowser
s1z.ru
scalaj-http
seoscanners
seostar
sitechecker.pro
voyagerx.com
webgains-bot
webprosbot
x22Mozilla
xpymep1.exe
zauba.io
zgrab