nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2024-02-20 10:07:08 +00:00

100 lines
1 KiB
Text

ADmantX
Alexibot
Apexoo
Aspiegel
Atomseobot
AwarioSmartBot
BDCbot
BackWeb
Badass
Buddy
Cocolyzebot
DIIbot
Dirbuster
DomainAppender
EasyDL
Ebingbong
Express WebPictures
Flunky
GPTBot
GT::WWW
GetRight
Gigabot
GrapeFX
HMView
HTTrack
Harvest
Hloader
HybridBot
Iblog
Image Sucker
InfoNaviRobot
InfoTekies
JustView
Kinza
LexiBot
LinkWalker
LinkextractorPro
LinqiaScrapeBot
Lipperhey
Majestic SEO
Morfeus Fucking Scanner
Nameprotect
Netvibes
Nutch
Octopus
OnCrawl
Openfind
Openvas
Page Analyzer
Pandalytics
Papa Foto
Piepmatz
RankActiveLinkBot
Reaper
RebelMouse
RocketCrawler
SEOkicks-Robot
SearchmetricsBot
SentiBot
SeoSiteCheckup
Shodan
SiteCheckerBotCrawler
Sitevigil
Snake
SpaceBison
SpankBot
Sqlworm
Sqworm
Steeler
SuperBot
SuperHTTP
Thumbor
TurnitinBot
Twice
URLy.Warning
Upflow
VelenPublicWebCrawler
VoidEYE
Voil
WWW-Collector-E
Web Fuck
WebBandit
WebGo IS
WebZIP
Webalta
Website Quester
WebsiteQuester
Wonderbot
Xaldon WebSpider
Xaldon_WebSpider
Zermelo
ZoominfoBot
ZyBorg
adscanner
anthropic-ai
dataforseo.com
page scorer
tAkeOut
trendiction.com
x22Mozilla