nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2024-09-28 22:04:53 +00:00

100 lines
1.1 KiB
Text

01h4x.com
404enemy
ADmantX
AdsTxtCrawlerTP
AhrefsBot
AlphaBot
Ankit
AwarioBot
BDCbot
Backlink-Ceck
Badass
BlackWidow
Blackboard
Buck
BuiltBotTough
BunnySlippers
CazoodleBot
Claritybot
Cocolyzebot
Crawling at Home Project
DTS Agent
Digincore
Discoverybot
Dispatch
DomainStatsBot
ECCP/1.0
EMail Wolf
Express WebPictures
FDM
G-i-g-a-b-o-t
GPTBot
GetWeb
GoZilla
HTTrack
InfoNaviRobot
JamesBOT
JennyBot
JikeSpider
Joomla
Keyword Density
Kinza
LWP::Simple
Mag-Net
Majestic SEO
Majestic-SEO
MarkMonitor
Mojeek
Nibbler
Nmap
Page Analyzer
Piepmatz
Psbot
RankActiveLinkBot
Re-re
SEOkicks-Robot
SMTBot
Screaming
SemrushBot
SentiBot
SenutoBot
SeoSiteCheckup
Seomoz
Siphon
Sitebeam
Sociscraper
SpaceBison
Spider_Bot
SputnikBot
Sucker
TightTwatBot
Twice
URLy.Warning
WPScan
Wallpapers
WebAuto
WebmasterWorldForumBot
Widow
Xaldon WebSpider
Xenu
Zitebot
archive.org_bot
autoemailspider
crawl.sogou.com
dataforseo.com
domainsproject.org
eCatch
gopher
isitwp.com
lwp-request
mediawords
muhstik-scan
page scorer
scan.lol
seobility
seocompany.store
siteripz
sp_auditbot
trendiction.de
voyagerx.com
webprosbot