nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2025-04-26 10:10:58 +00:00

100 lines
1.1 KiB
Text

AwarioSmartBot
BDCbot
BackDoorBot
Backlink-Ceck
Battleztar Bazinga
Buddy
BuiltBotTough
Cliqzbot
Cocolyzebot
Copyscape
DTS Agent
Extractor
FemtosearchBot
Flunky
GetRight
Getintent
GrapeFX
GrapeshotCrawler
HTTrack
Haansoft
HybridBot
InternetSeer
IstellaBot
Jbrofuzz
Jorgee
LWP::Simple
Libwhisker
LinkextractorPro
LinqiaMetadataDownloaderBot
Lmspider
Ltx71
MIIxpc
Majestic12
Mediatoolkitbot
Mojeek
Mojolicious
Mr.4x3
Navroad
Net Vampire
NetAnts
NetLyzer
Netcraft
NimbleCrawler
Nuclei
OutclicksBot
PageScorer
Panscient
Petalbot
QueryN Metasearch
Quick-Crawler
RankFlex
ScrepyBot
SemrushBot-OCOB
SeoSiteCheckup
Site Sucker
SlySearch
Snapbot
Snoopy
Sosospider
SpaceBison
SpankBot
Spider_Bot/3.0
Spinn3r
Sqlmap
Sqworm
T0PHackTeam
TheNomad
Thumbor
Turingos
Vagabondo
VelenPublicWebCrawler
Voil
Voltron
WPScan
WWW-Collector-E
WWWOFFLE
Web Fetch
WebWhacker
WebmasterWorldForumBot
Who.is Bot
Widow
Zeus
ZoominfoBot
ZumBot
arquivo-web-crawler
autoemailspider
cah.io.community
crawler.feedback
crawler4j
instabid
internetVista monitor
meanpathbot
muhstik-scan
openai
openai.com
page scorer
scalaj-http
sogouspider
webprosbot
zauba.io