nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2024-10-18 10:08:47 +00:00

100 lines
1.1 KiB
Text

01h4x.com
Alexibot
Ankit
Anthill
BackDoorBot
BacklinksExtendedBot
Bolt
Bullseye
CATExplorador
CSHttp
CensysInspect
ClaudeBot
Cloud mapping
Craftbot
Digincore
DomainAppender
DomainSigmaCrawler
DomainStatsBot
Download Wonder
Dragonfly
ECCP/1.0
EMail Siphon
Ebingbong
ExtLinksBot
Extractor
Genieo
GetRight
HTMLparser
Humanlinks
InfoNaviRobot
InfoTekies
Intelliseek
InterGET
Iskanie
JetCar
Jetty
LexiBot
LieBaoFast
LinksManager
LinqiaMetadataDownloaderBot
MTRobot
Masscan
Mb2345Browser
Metauri
MicroMessenger
Mojolicious
Msrabot
NPbot
Navroad
NetAnts
NetMechanic
Niki-bot
NimbleCrawler
OutfoxBot
Page Analyzer
PageGrabber
PageScorer
PageThing.com
Papa Foto
Pixray
Probethenet
PyCurl
Quick-Crawler
RSSingBot
Rainbot
RankActiveLinkBot
RankFlex
RankingBot
RankurBot
ReGet
SEOprofiler
ScreenerBot
ScrepyBot
Searchestate
SeoCherryBot
Seomoz
SiteCheckerBotCrawler
Snake
Sottopop
SpaceBison
Spinn3r
TightTwatBot
Turnitin
TwengaBot
VelenPublicWebCrawler
Woobot
Xaldon_WebSpider
anthropic-ai
backlink-check
clark-crawler
crawler.feedback
gopher
heritrix
instabid
mediawords
probe-image-size
ripz
scan.lol
sitechecker.pro
sogouspider