nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2024-06-14 10:07:18 +00:00

100 lines
1.1 KiB
Text

01h4x.com
404checker
404enemy
AiHitBot
Anarchy
BDFetch
BackStreet
Bigfoot
Black Hole
BotALot
CheeseBot
Chlooe
Cogentbot
CrazyWebCrawler
CrunchBot
DataCha0s
DigitalPebble
DnyzBot
DomCopBot
DomainCrawler
DomainSigmaCrawler
Foobot
Fuzz
GetRight
GoZilla
Gotit
GrapeshotCrawler
Heritrix
HonoluluBot
InfoNaviRobot
Information Security Team InfraSec Scanner
Internet Ninja
Iria
LieBaoFast
Likse
Linkbot
LinkextractorPro
LinkpadBot
LinqiaScrapeBot
Litemage_walker
Mag-Net
MarkMonitor
Metauri
Mojolicious
Name Intelligence
Nimbostratus
OutfoxBot
POE-Component-Client-HTTP
PageScorer
Panscient
Pavuk
PeoplePal
Petalbot
PictureFinder
Pockey
Pu_iN
PxBroker
QueryN Metasearch
Rainbot
RankurBot
Rogerbot
ScreenerBot
Searchestate
Semrush
SemrushBot
SiteExplorer
SiteSucker
Snoopy
Sociscraper
Sosospider
Spinn3r
SputnikBot
Sqlmap
TinyTestBot
Titan
Turnitin
VidibleScraper
Virusdie
WISENutbot
WWW-Collector-E
Wallpapers/3.0
Web Sauger
WebCopier
WebSucker
WebWhacker
Whatweb
Zermelo
Zitebot
cah.io.community
clark-crawler
cohere-ai
gopher
internetVista monitor
meanpathbot
scalaj-http
seoscanners
trendiction.com
voyagerx.com
webmeup-crawler
webpros.com