nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2025-04-28 10:47:16 +00:00

100 lines
1 KiB
Text

404checker
404enemy
ADmantX
ASPSeek
Aboundex
Anarchy99
Ankit
AwarioRssBot
BDCbot
BLEXBot
Black Hole
BlackWidow
Blow
Bytespider
Calculon
Cegbfeieh
CensysInspect
CheeseBot
Chlooe
Cocolyzebot
Crawling at Home Project
Curious
DIIbot
EirGrabber
Extreme Picture Finder
FDM
Fimap
Fuzz
Getintent
Go-Ahead-Got-It
GrabNet
Grabber
HaosouSpider
IDBTE4M
Iskanie
Jetty
Joomla
LeechFTP
LexiBot
Lftp
Lightspeedsystems
LinkWalker
Linkbot
MSFrontPage
MauiBot
Mb2345Browser
Metauri
Microsoft Data Access
Mojeek
Mojolicious
Msrabot
Net Vampire
NetAnts
NetMechanic
NextGenSearchBot
Nibbler
NimbleCrawler
Octopus
Pu_iN
Pump
RankActiveLinkBot
RankingBot
Rankivabot
Recorder
Rogerbot
ScreenerBot
SearchmetricsBot
Seomoz
SiteAuditBot
SiteSucker
SlySearch
Sociscraper
Sogou web spider
SputnikBot
Sqworm
Sucker
Sucuri
TightTwatBot
Trendiction
Trendictionbot
Turingos
VB Project
WASALive-Bot
WPScan
WebEnhancer
Webshag
Website Quester
Widow
Wprecon
Zade
Zitebot
anthropic-ai
cah.io.community
crawler4j
heritrix
magpie-crawler
seostar
sogouspider
webpros.com
zauba.io