nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2025-03-31 22:08:22 +00:00

100 lines
1.1 KiB
Text

404enemy
ADmantX
Abonti
Aboundex
AfD-Verbotsverfahren
Anarchy
BackDoorBot
Backlink-Ceck
BacklinksExtendedBot
Badass
Blackboard
Blow
BuiltBotTough
CCBot
ChatGPT-User
Citoid
CrazyWebCrawler
Custo
DigitalPebble
DnyzBot
DomainCrawler
Ebingbong
ExtLinksBot
Extractor
FemtosearchBot
Freeuploader
FrontPage
FyberSpider
Genieo
GermCrawler
Gigabot
GrabNet
Grabber
Harvest
IndeedBot
Keyword Density
Larbin
LibWeb
Libwhisker
LieBaoFast
LinkWalker
Linkbot
LinkextractorPro
LinqiaScrapeBot
Lipperhey Spider
Majestic-SEO
Mass Downloader
MicroMessenger
Microsoft URL Control
Minefield
Msrabot
Net Vampire
NetAnts
Nikto
Offline Explorer
OpenVAS
PageScorer
Picsearch
Proximic
Pu_iN
PxBroker
Quick-Crawler
RebelMouse
RocketCrawler
SISTRIX
SMTBot
ScanAlert
Scrapy
ScreenerBot
ScrepyBot
Seekport
SentiBot
SeoCherryBot
SeobilityBot
Sitevigil
Sogou web spider
Spbot
SplitSignalBot
TheNomad
Toata
Toweyabot
Trendictionbot
Twice
WebAuto
WebImageCollector
WebPix
WebSucker
Webshag
Whack
Whacker
Xaldon WebSpider
Xaldon_WebSpider
Zauba
com.plumanalytics
crawler.feedback
domainsproject.org
eCatch
iubenda-radar
x09Mozilla
zauba.io