nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2026-02-14 22:08:32 +00:00

100 lines
1.1 KiB
Text

01h4x.com
404enemy
AIBOT
ALittle Client
Abonti
AfD-Verbotsverfahren
Aipbot
AliyunSecBot
AwarioSmartBot
BackStreet
BacklinkCrawler
Blackboard
ChinaClaw
Chlooe
CopyRightCheck
Crawling at Home Project
Custo
DTS Agent
DataCha0s
DatabaseDriverMysqli
Demon
Dirbuster
Dragonfly
Exabot
FacebookBot
Firefox/7.0
FlashGet
GalaxyBot
GetRight
GoZilla
HaosouSpider
Heritrix
Humanlinks
Image Sucker
IndeedBot
InfoNaviRobot
JetCar
Jorgee
Kozmosbot
LNSpiderguy
LWP::Simple
Libwhisker
LinkpadBot
LinqiaRSSBot
MFC_Tear_Sample
Majestic12
Metauri
Msrabot
Musobot
NICErsPRO
Octopus
OutclicksBot
Page Analyzer
PageScorer
PyCurl
RSSingBot
RankActive
Reaper
RocketCrawler
ScanAlert
ScreenerBot
SeekportBot
SemrushBot
SentiBot
SiteAuditBot
SiteLockSpider
Sitebeam
SocialRankIOBot
Spanner
SplitSignalBot
Teleport
Telesoft
The Intraformant
Titan
Trendiction
Typhoeus
URLy Warning
Upflow
Voil
WallpapersHD
Web Enhancer
WebCollage
WebFetch
WebPix
Website Quester
WebsiteExtractor
Whatweb
Zeus
allenai.org
arquivo-web-crawler
check1.exe
crawler.feedback
dataforseo.com
eCatch
evc-batch
meanpathbot
openai.com
plumanalytics
spyfu
voyagerx.com