nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2024-06-18 10:07:14 +00:00

100 lines
1.1 KiB
Text

AhrefsBot
AllSubmitter
Backlink-Ceck
Bigfoot
Blackboard
Blow
Brandwatch
BuiltBotTough
ChatGPT-User
CheTeam
ChinaClaw
Collector
Crawling at Home Project
Custo
DSearch
DTS Agent
DataCha0s
Deusu
Digincore
Dragonfly
EMail Siphon
EMail Wolf
EasyDL
EirGrabber
Fimap
Freeuploader
FyberSpider
GermCrawler
Getintent
Grabber
Haansoft
Havij
IDBTE4M
IDBot
Id-search
Image Fetch
InfraSec Scanner
InterGET
Internet Ninja
Keyword Density
LinkpadBot
Lipperhey Spider
Ltx71
MIDown tool
MSFrontPage
MTRobot
Magnet
Majestic12
MarkMonitor
MicroMessenger
Microsoft Data Access
Nutch
OrangeBot
OrangeSpider
PageThing.com
Panscient
Pavuk
RankurBot
RealDownload
SEOkicks
SEOprofiler
SalesIntelligent
Seekport
SiteLockSpider
Snapbot
Sqlmap
Sucker
True_Robot
UnisterBot
VelenPublicWebCrawler
Voil
WEBDAV
WWW::Mechanize
Web Auto
Web Fetch
WebFetch
WebReaper
WebStripper
Whack
adscanner
anthropic-ai
backlink-check
check1.exe
crawl.sogou.com
dataforseo.com
dataforseobot
domainsproject.org
heritrix
iubenda-radar
linkdexbot
meanpathbot
muhstik-scan
netEstate NE Crawler
oBot
openai
ripz
s1z.ru
seocompany.store
sogouspider
spyfu