nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2025-02-28 10:11:43 +00:00

100 lines
1 KiB
Text

ASPSeek
Anarchy
Asterias
AwarioBot
AwarioRssBot
BackDoorBot
BackWeb
Backlink-Ceck
BatchFTP
BlackWidow
Buddy
BuzzSumo
Bytespider
CensysInspect
CherryPicker
Chlooe
CopyRightCheck
Copyscape
Curious
DTS Agent
DataCha0s
Discoverybot
Domains Project
Drip
Ecxi
EirGrabber
Evil
FlashGet
Fuzz
G-i-g-a-b-o-t
GermCrawler
Gotit
GridBot
HTTP::Lite
Image Sucker
Intelliseek
JamesBOT
Kinza
Lipperhey
Lmspider
MIDown tool
Mag-Net
MarkMonitor
Masscan
Mediatoolkitbot
Microsoft URL Control
Msrabot
Musobot
Name Intelligence
NetZIP
Nettrack
Offline Navigator
PECL::HTTP
PageScorer
ProPowerBot
Pu_iN
Rainbot
RankurBot
SBIder
SEOkicks
SEOprofiler
SEOstats
ScanAlert
Screaming
SeekportBot
SemrushBot-BA
SentiBot
SiteLockSpider
Snake
Spinn3r
SputnikBot
Steeler
Stripper
Toata
Toweyabot
Turnitin
TwengaBot
Twice
VidibleScraper
WASALive-Bot
WeSEE
Web Auto
WebFuck
WebPix
WinHTTrack
Xaldon_WebSpider
archive.org_bot
coccocbot
cohere-ai
com.plumanalytics
heritrix
imagesift.com
linkfluence
magpie-crawler
mediawords
openai.com
page scorer
pcBrowser
seocompany.store
sexsearcher