nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2024-12-13 22:04:46 +00:00

100 lines
1.1 KiB
Text

360Spider
404enemy
80legs
ADmantX
Abonti
BackDoorBot
BacklinksExtendedBot
Bandit
Bigfoot
BlowFish
Bolt
CODE87
Calculon
Crawling at Home Project
DigitalPebble
Dispatch
DittoSpyder
DomainAppender
Dotbot
ECCP/1.0
Ecxi
EroCrawler
Extractor
ExtractorPro
FrontPage
Fuzz
Genieo
GetWeb
Go!Zilla
GrabNet
HMView
Havij
IDBot
IlseBot
Image Sucker
InfoTekies
InfraSec Scanner
InternetSeer
JamesBOT
JikeSpider
JustView
MFC_Tear_Sample
MSIECrawler
Majestic-SEO
Metauri
Microsoft Data Access
Microsoft URL Control
Mozlila
Nameprotect
NetAnts
Nibbler
PHPCrawl
Panscient
Pimonster
Pockey
Probethenet
PyCurl
Rainbot
RankingBot
Re-re
Recorder
RocketCrawler
ScrepyBot
SemrushBot
SeobilityBot
Seomoz
Site Sucker
SiteLockSpider
SmartDownload
Spinn3r
Steeler
SuperHTTP
TheNomad
Turnitin
Vacuum
VeriCiteCrawler
WWWOFFLE
Web Fetch
WebCopier
WebEnhancer
WebFetch
WebImageCollector
WebPix
WebWhacker
WebsiteQuester
Whacker
WiseGuys Robot
ZumBot
anthropic-ai
autoemailspider
com.plumanalytics
dataforseobot
demandbase-bot
lwp-request
magpie-crawler
meanpathbot
openai.com
page scorer
serpstatbot
xpymep1.exe