nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2024-12-10 22:04:50 +00:00

100 lines
1.1 KiB
Text

80legs
Aboundexbot
Acunetix
AwarioRssBot
BackWeb
BacklinksExtendedBot
Black Hole
BlackWidow
BotALot
Brandprotect
Buck
BunnySlippers
CCBot
CODE87
ChatGPT-User
CheTeam
Curious
CyotekWebCopy
DSearch
DomainAppender
Domains Project
Ebingbong
Exabot
Extreme Picture Finder
Freeuploader
IstellaBot
Joomla
Jorgee
Kenjin Spider
Lftp
LinkextractorPro
MFC_Tear_Sample
MIIxpc
MTRobot
Majestic SEO
Mb2345Browser
MeanPath Bot
Meanpathbot
NetMechanic
OutclicksBot
Pandalytics
Petalbot
Picscout
Pixray
PleaseCrawl
Pockey
ProPowerBot
Probethenet
Pump
Quick-Crawler
RankFlex
RankingBot
ReGet
RedesScrapy
SEOkicks-Robot
ScreenerBot
Searchestate
SearchmetricsBot
SeekportBot
SiteLockSpider
SiteSucker
Sitevigil
SmartDownload
SpaceBison
SputnikBot
Sucuri
Swiftbot
Telesphoreo
TheNomad
True_Robot
UnisterBot
VB Project
WASALive-Bot
WPScan
WWW::Mechanize
WWWOFFLE
Web Sucker
WebCopier
WebImageCollector
WebSauger
Webshag
Who.is Bot
Woobot
Wprecon
YoudaoBot
Zade
ZyBorg
arquivo.pt
cah.io.community
dataforseobot
domainsproject.org
everyfeed-spider
imagesift.com
instabid
linkdexbot
probe-image-size
seocompany.store
seoscanners
sogouspider
webgains-bot