nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2024-09-17 10:07:22 +00:00

100 lines
1 KiB
Text

404enemy
Alligator
AlphaBot
AwarioRssBot
Bigfoot
BlackWidow
Brandprotect
Buck
BuiltWith
CODE87
CSHttp
Chlooe
Cogentbot
Collector
Craftbot
Curious
Custo
Demon
DigitalPebble
DittoSpyder
DnyzBot
Extractor
ExtractorPro
FlashGet
G-i-g-a-b-o-t
GT::WWW
Grabber
HTMLparser
HonoluluBot
Humanlinks
IDBTE4M
IlseBot
Image Sucker
Internet Ninja
InternetMeasurement
Iskanie
JennyBot
JikeSpider
Jorgee
LNSpiderguy
Larbin
LeechGet
Lightspeedsystems
LinkScan
Litemage_walker
Lmspider
Ltx71
MIDown tool
Moblie Safari
Nettrack
OpenLinkProfiler
OrangeSpider
OutfoxBot
PHPCrawl
Page Analyzer
Petalbot
PictureFinder
Piepmatz
PleaseCrawl
Pockey
Psbot
Pu_iN
Pump
Ripper
SearchmetricsBot
SentiBot
SiteCheckerBotCrawler
Snake
Sosospider
Sqlmap
Sqlworm
Sqworm
Thumbor
Toata
True_Robot
Turnitin
UnisterBot
Upflow
WWW::Mechanize
Web Collage
WebCollage
Webshag
Website Quester
Webster
Widow
Xenu
Zermelo
adscanner
backlink-check
dataforseo.com
demandbase-bot
domainsproject.org
facebookscraper
linkfluence
meanpathbot
page scorer
sp_auditbot
trendiction.com
ubermetrics-technologies.com
webmeup-crawler