nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2023-08-25 22:05:06 +00:00

100 lines
1.1 KiB
Text

01h4x.com
404enemy
Anthill
AwarioSmartBot
BBBike
BlackWidow
Blow
Boardreader
Bullseye
CensysInspect
CheeseBot
CherryPicker
CopyRightCheck
Craftbot
Demon
DomCopBot
ECCP/1.0
EirGrabber
Express WebPictures
FlashGet
Fuzz
GalaxyBot
GetRight
GetWeb
Getintent
Go-Ahead-Got-It
Grafula
GridBot
HTMLparser
Heritrix
IRLbot
IlseBot
IndeedBot
JikeSpider
Joomla
Jorgee
Keybot Translation-Search-Machine
Kinza
Kozmosbot
Litemage_walker
MTRobot
Majestic12
MicroMessenger
Minefield
Mister PiX
Mojeek
MolokaiBot
Msrabot
Nameprotect
Netvibes
Nibbler
Niki-bot
Nmap
OpenLinkProfiler
OutfoxBot
PECL::HTTP
Petalbot
Picsearch
Pixray
RankFlex
RebelMouse
SMTBot
SalesIntelligent
Scrapy
Searchestate
Siphon
SocialRankIOBot
Spbot
Sqworm
The Intraformant
True_Robot
Turnitin
URLy.Warning
VeriCiteCrawler
VidibleScraper
Virusdie
VoidEYE
Web Enhancer
Web Fetch
Web Pix
WebEnhancer
WebImageCollector
Widow
WinHTTrack
Xaldon_WebSpider
YoudaoBot
Zauba
Zeus
cah.io.community
clark-crawler
crawler.feedback
domainsproject.org
ips-agent
lwp-request
netEstate NE Crawler
oBot
seoscanners
seostar
trendiction.com
xpymep1.exe