nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2023-08-28 22:04:59 +00:00

100 lines
1,003 B
Text

ADmantX
ALittle Client
Acunetix
AhrefsBot
Alexibot
Asterias
AwarioSmartBot
BLEXBot
Backlink-Ceck
BatchFTP
Blow
BuiltWith
CATExplorador
CSHttp
Claritybot
Cogentbot
Custo
Devil
DittoSpyder
Drip
ExtLinksBot
Extractor
Fimap
Fuzz
Gigabot
Gotit
HTMLparser
Iblog
IndeedBot
Iskanie
JennyBot
JustView
LibWeb
LinkScan
MJ12bot
MQQBrowser
Mail.RU_Bot
Mb2345Browser
MicroMessenger
Mojeek
Mojolicious
Nameprotect
NetSpider
NextGenSearchBot
Offline Navigator
OutclicksBot
PECL::HTTP
POE-Component-Client-HTTP
Petalbot
Pi-Monster
Proximic
Pump
RepoMonkey
Ripper
SEOlyticsCrawler
Scanbot
SentiBot
Shodan
Siphon
SiteExplorer
SiteLockSpider
SiteSnagger
Siteimprove
Sottopop
Spanner
Sqworm
Sucuri
T8Abot
Titan
TwengaBot
Typhoeus
Vacuum
Virusdie
VoidEYE
Voil
Web Collage
Web Fuck
WebCopier
WebLeacher
WebSauger
Webshag
Webster
Whacker
Wotbox
YoudaoBot
Zitebot
ZmEu
arquivo.pt
backlink-check
crawl.sogou.com
crawler4j
facebookscraper
polaris version
scan.lol
seobility
seoscanners
sogouspider
tAkeOut
webgains-bot
x09Mozilla