nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2023-07-16 10:07:28 +00:00

100 lines
1.1 KiB
Text

360Spider
Anarchy99
BackDoorBot
Bitacle
Blackboard
Brandwatch
Buck
Buddy
BuiltBotTough
BuzzSumo
Calculon
CazoodleBot
CheTeam
Cliqzbot
Copier
Crawling at Home Project
Devil
DigitalPebble
DomCopBot
ExtLinksBot
EyeNetIE
FlashGet
Genieo
Grafula
HTMLparser
HTTP::Lite
Hloader
HybridBot
InfoTekies
Intelliseek
Internet Ninja
InternetSeer
Iria
Jbrofuzz
Jetty
Jorgee
Kenjin Spider
LibWeb
LieBaoFast
MIDown tool
Majestic12
MarkMonitor
Masscan
NPbot
Nameprotect
NetZIP
Nettrack
Netvibes
Nikto
Offline Navigator
OrangeSpider
OutclicksBot
PHPCrawl
POE-Component-Client-HTTP
PageAnalyzer
Petalbot
Picscout
PleaseCrawl
Pump
SMTBot
Searchestate
SemrushBot
Site Sucker
SiteCheckerBotCrawler
SiteLockSpider
Sociscraper
Sqlmap
Sqworm
Stripper
Sucker
SuperHTTP
TeleportPro
Turnitin
VidibleScraper
WISENutbot
WWW::Mechanize
WebBandit
WebEnhancer
WebGo IS
Webshag
WebsiteExtractor
Who.is Bot
Zade
ZmEu
check1.exe
clark-crawler
crawler.feedback
eCatch
internetVista monitor
mediawords
oBot
polaris version
probe-image-size
s1z.ru
scalaj-http
seocompany.store
sitechecker.pro
webgains-bot
webmeup-crawler
x09Mozilla