nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2023-08-17 10:07:18 +00:00

100 lines
1 KiB
Text

ALittle Client
ASPSeek
Acunetix
AdsTxtCrawlerTP
Anthill
Aspiegel
BDFetch
BacklinkCrawler
Blackboard
BotALot
Brandprotect
Brandwatch
BuiltWith
CATExplorador
Copier
CopyRightCheck
Cosmos
Curious
DBLBot
Demon
Deusu
Disco
DnyzBot
DomainStatsBot
Dotbot
Dragonfly
EMail Wolf
Exabot
FDM
FHscan
Haansoft
Humanlinks
IRLbot
Image Fetch
Iskanie
Kozmosbot
LinkpadBot
Ltx71
Mail.RU_Bot
MauiBot
Meanpathbot
Microsoft URL Control
Moblie Safari
Musobot
Nameprotect
Net Vampire
Niki-bot
Nmap
Offline Explorer
OpenVAS
PageScorer
Pandalytics
Papa Foto
Picscout
PleaseCrawl
ProPowerBot
Pu_iN
PxBroker
QueryN Metasearch
Rankivabot
RedesScrapy
Scanbot
ScoutJet
Shodan
Site Sucker
SiteExplorer
SiteSucker
Snake
Sogou web spider
Sottopop
Spinn3r
The Intraformant
TheNomad
Trendiction
Turnitin
TwengaBot
Typhoeus
Vacuum
WASALive-Bot
WBSearchBot
WWWOFFLE
WebCollage
WebmasterWorldForumBot
Whacker
Who.is Bot
Xaldon WebSpider
Xaldon_WebSpider
Zeus
autoemailspider
dataforseo.com
eCatch
gopher
linkdexbot
lwp-request
plumanalytics
polaris version
scalaj-http
seoscanners
tAkeOut
webpros.com