nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2024-02-13 10:06:56 +00:00

100 lines
1 KiB
Text

ADmantX
AIBOT
Ankit
Anthill
AwarioRssBot
BackStreet
Boardreader
Calculon
CazoodleBot
CheeseBot
Cosmos
CrunchBot
Curious
DIIbot
DTS Agent
Digincore
DittoSpyder
DomainAppender
DomainCrawler
Dragonfly
FacebookBot
Fuzz
GetWeb
HEADMasterSEO
Heritrix
InfoNaviRobot
Internet Ninja
JamesBOT
Jetty
Joomla
Jorgee
Kozmosbot
Larbin
Leap
LeechFTP
LieBaoFast
Linkbot
LinkpadBot
Lipperhey Spider
Lmspider
MJ12bot
MarkWatch
Mb2345Browser
NetAnts
NextGenSearchBot
OrangeBot
PageGrabber
PageScorer
Pavuk
Picsearch
QueryN Metasearch
RankActiveLinkBot
RankingBot
Re-re
Reaper
Recorder
SEOprofiler
Scrapy
ScreenerBot
Searchestate
SemanticJuice
Semrush
SeobilityBot
Shodan
Snake
Snapbot
Snoopy
SputnikBot
Sqworm
Sucker
SuperHTTP
Teleport
Telesoft
TheNomad
Tracemyfile
True_Robot
V-BOT
Voil
WWWOFFLE
Web Sucker
WebFuck
WebLeacher
Website Quester
Who.is Bot
Wonderbot
Xaldon_WebSpider
YoudaoBot
crawl.sogou.com
ips-agent
iubenda-radar
magpie-crawler
page scorer
pcBrowser
plumanalytics
polaris version
seobility
sitechecker.pro
spyfu
trendiction.de
xpymep1.exe