nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2025-04-14 22:08:37 +00:00

100 lines
1.1 KiB
Text

01h4x.com
AIBOT
ALittle Client
ASPSeek
Aboundexbot
AdsTxtCrawlerTP
Alligator
Ankit
Anthill
Aspiegel
Backlink-Ceck
BacklinksExtendedBot
Bigfoot
Bitacle
Brandwatch
Bullseye
BunnySlippers
CSHttp
CazoodleBot
CherryPicker
Cliqzbot
Collector
CrazyWebCrawler
Custo
DIIbot
DSearch
DatabaseDriverMysqli
Domains Project
Ebingbong
Ecxi
Exabot
FyberSpider
GalaxyBot
Gotit
GrabNet
Grafula
HTMLparser
Intelliseek
InternetMeasurement
JamesBOT
JikeSpider
Jorgee
JustView
Keybot Translation-Search-Machine
Keyword Density
Lanshanbot
LeechFTP
LexiBot
LieBaoFast
LinkWalker
Linkbot
Lmspider
Ltx71
Mail.RU_Bot
Majestic12
Mata Hari
MegaIndex.ru
MicroMessenger
Mister PiX
MolokaiBot
NetMechanic
Netcraft
Netvibes
Nutch
OpenLinkProfiler
Pump
RankingBot
RedesScrapy
ScoutJet
ScrepyBot
Searchestate
SemrushBot-FT
SemrushBot-OCOB
Site Sucker
SiteAuditBot
SiteExplorer
SpaceBison
Spammen
SpankBot
Spider_Bot
T0PHackTeam
Telesoft
Titan
Trendictionbot
True_Robot
Turnitin
Voil
Whacker
Zitebot
ZumBot
arquivo.pt
com.plumanalytics
crawler4j
facebookscraper
meanpathbot
omgili
openai
polaris version
tAkeOut
trendiction.de