nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2024-12-27 10:07:14 +00:00

100 lines
1.1 KiB
Text

AIBOT
Abonti
Aipbot
Alexibot
Anthill
BDCbot
Battleztar Bazinga
Bitacle
BlackWidow
Brandprotect
Brandwatch
Citoid
Claritybot
ClaudeBot
Copier
Cosmos
CrazyWebCrawler
Crescent
CrunchBot
Curious
DSearch
Discoverybot
Dispatch
DittoSpyder
DomainSigmaCrawler
Dotbot
EMail Siphon
ExtractorPro
GT::WWW
GalaxyBot
Genieo
GermCrawler
HEADMasterSEO
HaosouSpider
Havij
InfoTekies
Jorgee
JustView
LNSpiderguy
Lightspeedsystems
Litemage_walker
Mail.RU_Bot
Moblie Safari
Mozlila
Name Intelligence
Nibbler
Offline Explorer
OrangeSpider
PHPCrawl
POE-Component-Client-HTTP
PageThing.com
Panscient
Pixray
Probethenet
Pump
PyCurl
QueryN Metasearch
RankActiveLinkBot
RankingBot2
ReGet
Searchestate
SearchmetricsBot
SeoCherryBot
SiteExplorer
SiteSucker
Spammen
SputnikBot
Sqworm
Swiftbot
Telesoft
TinyTestBot
Turnitin
TurnitinBot
URLy Warning
VCI
WASALive-Bot
WeSEE
Web Sucker
WebAuto
Whatweb
WiseGuys Robot
Woobot
ZmEu
ZyBorg
arquivo-web-crawler
arquivo.pt
autoemailspider
check1.exe
cognitiveseo
cohere-ai
crawler4j
gopher
instabid
ips-agent
isitwp.com
meanpathbot
page scorer
seoscanners
sp_auditbot
ubermetrics-technologies.com