nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2024-07-24 15:10:00 +00:00

100 lines
1.1 KiB
Text

Aboundexbot
Apexoo
BacklinkCrawler
Bandit
Battleztar Bazinga
Blow
Bolt
BuiltBotTough
Bullseye
Collector
Copyscape
Crescent
DBLBot
Devil
DomCopBot
DomainCrawler
Ebingbong
EirGrabber
Exabot
Extractor
ExtractorPro
Ezooms
Fimap
GetWeb
Google-Extended
GrapeshotCrawler
HMView
HonoluluBot
IDBTE4M
InfoNaviRobot
Internet Ninja
InternetMeasurement
Jbrofuzz
Jetty
Keybot Translation-Search-Machine
LNSpiderguy
LieBaoFast
LinkWalker
LinkpadBot
LinqiaMetadataDownloaderBot
LinqiaScrapeBot
Lipperhey
MQQBrowser
Mata Hari
Mozlila
Msrabot
NimbleCrawler
Nmap
Nutch
Offline Explorer
POE-Component-Client-HTTP
PageGrabber
Pi-Monster
ProPowerBot
Pu_iN
Quick-Crawler
RSSingBot
RankActiveLinkBot
RepoMonkey
SEOkicks
SEOkicks-Robot
SEOstats
Searchestate
SemanticJuice
SenutoBot
Site Sucker
SiteLockSpider
SlySearch
Spanner
T8Abot
TheNomad
Twice
Voltron
WebPix
WebSauger
WebsiteExtractor
Whack
Widow
WinHTTrack
Xaldon_WebSpider
Zermelo
Zeus
ZyBorg
cohere-ai
crawler.feedback
demandbase-bot
evc-batch
gopher
internetVista monitor
isitwp.com
meanpathbot
openai
s1z.ru
seoscanners
spyfu
ubermetrics-technologies.com
webgains-bot
webpros.com
x09Mozilla
zgrab