nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2023-08-13 22:05:13 +00:00

100 lines
1.1 KiB
Text

404checker
ADmantX
AIBOT
AdsTxtCrawlerTP
Anarchy99
Attach
AwarioSmartBot
BBBike
BackDoorBot
Blackboard
Brandprotect
BuiltWith
ChinaClaw
Claritybot
Craftbot
CyotekWebCopy
DBLBot
DIIbot
Devil
DigitalPebble
DomCopBot
DomainCrawler
Express WebPictures
FemtosearchBot
Go-Ahead-Got-It
GrabNet
HTTP::Lite
Hloader
IDBTE4M
IstellaBot
JamesBOT
Jbrofuzz
JennyBot
Jorgee
Kenjin Spider
Keyword Density
LNSpiderguy
LexiBot
Lightspeedsystems
Likse
Ltx71
MFC_Tear_Sample
MarkWatch
MeanPath Bot
MicroMessenger
Mister PiX
Morfeus Fucking Scanner
Needle
NetMechanic
NetSpider
Nibbler
Nikto
Nmap
Offline Explorer
OrangeBot
OutclicksBot
PleaseCrawl
Re-re
RealDownload
RepoMonkey
Rogerbot
SEOprofiler
SISTRIX
SMTBot
SeoSiteCheckup
Seomoz
SiteCheckerBotCrawler
Sitevigil
Sogou web spider
Sosospider
SputnikBot
SuperBot
Swiftbot
T8Abot
Telesphoreo
The Intraformant
Titan
Toweyabot
Trendiction
Turnitin
URLy.Warning
Voil
WEBDAV
Web Sucker
WebCopier
WebFuck
WebLeacher
Xaldon_WebSpider
Xenu
Zade
ZyBorg
arquivo-web-crawler
crawler.feedback
dataforseobot
eCatch
instabid
meanpathbot
openai
seocompany.store
siteripz