nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2024-09-18 22:05:06 +00:00

100 lines
1 KiB
Text

ADmantX
AIBOT
Acunetix
AdsTxtCrawlerTP
Alligator
AwarioRssBot
BBBike
BotALot
Buck
CazoodleBot
ChinaClaw
ClaudeBot
Curious
DIIbot
DTS Agent
Deusu
Devil
Discobot
Discoverybot
DnyzBot
Domains Project
Drip
EroCrawler
Evil
Express WebPictures
Flunky
Foobot
Fuzz
FyberSpider
Getintent
Gigabot
Go-Ahead-Got-It
GrabNet
IstellaBot
JetCar
Lanshanbot
MJ12bot
MarkMonitor
Mata Hari
MegaIndex.ru
Microsoft URL Control
Moblie Safari
NICErsPRO
Nessus
NetLyzer
NetZIP
NextGenSearchBot
Nuclei
Openfind
OutclicksBot
PageThing.com
Pandalytics
Picscout
Pimonster
Probethenet
Rainbot
Ripper
SEOprofiler
ScreenerBot
SeobilityBot
Siphon
SiteLockSpider
SiteSucker
Sitebeam
SocialRankIOBot
Sogou web spider
Spbot
Stripper
Telesphorep
TinyTestBot
Trendictionbot
True_Robot
TwengaBot
Typhoeus
URLy.Warning
WWW-Mechanize
WeSEE
WebCopier
WebWhacker
WebsiteQuester
Widow
WinHTTrack
crawler4j
demandbase-bot
domainsproject.org
evc-batch
gopher
internetVista monitor
isitwp.com
iubenda-radar
omgili
page scorer
ripz
s1z.ru
seoscanners
sexsearcher
siteripz
sogouspider
sysscan
xpymep1.exe