nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2023-04-29 10:07:06 +00:00

100 lines
999 B
Text

360Spider
404enemy
ALittle Client
AhrefsBot
Alligator
Anthill
Apexoo
Badass
Bandit
Black Hole
BlackWidow
BotALot
Buck
CazoodleBot
Crescent
DTS Agent
Demon
DnBCrawler-Analytics
DomCopBot
DomainStatsBot
Domains Project
EMail Wolf
FDM
Flunky
GT::WWW
GalaxyBot
GetWeb
Gotit
Grafula
GridBot
HEADMasterSEO
HTMLparser
HTTrack
HybridBot
IDBot
Jetty
Leap
LinkWalker
LinkextractorPro
LinqiaRSSBot
LinqiaScrapeBot
Lmspider
MQQBrowser
Majestic SEO
Mass Downloader
MauiBot
MicroMessenger
Mojolicious
Net Vampire
NetMechanic
OnCrawl
POE-Component-Client-HTTP
Panscient
PeoplePal
Petalbot
Pimonster
Pu_iN
PyCurl
RedesScrapy
SEOkicks
SMTBot
ScanAlert
SemrushBot
SentiBot
Siteimprove
Snake
Snapbot
Sottopop
Spinn3r
SputnikBot
Sqlworm
Steeler
SurveyBot
Suzuran
T0PHackTeam
Telesphoreo
TightTwatBot
Titan
Toata
Upflow
Vagabondo
VidibleScraper
WPScan
WWWOFFLE
WebFetch
Wotbox
Zade
ZumBot
cognitiveseo
com.plumanalytics
gopher
iubenda-radar
linkdexbot
lwp-trivial
muhstik-scan
ripz
sexsearcher
siteripz
spyfu
webprosbot