nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2023-12-10 22:04:48 +00:00

100 lines
1 KiB
Text

ASPSeek
Abonti
Anthill
BDCbot
Backlink-Ceck
Badass
BetaBot
Blow
Bolt
CSHttp
Cegbfeieh
Cliqzbot
Cocolyzebot
Craftbot
DIIbot
DataCha0s
DittoSpyder
DomainStatsBot
Dragonfly
EasyDL
EirGrabber
Fimap
Firefox/7.0
GetRight
HEADMasterSEO
Harvest
Heritrix
IRLbot
IlseBot
Image Sucker
InterGET
IstellaBot
JOC Web Spider
JikeSpider
Kenjin Spider
Kinza
Larbin
Libwhisker
Likse
MSFrontPage
MarkMonitor
Mata Hari
MauiBot
Mb2345Browser
Meanpathbot
Mediatoolkitbot
Microsoft Data Access
Mozlila
Msrabot
NearSite
Nuclei
Offline Explorer
OnCrawl
OrangeSpider
OutfoxBot
Page Analyzer
PageThing.com
PictureFinder
PxBroker
Rainbot
RankingBot
SMTBot
Screaming
Searchestate
SemrushBot
SentiBot
Shodan
SiteLockSpider
Snake
SpankBot
Spanner
SputnikBot
Sqworm
Sucuri
TheNomad
TightTwatBot
Toweyabot
Tracemyfile
Trendictionbot
Turingos
Twice
Voil
WASALive-Bot
WWW-Collector-E
Wallpapers/3.0
Web Enhancer
Web Fetch
WebBandit
WebCopier
WebStripper
Whack
Wotbox
arquivo-web-crawler
crawler.feedback
evc-batch
ips-agent
sitechecker.pro
webgains-bot
webprosbot
x09Mozilla