nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2023-10-09 22:05:05 +00:00

100 lines
1 KiB
Text

Acunetix
AhrefsBot
AllSubmitter
BackDoorBot
Bandit
Black Hole
Cegbfeieh
CheTeam
CheeseBot
CherryPicker
ChinaClaw
Cosmos
Craftbot
DTS Agent
Digincore
DomainStatsBot
EMail Wolf
EasyDL
EirGrabber
ExtractorPro
FDM
Fimap
FlashGet
Foobot
Grabber
HTTP::Lite
HaosouSpider
Jetty
JustView
Lanshanbot
LinkScan
LinksManager
LinqiaRSSBot
Litemage_walker
MJ12bot
Majestic-SEO
Mass Downloader
MeanPath Bot
Minefield
Mojolicious
Mozlila
Msrabot
NPbot
NimbleCrawler
Nimbostratus
Openfind
PageScorer
Pandalytics
Panscient
Picscout
Pixray
PleaseCrawl
Probethenet
PyCurl
RebelMouse
Rogerbot
SEOkicks
SEOstats
SISTRIX
Scrapy
Screaming
ScreenerBot
Searchestate
Semrush
SemrushBot
Siphon
SlySearch
Snapbot
Spanner
Spbot
Sucuri
Typhoeus
Virusdie
WBSearchBot
WEBDAV
WeSEE
Web Collage
Web Fuck
Web Pix
WebBandit
WebEnhancer
WebGo IS
WebStripper
Webster
Wonderbot
Woobot
ZoomBot
check1.exe
crawl.sogou.com
domainsproject.org
eCatch
iubenda-radar
netEstate NE Crawler
polaris version
scan.lol
seobility
seocompany.store
siteripz
tAkeOut
trendiction.de