nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2023-05-28 22:05:26 +00:00

100 lines
1 KiB
Text

404enemy
ALittle Client
Aboundexbot
AhrefsBot
BLEXBot
BackDoorBot
BlackWidow
CCBot
CODE87
Cloud mapping
Collector
Copyscape
CrazyWebCrawler
Custo
CyotekWebCopy
DSearch
Devil
Discobot
Dispatch
EMail Wolf
Ebingbong
ExtLinksBot
EyeNetIE
Foobot
GermCrawler
GoZilla
GrabNet
GrapeshotCrawler
HTMLparser
HTTrack
Hloader
IDBot
Id-search
JikeSpider
Jorgee
Jyxobot
Lftp
LinkScan
Lipperhey
Lipperhey Spider
Ltx71
MIIxpc
MJ12bot
MSFrontPage
MSIECrawler
Mag-Net
Magnet
Mail.RU_Bot
Majestic-SEO
Mediatoolkitbot
MicroMessenger
Mojolicious
NetSpider
Nuclei
OpenLinkProfiler
Pixray
Proximic
RankingBot2
Rankivabot
SEOkicks
Semrush
Site Sucker
SiteSnagger
Sitebeam
Spammen
Telesoft
Titan
Toweyabot
Trendiction
VCI
VelenPublicWebCrawler
VidibleScraper
Virusdie
WASALive-Bot
WBSearchBot
Wallpapers/3.0
Web Fuck
Web Pix
WebSauger
WebsiteQuester
Webster
Widow
Wonderbot
Wprecon
ZoominfoBot
ZumBot
archive.org_bot
cah.io.community
check1.exe
crawl.sogou.com
domainsproject.org
iubenda-radar
linkdexbot
pcBrowser
satoristudio.net
seoscanners
sexsearcher
spyfu
sysscan
x09Mozilla