nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2023-03-12 10:07:07 +00:00

100 lines
1.1 KiB
Text

01h4x.com
AIBOT
Aboundex
Acunetix
AfD-Verbotsverfahren
Apexoo
Attach
AwarioRssBot
BBBike
BDCbot
BacklinkCrawler
BatchFTP
BetaBot
Bolt
BuiltWith
Bullseye
CODE87
CheeseBot
Claritybot
Cloud mapping
Cogentbot
Cosmos
DittoSpyder
DnyzBot
DomainSigmaCrawler
Drip
Ebingbong
Fyrebot
Gotit
HMView
HTTrack
HonoluluBot
Image Sucker
IstellaBot
Jbrofuzz
Keybot Translation-Search-Machine
LWP::Simple
LinkextractorPro
LinqiaMetadataDownloaderBot
Lipperhey Spider
MIIxpc
Mag-Net
MarkWatch
Meanpathbot
MegaIndex.ru
MicroMessenger
Mojeek
Morfeus Fucking Scanner
Msrabot
NetZIP
Openfind
OrangeBot
RSSingBot
SISTRIX
Searchestate
SearchmetricsBot
Seekport
SemrushBot
Shodan
SiteLockSpider
Sottopop
SpaceBison
Spbot
Sqlmap
Sqworm
Stripper
TeleportPro
Telesoft
Toweyabot
True_Robot
UnisterBot
VidibleScraper
WBSearchBot
WWW-Collector-E
Web Pix
WebFetch
WebsiteQuester
Whacker
Who.is Bot
WiseGuys Robot
Wonderbot
Wotbox
Zitebot
ZoominfoBot
ZumBot
archive.org_bot
autoemailspider
backlink-check
cah.io.community
clark-crawler
dataforseo.com
iubenda-radar
lwp-request
netEstate NE Crawler
polaris version
s1z.ru
seocompany.store
trendiction.de
ubermetrics-technologies.com
zgrab