nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2023-08-09 10:07:23 +00:00

100 lines
1.1 KiB
Text

AIBOT
Acunetix
AfD-Verbotsverfahren
Aspiegel
Atomseobot
AwarioRssBot
BLEXBot
Brandwatch
BuzzSumo
Cegbfeieh
CherryPicker
ChinaClaw
Cloud mapping
Craftbot
CyotekWebCopy
DomainStatsBot
Drip
EirGrabber
Extractor
FDM
Flunky
GalaxyBot
GrapeFX
HTMLparser
HaosouSpider
HybridBot
IlseBot
IndeedBot
InternetSeer
Jorgee
Kenjin Spider
LNSpiderguy
Leap
LeechGet
Libwhisker
LinqiaMetadataDownloaderBot
LinqiaScrapeBot
Litemage_walker
Mail.RU_Bot
Majestic SEO
Meanpathbot
Mediatoolkitbot
MicroMessenger
Microsoft Data Access
Mozlila
Msrabot
Name Intelligence
Nameprotect
Net Vampire
Openfind
Openvas
OrangeBot
PECL::HTTP
POE-Component-Client-HTTP
Pandalytics
RankActive
RankFlex
RankurBot
RealDownload
Reaper
RocketCrawler
SMTBot
SalesIntelligent
Scrapy
SeekportBot
SemanticJuice
Shodan
SiteExplorer
SiteSucker
Snake
Sociscraper
SpaceBison
Spanner
Sqlmap
Stripper
Szukacz
Tracemyfile
Twice
Typhoeus
VidibleScraper
Virusdie
WWWOFFLE
Wallpapers/3.0
Web Sucker
WebFetch
WebLeacher
WebPix
Zitebot
crawler.feedback
dataforseobot
demandbase-bot
heritrix
internetVista monitor
isitwp.com
polaris version
siteripz
voyagerx.com
webgains-bot
webpros.com
x22Mozilla