nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2023-03-02 10:07:37 +00:00

100 lines
1 KiB
Text

404enemy
ADmantX
AiHitBot
Alligator
Anarchy
AwarioSmartBot
Backlink-Ceck
BetaBot
BlowFish
Brandprotect
Cegbfeieh
Cloud mapping
Copier
Discobot
Exabot
ExtLinksBot
Foobot
Go!Zilla
GoZilla
Image Fetch
IndeedBot
Indy Library
Intelliseek
Iria
Jyxobot
Kenjin Spider
Lftp
LinkextractorPro
LinksManager
LinqiaRSSBot
LinqiaScrapeBot
Lipperhey
Lipperhey Spider
Lmspider
MFC_Tear_Sample
MJ12bot
MQQBrowser
MSIECrawler
Majestic-SEO
Mass Downloader
Masscan
Mb2345Browser
Meanpathbot
Minefield
Mojeek
Mojolicious
Mozlila
Name Intelligence
Needle
NetSpider
Netvibes
Nikto
Not
Offline Navigator
Openvas
OrangeBot
OrangeSpider
OutclicksBot
PeoplePal
ProPowerBot
ProWebWalker
PyCurl
RankFlex
ReGet
RedesScrapy
Rogerbot
SISTRIX
Semrush
SeobilityBot
Siphon
SiteCheckerBotCrawler
Sosospider
Swiftbot
TeleportPro
Thumbor
Toata
TwengaBot
VCI
Vacuum
VidibleScraper
Web Pix
Web Sauger
WebFetch
WebImageCollector
WebLeacher
WebSauger
Webalta
Webshag
Whack
Whacker
Wonderbot
Xaldon WebSpider
ZmEu
adscanner
facebookscraper
instabid
magpie-crawler
serpstatbot
spyfu
sysscan