nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2024-07-31 10:06:54 +00:00

100 lines
1,008 B
Text

360Spider
Aboundexbot
AiHitBot
Alexibot
Anarchie
Anarchy
Atomseobot
Attach
BDFetch
BackWeb
Bandit
BetaBot
Bigfoot
Bitacle
Blow
Buck
BuiltWith
CATExplorador
CSHttp
Cegbfeieh
ChinaClaw
Cliqzbot
Craftbot
Crawling at Home Project
Curious
Discoverybot
Download Wonder
Dragonfly
Extractor
FDM
FrontPage
FyberSpider
GT::WWW
Genieo
GetRight
Getintent
Go-Ahead-Got-It
HTTrack
Heritrix
HybridBot
Iblog
Id-search
Image Sucker
InfraSec Scanner
InterGET
Internet Ninja
Jyxobot
Kozmosbot
Likse
LinkWalker
Linkbot
LinqiaRSSBot
MQQBrowser
MSFrontPage
Mag-Net
MarkWatch
Navroad
Netvibes
Nibbler
Ninja
Nuclei
Pi-Monster
Picsearch
Pixray
ProPowerBot
PxBroker
PyCurl
QueryN Metasearch
RSSingBot
Rankivabot
RedesScrapy
SEOkicks-Robot
SEOlyticsCrawler
SalesIntelligent
SenutoBot
Site Sucker
Snoopy
Spanner
SputnikBot
TinyTestBot
VCI
WeSEE
Web Enhancer
Web Pix
WebFetch
WebSauger
Webshag
WebsiteQuester
Webster
Who.is Bot
Wotbox
Zade
Zeus
check1.exe
cognitiveseo
lwp-trivial
page scorer
seocompany.store
serpstatbot
trendiction.de