nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2023-07-13 22:05:02 +00:00

100 lines
1 KiB
Text

Aboundexbot
Alligator
Anarchie
Anarchy99
Attach
BDFetch
BLEXBot
BackWeb
Badass
Bandit
BetaBot
Bitacle
Blow
BunnySlippers
BuzzSumo
Cegbfeieh
Claritybot
Craftbot
Disco
Discobot
DomainCrawler
DomainSigmaCrawler
Domains Project
EMail Siphon
Foobot
FrontPage
FyberSpider
G-i-g-a-b-o-t
GalaxyBot
HTMLparser
HonoluluBot
Image Fetch
InterGET
Jbrofuzz
LinkextractorPro
MSIECrawler
Mail.RU_Bot
MarkWatch
Mb2345Browser
Musobot
Name Intelligence
Navroad
NearSite
Needle
NetAnts
NetZIP
Netcraft
Niki-bot
Openvas
PageThing.com
Pandalytics
PyCurl
RankFlex
Rankivabot
Re-re
RealDownload
SBIder
SEOkicks-Robot
SEOprofiler
SEOstats
Scanbot
ScoutJet
ScreenerBot
Semrush
Sitevigil
Sottopop
SuperHTTP
Telesphorep
Toweyabot
Tracemyfile
Trendiction
TurnitinBot
TwengaBot
Vacuum
Virusdie
WISENutbot
WWW-Collector-E
WWW-Mechanize
WWWOFFLE
Web Pix
Web Sucker
WebCollage
WebGo IS
WebSauger
Widow
Xaldon_WebSpider
Xenu
YoudaoBot
Zermelo
ZoomBot
coccocbot
crawler.feedback
dataforseobot
gopher
internetVista monitor
lwp-request
polaris version
satoristudio.net
siteripz
voyagerx.com