nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2021-12-21 10:09:23 +00:00

250 lines
2.6 KiB
Text

80legs
AIBOT
Aboundexbot
AhrefsBot
Alexibot
Alligator
AlphaBot
Anarchie
Ankit
Anthill
Apexoo
Asterias
AwarioRssBot
BDCbot
BDFetch
BackDoorBot
Backlink-Ceck
BacklinkCrawler
Battleztar Bazinga
BetaBot
Bigfoot
BotALot
Brandwatch
Buddy
BuiltBotTough
BuiltWith
CATExplorador
CCBot
Calculon
CazoodleBot
Cegbfeieh
CensysInspect
CherryPicker
Chlooe
Cloud mapping
Cogentbot
Collector
Copyscape
Cosmos
Craftbot
CrazyWebCrawler
Crescent
CrunchBot
Curious
DIIbot
DSearch
DTS Agent
DatabaseDriverMysqli
Demon
DigitalPebble
Discobot
Dragonfly
Drip
Ecxi
ExtLinksBot
Extractor
ExtractorPro
FDM
FHscan
FemtosearchBot
Fimap
Firefox/7.0
FrontPage
FyberSpider
GalaxyBot
Getintent
Go!Zilla
Gotit
Grabber
GrapeFX
GrapeshotCrawler
GridBot
HEADMasterSEO
HTMLparser
HTTrack
Haansoft
Harvest
Heritrix
Humanlinks
IlseBot
Indy Library
InfoNaviRobot
InfoTekies
Intelliseek
InternetSeer
Iria
JamesBOT
JetCar
Jetty
JikeSpider
Kenjin Spider
Lanshanbot
Leap
LexiBot
LibWeb
LieBaoFast
Lightspeedsystems
LinkScan
Linkdexbot
LinksManager
LinqiaRSSBot
LinqiaScrapeBot
Litemage_walker
Lmspider
MIDown tool
MIIxpc
MJ12bot
Mail.RU_Bot
Majestic SEO
Majestic-SEO
MarkMonitor
MauiBot
Mb2345Browser
MeanPath Bot
MegaIndex.ru
MicroMessenger
Microsoft Data Access
Microsoft URL Control
Minefield
Mojeek
Mojolicious
Mozlila
NPbot
Nameprotect
NearSite
Nessus
NetLyzer
NetMechanic
Netcraft
Niki-bot
Not
Offline Navigator
OnCrawl
OpenLinkProfiler
Openfind
OrangeSpider
PECL::HTTP
POE-Component-Client-HTTP
Pandalytics
Papa Foto
Pi-Monster
Picscout
Piepmatz
ProPowerBot
Probethenet
Psbot
Pump
RankActive
RankActiveLinkBot
Rankivabot
Re-re
RealDownload
RebelMouse
Recorder
RedesScrapy
RocketCrawler
Rogerbot
SBIder
SEOkicks-Robot
ScanAlert
ScoutJet
ScreenerBot
SearchmetricsBot
Semrush
SemrushBot
Siphon
Siteimprove
Snoopy
SocialRankIOBot
Sociscraper
Sogou web spider
Sottopop
SpankBot
SputnikBot
Sqlmap
Sqworm
Steeler
Stripper
Sucker
SuperBot
SuperHTTP
SurveyBot
Teleport
Telesoft
The Intraformant
TheNomad
Toata
True_Robot
TurnitinBot
URLy Warning
Upflow
V-BOT
VCI
Vacuum
VeriCiteCrawler
Virusdie
VoidEYE
WASALive-Bot
WBSearchBot
WWW-Collector-E
WWW-Mechanize
Wallpapers
Wallpapers/3.0
Web Enhancer
Web Fetch
Web Pix
Web Sucker
WebBandit
WebCollage
WebFetch
WebLeacher
WebStripper
WebWhacker
WebmasterWorldForumBot
WebsiteExtractor
Whack
Wonderbot
Wprecon
Xaldon_WebSpider
YoudaoBot
Zauba
Zitebot
ZoomBot
ZoominfoBot
ZumBot
arquivo.pt
autoemailspider
crawl.sogou.com
crawler.feedback
gopher
instabid
isitwp.com
lwp-request
meanpathbot
mediawords
muhstik-scan
netEstate NE Crawler
pcBrowser
plumanalytics
s1z.ru
seocompany.store
seoscanners
seostar
sysscan
trendiction.com
trendiction.de
webgains-bot
x09Mozilla
x22Mozilla
zgrab