nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2021-09-08 22:07:11 +00:00

250 lines
2.7 KiB
Text

01h4x.com
360Spider
80legs
ADmantX
AIBOT
ALittle Client
Aboundexbot
AfD-Verbotsverfahren
AhrefsBot
AiHitBot
Alligator
AlphaBot
Anarchy
Apexoo
Asterias
Attach
AwarioSmartBot
BBBike
BDCbot
BLEXBot
BackDoorBot
BackStreet
Bandit
BatchFTP
Battleztar Bazinga
Bigfoot
Blow
Buddy
BuiltBotTough
BunnySlippers
BuzzSumo
CATExplorador
CODE87
CazoodleBot
CensysInspect
CherryPicker
Chlooe
Cliqzbot
Cloud mapping
Copier
CopyRightCheck
Copyscape
Crawling at Home Project
Custo
DBLBot
DIIbot
DTS Agent
Devil
DigitalPebble
Dirbuster
Discoverybot
Dispatch
DnyzBot
DomainSigmaCrawler
Domains Project
Dragonfly
ECCP/1.0
EMail Siphon
EMail Wolf
Ebingbong
Ecxi
EirGrabber
ExtractorPro
Extreme Picture Finder
Fimap
Foobot
FrontPage
FyberSpider
G-i-g-a-b-o-t
GT::WWW
GalaxyBot
GetWeb
Getintent
Gigabot
Go!Zilla
Go-Ahead-Got-It
GridBot
HTMLparser
HTTP::Lite
HaosouSpider
Heritrix
Humanlinks
IDBot
Iblog
Id-search
Image Fetch
Indy Library
InfoNaviRobot
InfoTekies
Intelliseek
Iria
Iskanie
IstellaBot
JOC Web Spider
JamesBOT
Jbrofuzz
JennyBot
JetCar
JikeSpider
Joomla
JustView
Kenjin Spider
Keyword Density
LNSpiderguy
Lanshanbot
Leap
Lightspeedsystems
Likse
LinkextractorPro
LinksManager
LinqiaScrapeBot
Ltx71
MFC_Tear_Sample
MJ12bot
MSFrontPage
MSIECrawler
MTRobot
Mag-Net
Magnet
MarkMonitor
Mass Downloader
Mata Hari
MauiBot
MegaIndex.ru
Moblie Safari
Mojeek
Morfeus Fucking Scanner
Mozlila
Msrabot
NPbot
Name Intelligence
Nameprotect
Navroad
NearSite
Needle
Nikto
Octopus
OpenVAS
Openfind
Openvas
OutclicksBot
PECL::HTTP
PageGrabber
Pavuk
Petalbot
PleaseCrawl
Psbot
Pump
RankActiveLinkBot
Re-re
RealDownload
Reaper
RepoMonkey
SEOkicks
SEOkicks-Robot
SEOlyticsCrawler
SEOstats
ScreenerBot
ScrepyBot
Semrush
SemrushBot
SentiBot
SiteSnagger
SiteSucker
Sitebeam
SmartDownload
Snapbot
SocialRankIOBot
SpaceBison
Telesoft
Telesphorep
TheNomad
TightTwatBot
Titan
Toweyabot
Trendictionbot
Turnitin
Typhoeus
URLy.Warning
Upflow
VCI
VeriCiteCrawler
VidibleScraper
Virusdie
WASALive-Bot
WISENutbot
WWW::Mechanize
Wallpapers
Wallpapers/3.0
WallpapersHD
Web Enhancer
WebBandit
WebCollage
WebImageCollector
WebReaper
WebWhacker
Webalta
WebmasterWorldForumBot
Webshag
Website Quester
Webster
Whacker
Whatweb
Wonderbot
Wprecon
YoudaoBot
Zauba
Zitebot
ZoomBot
ZoominfoBot
ZumBot
ZyBorg
archive.org_bot
arquivo-web-crawler
arquivo.pt
check1.exe
com.plumanalytics
crawl.sogou.com
crawler.feedback
crawler4j
demandbase-bot
evc-batch
facebookscraper
gopher
lwp-request
magpie-crawler
meanpathbot
oBot
page scorer
pcBrowser
plumanalytics
polaris version
probe-image-size
ripz
s1z.ru
seobility
seoscanners
serpstatbot
sexsearcher
sitechecker.pro
siteripz
sogouspider
spyfu
sysscan
trendiction.com
ubermetrics-technologies.com
x09Mozilla
xpymep1.exe
zauba.io
zgrab