nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2021-10-23 22:08:29 +00:00

250 lines
2.6 KiB
Text

01h4x.com
360Spider
80legs
Aboundexbot
Acunetix
AfD-Verbotsverfahren
AiHitBot
Aipbot
Alligator
AlphaBot
Apexoo
BLEXBot
BackDoorBot
BacklinkCrawler
Badass
Bandit
Bigfoot
Bitacle
BlackWidow
Blow
BlowFish
Bolt
Brandprotect
BuiltBotTough
BuiltWith
Bullseye
BuzzSumo
CODE87
Calculon
Cegbfeieh
ChinaClaw
Cocolyzebot
Copier
CopyRightCheck
Crescent
DBLBot
DTS Agent
DataCha0s
Demon
Devil
Disco
Discobot
Discoverybot
Dispatch
DittoSpyder
DnBCrawler-Analytics
DnyzBot
DomCopBot
DomainStatsBot
Dotbot
Download Wonder
EirGrabber
Evil
Exabot
Extractor
Ezooms
FHscan
Freeuploader
Fuzz
FyberSpider
Fyrebot
GT::WWW
GetRight
Go!Zilla
GrabNet
GrapeshotCrawler
GridBot
HEADMasterSEO
HTMLparser
Haansoft
HybridBot
IDBTE4M
IRLbot
Image Sucker
IndeedBot
InfoNaviRobot
InternetSeer
Iria
IstellaBot
JamesBOT
Jbrofuzz
JustView
Kenjin Spider
Keyword Density
Kinza
Kozmosbot
LeechFTP
Lftp
LibWeb
Libwhisker
LieBaoFast
Likse
LinkWalker
Linkbot
Linkdexbot
LinqiaMetadataDownloaderBot
LinqiaRSSBot
LinqiaScrapeBot
Lipperhey
MFC_Tear_Sample
MIDown tool
MIIxpc
MJ12bot
Mail.RU_Bot
Majestic-SEO
Mata Hari
Meanpathbot
Mediatoolkitbot
Microsoft URL Control
Mojeek
Msrabot
NPbot
Name Intelligence
Needle
Net Vampire
Nibbler
Nikto
NimbleCrawler
Nimbostratus
Offline Explorer
Openfind
OrangeBot
OrangeSpider
OutclicksBot
OutfoxBot
PECL::HTTP
POE-Component-Client-HTTP
PageGrabber
PageThing.com
PeoplePal
Pi-Monster
Picscout
Piepmatz
PleaseCrawl
Pockey
PxBroker
PyCurl
RankActiveLinkBot
RankingBot
RankingBot2
RankurBot
ReGet
RealDownload
RebelMouse
Recorder
RepoMonkey
Ripper
RocketCrawler
SEOlyticsCrawler
SMTBot
SalesIntelligent
Screaming
ScreenerBot
Searchestate
SearchmetricsBot
SemrushBot
SiteCheckerBotCrawler
SiteSnagger
SiteSucker
Snoopy
Sosospider
Sottopop
SpaceBison
SpankBot
Spanner
Spinn3r
SputnikBot
Stripper
Sucuri
SuperBot
Surfbot
Szukacz
Teleport
Telesphoreo
TheNomad
TightTwatBot
Titan
Toweyabot
Tracemyfile
Trendiction
True_Robot
Turingos
Turnitin
TurnitinBot
Twice
UnisterBot
Vacuum
Vagabondo
VelenPublicWebCrawler
Virusdie
VoidEYE
Voil
WISENutbot
WWW-Collector-E
WWW-Mechanize
WWWOFFLE
Wallpapers
Web Auto
Web Collage
Web Fetch
Web Sauger
WebBandit
WebFetch
WebFuck
WebGo IS
WebImageCollector
WebLeacher
WebPix
WebStripper
Webalta
Website Quester
Whack
Whatweb
Widow
Woobot
Wotbox
Xaldon WebSpider
Xaldon_WebSpider
Xenu
Zade
Zitebot
ZmEu
ZoomBot
ZoominfoBot
arquivo-web-crawler
cah.io.community
coccocbot-web
demandbase-bot
domainsproject.org
gopher
internetVista monitor
lwp-request
magpie-crawler
meanpathbot
mediawords
muhstik-scan
netEstate NE Crawler
page scorer
pcBrowser
plumanalytics
scalaj-http
seobility
seoscanners
serpstatbot
sp_auditbot
spyfu
trendiction.com
x09Mozilla
xpymep1.exe
zauba.io