nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-08-22 22:07:18 +00:00

250 lines
2.6 KiB
Text

01h4x.com
404enemy
80legs
AIBOT
Acunetix
AhrefsBot
Anarchie
Ankit
Aspiegel
Asterias
Atomseobot
Attach
BackDoorBot
Barkrowler
BatchFTP
BlackWidow
BlowFish
Boardreader
BotALot
Buddy
BuiltBotTough
BunnySlippers
BuzzSumo
CSHttp
Claritybot
Copier
CopyRightCheck
Crawling at Home Project
CyotekWebCopy
DBLBot
DIIbot
DataCha0s
DatabaseDriverMysqli
Deusu
Digincore
DigitalPebble
Disco
Dispatch
DnyzBot
DomainCrawler
Dotbot
Download Wonder
Dragonfly
ECCP/1.0
EMail Wolf
EasyDL
Exabot
ExtractorPro
Ezooms
Firefox/7.0
FlashGet
Fuzz
FyberSpider
Genieo
GermCrawler
GetWeb
Gigabot
Go-Ahead-Got-It
GoZilla
GrabNet
GridBot
HEADMasterSEO
HTMLparser
HTTrack
HaosouSpider
Heritrix
Hloader
Humanlinks
HybridBot
IDBot
IRLbot
Id-search
IlseBot
Indy Library
InfoNaviRobot
InterGET
Iria
Joomla
Jorgee
JustView
Keybot Translation-Search-Machine
Keyword Density
Kozmosbot
LWP::Simple
Lanshanbot
Leap
LeechGet
Lftp
LibWeb
LinkScan
LinkextractorPro
LinkpadBot
LinqiaMetadataDownloaderBot
Litemage_walker
Lmspider
MIDown tool
MJ12bot
Magnet
Mail.RU_Bot
Majestic12
MarkWatch
Mata Hari
MauiBot
Mb2345Browser
MegaIndex.ru
Metauri
MicroMessenger
Mister PiX
Moblie Safari
Mojeek
Mojolicious
Morfeus Fucking Scanner
Mozlila
Mr.4x3
NetAnts
NetMechanic
Netcraft
Niki-bot
Nikto
Nimbostratus
Not
Nuclei
Nutch
OnCrawl
Openvas
OrangeBot
OutfoxBot
PECL::HTTP
POE-Component-Client-HTTP
Page Analyzer
PageThing.com
Pandalytics
Pavuk
Pi-Monster
Piepmatz
Pimonster
Quick-Crawler
RankActive
RankActiveLinkBot
RankingBot
RankingBot2
RankurBot
RebelMouse
Recorder
Ripper
RocketCrawler
SBIder
SEOstats
ScoutJet
Scrapy
Screaming
Searchestate
Seekport
SemanticJuice
SeoSiteCheckup
SeobilityBot
Shodan
Siphon
SiteCheckerBotCrawler
SiteLockSpider
SiteSucker
Sitebeam
Siteimprove
Sitevigil
Sociscraper
Sogou web spider
Sosospider
Sottopop
Spanner
Spinn3r
Sqlmap
Sqlworm
Sqworm
Stripper
Sucuri
SuperHTTP
Surfbot
SurveyBot
T0PHackTeam
T8Abot
Teleport
Telesoft
TheNomad
Thumbor
Titan
Tracemyfile
Turnitin
TurnitinBot
TwengaBot
Twice
UnisterBot
VB Project
VCI
Vacuum
VeriCiteCrawler
VidibleScraper
Voltron
WISENutbot
WWW-Mechanize
WWW::Mechanize
WWWOFFLE
Wallpapers/3.0
Web Collage
Web Enhancer
Web Pix
WebAuto
WebCopier
WebImageCollector
WebSauger
WebWhacker
WebZIP
Webalta
WebmasterWorldForumBot
Webshag
Website Quester
WebsiteQuester
Webster
Whack
Widow
Wprecon
Zade
Zitebot
ZoominfoBot
archive.org_bot
autoemailspider
check1.exe
cognitiveseo
com.plumanalytics
crawl.sogou.com
crawler.feedback
dataforseo.com
heritrix
lwp-request
lwp-trivial
muhstik-scan
page scorer
plumanalytics
probe-image-size
serpstatbot
sitechecker.pro
siteripz
sp_auditbot
trendiction.com
trendiction.de
ubermetrics-technologies.com
webpros.com
webprosbot
x09Mozilla
x22Mozilla
zauba.io